Implementing paging with multiple data sources
I have multiple data sources that I need to search across and return back to the client (web app). For example the sources are: an elastic search index a sql database Is there an efficient way to perform paging across two sources? At the moment I am searching on one, and then reducing the searchable items on the second, then paging only. Alternative options: Ideally, I would like to move one source into the other, but for various reasons (e.g. space constraints, pricing etc.) this seems not a viable option. Disabling the search until a more refined criteria is placed in, so the returning result set is guaranteed to be smaller and thus paging is of less importance. Without the paging, the performance of this aspect of the application is not great when the search criteria is more open. Are there any approaches for this nature of searching?
I have multiple data sources that I need to search across and return back to the client (web app).
For example the sources are:
- an elastic search index
- a sql database
Is there an efficient way to perform paging across two sources? At the moment I am searching on one, and then reducing the searchable items on the second, then paging only.
Alternative options:
- Ideally, I would like to move one source into the other, but for various reasons (e.g. space constraints, pricing etc.) this seems not a viable option.
- Disabling the search until a more refined criteria is placed in, so the returning result set is guaranteed to be smaller and thus paging is of less importance.
Without the paging, the performance of this aspect of the application is not great when the search criteria is more open.
Are there any approaches for this nature of searching?
