I scraped several e-commerce websites (more than 5) and the data is stored in a large json file as a list of dictionaries, like this:{ "url": "http://ift.tt/2DSQwmZ", "price": 539, "product_code": ["x123"], "page_title": "Smartphone Samsung Galaxy S7", "h1": "Smartphone Samsung Galaxy S7, 2.3GHz / 1.6GHz, QHD Super AMOLED" } The list is composed of more than 11k dictionaries.Given that all the data is standardized, how can I search through it for best results?Is it better to use Regex or to index the json file with something like Whoosh?
http://ift.tt/eA8V8J
I scraped several e-commerce websites (more than 5) and the data is stored in a large json file as a list of dictionaries, like this:
{ "url": "https://www.amazon.com/category/product_1", "price": 539, "product_code": ["x123"], "page_title": "Smartphone Samsung Galaxy S7", "h1": "Smartphone Samsung Galaxy S7, 2.3GHz / 1.6GHz, QHD Super AMOLED" }
The list is composed of more than 11k dictionaries.
Given that all the data is standardized, how can I search through it for best results?
Is it better to use Regex or to index the json file with something like Whoosh?