Realtime prising data platform
About Project
Web
PLATFORMUSA
COUNTRYTrade
INDUSTRY2 years
PROJECT DURATION3 Members
SIZE OF TEAM2016
COMPLETEDAbout Project
Web
PLATFORMUSA
COUNTRYTrade
INDUSTRY2 years
PROJECT DURATION3 Members
SIZE OF TEAM2016
COMPLETEDTechnologies & Tools
Challenges and Objectives
To achieve our goals we implemented such things:
-
The data is stored in AWS Redshift.
-
We use Postgres for real-time aggregations during scraping.
-
Play libraries are used for making http requests.
-
Play JSON and JSoup libraries for Json and HTML parsing.
-
AWS Kinesis for moving the data into Redshift.
-
Spark for populating Cassandra db.
Results
UNPRECEDENTED ACCESS TO GROCERY AND RETAIL PRICES collected from the web.
Prices are collected for each store and zip code, allowing you to track who is selling what, where, and for how much
Datasembly's up-to-date data empowers you to make fast, informed, data-driven decisions. Don't let stale data ruin your analysis Prices, availability,
and promotion data, covering all your geographies, all your products, and all your competition.
Customer Feedback
Dan Gallagher
CTO at Datasembly
Review more our projects in Trade industry