Back End Engineer - Data Fetching
This job has expired. The employer might not be hiring anymore.
Sensor Tower, named one of "The 50 San Francisco Tech Companies You Should Know in 2020" is a market-leading competitive intelligence solution in the mobile app market. As a globally distributed team that has hit profitability with minimal funding ($1 million seed round), we attribute our success to both our innovative & trusted product and our talented employees. We put a great emphasis on hiring self-starters that are both driven and humble enough to recognize that there is always more to learn and more that each of us can do on our mission of being the Trusted Source of Mobile Insights.
Public companies like DocuSign and Expedia, as well as fast-growing startups like Hotel Tonight, Ticketmaster, and Robinhood turn to Sensor Tower to make key business decisions. Our insights are cited by the world's leading news and finance publications, including the Wall Street Journal, The New York Times, Forbes, Fortune, Bloomberg, CNBC, The Washington Post, and Reuters.
- Participate in the full development life cycle for data ingestion projects, including software design, implementation, quality testing, and release.
- Engage in code reviews, champion best practices, and bring new ideas to life in a collaborative environment.
- Work in close cooperation with the Product team to deliver innovative new data features by discovering new data sources, increasing coverage and reliability of existing data ingestion pipelines, and connecting these to downstream feature development and data modeling.
- Design, implement, and maintain robust data collection pipelines to fetch public data from third party sources.
- Build resilient systems that maintain high throughput within the allowed constraints of external sources.
- Monitor and troubleshoot data pipelines to ensure completeness, accuracy, and timeliness.
- Track changes in external data schemas (e.g. response format updates) and adjust collection logic as needed.
- Automate maintenance, alerting, and recovery for your scripts to minimize manual intervention.
- Work cross functionally with our compliance team to ensure data fetching is compliant with applicable laws and regulations.
- Solid knowledge of one or more modern software languages (Ruby, Python).
- Solid understanding of RESTful systems and the principles of good API design.
- Understanding of data hygiene, validation, and versioning.
- Experience with REST APIs, HTTP request libraries, and HTML parsing tools .
- Ability to debug and adapt in fast-changing or partially documented data environments.
- Strong problem-solving skills, attention to detail, and ability to work independently.
- Excellent communication and collaboration skills.
- Experience fetching public data from the Apple App Store, Google Play, or similar public-facing platforms.