Overview:
As a Data Engineer, you will work with stakeholders and the internal development team to guide the technical development of enterprise data solutions. The Data Engineer is a combination of a business and technical customer-facing role that will be accountable for the end-to-end customer data architecture, development, deployment, and support. The Data Engineer will be responsible for working with stakeholders to identify opportunities to leverage data to drive business value. In addition, you will be responsible for mining and analyzing data to drive efficiency and optimization, develop custom data models and algorithms, and develop processes and tools to monitor production systems and data accuracy.
Details:
- Estimated Duration of Project: 8 Months
- Work Location: Remote, Boston, Austin, and Las Vegas options
Responsibilities:
- Integrate with around 10-15 external data sources, primarily via API
- Perform data analysis to ensure pulled data meets business goals.
- Perform basic data transformations to pull data
- Write pulled data to simple tables in Postgres database in the AWS cloud
Required Qualifications:
- 4 Year College Degree in Computer Science, Mathematics, Statistics or a similar quantitative field or comparable experience in lieu of degree
- Have 3+ years of experience building data pipelines and ETL workflows from internal and external data sources using cloud platforms like Amazon Web Services, Azure or Google Cloud Platform
- Have experience with message queues
- Have experience using third party APIs
- Have experience with webhooks and callback URLs
- Proficient with Python and SQL
- Have experience working with RDBMS databases, such as Postgres
- Self-starter who can act autonomously as well as thrive in a strong team environment
- Be able to work with, clarify, and find creative solutions for ambiguous and sometimes challenging requests
- Be able to effectively and efficiently troubleshoot data issues and bugs
- Have excellent written and verbal communication skills
Bonus qualifications:
- Familiar with Agile software development process
- Advanced SQL knowledge