Data Engineer II, AWS Actuals
Job ID: 2771184 | Amazon.com Services LLC
DESCRIPTION
Are you passionate about data? Does the prospect of dealing with massive volumes of data excite you? Do you want to build data engineering solutions that process billions of records a day in a scalable fashion using AWS technologies? Do you want to create the next-generation tools for intuitive data access? If so, AWS Finance Technology (AWS Fintech) is for you!
AWS Fintech is seeking a Data Engineer to join the team that is shaping the future of the finance data platform. The team is committed to building the next generation big data platform that will be one of the world's largest finance data warehouse to support Amazon's rapidly growing and dynamic businesses, and use it to deliver the BI applications which will have an immediate influence on day-to-day decision making. Amazon has culture of data-driven decision-making, and demands data that is timely, accurate, and actionable. Our platform serves Amazon's finance, tax and accounting functions across the globe.
As a Data Engineer, you should be an expert with data warehousing technical components (e.g. Data Modeling, ETL and Reporting), infrastructure (e.g. hardware and software) and their integration. You should have deep understanding of the architecture for enterprise level data warehouse solutions using multiple platforms (RDBMS, Columnar, Cloud). You should be an expert in the design, creation, management, and business use of large data-sets. You should have excellent business and communication skills to be able to work with business owners to develop and define key business questions, and to build data sets that answer those questions. The candidate is expected to be able to build efficient, flexible, extensible, and scalable ETL and reporting solutions. You should be enthusiastic about learning new technologies and be able to implement solutions using them to provide new functionality to the users or to scale the existing platform. Excellent written and verbal communication skills are required as the person will work very closely with diverse teams. Having strong analytical skills is a plus. Above all, you should be passionate about working with huge data sets and someone who loves to bring data-sets together to answer business questions and drive change.
Our ideal candidate thrives in a fast-paced environment, relishes working with large transactional volumes and big data, enjoys the challenge of highly complex business contexts (that are typically being defined in real-time), and, above all, is a passionate about data and analytics. In this role you will be part of a team of engineers to create world's largest financial data warehouses and BI tools for Amazon's expanding global footprint.
Responsibilities
- Design, implement, and support a platform providing secured access to large datasets.
- Interface with tax, finance and accounting customers, gathering requirements and delivering complete BI solutions.
- Model data and metadata to support ad-hoc and pre-built reporting.
- Own the design, development, and maintenance of ongoing metrics, reports, analyses, dashboards, etc. to drive key business decisions.
- Recognize and adopt best practices in reporting and analysis: data integrity, test design, analysis, validation, and documentation.
- Tune application and query performance using profiling tools and SQL.
- Analyze and solve problems at their root, stepping back to understand the broader context.
- Learn and understand a broad range of Amazon’s data resources and know when, how, and which to use and which not to use.
- Keep up to date with advances in big data technologies and run pilots to design the data architecture to scale with the increased data volume using AWS.
- Continually improve ongoing reporting and analysis processes, automating or simplifying self-service support for datasets.
- Triage many possible courses of action in a high-ambiguity environment, making use of both quantitative analysis and business judgment.
Key job responsibilities
1. Create an operationally stable data pipeline that deals with a very large transactional volume
2. Ability to innovate on transactional data processing on a file system like use of open table format, incremental data processing, etc.
3. Understand the business domain and create dataset/data mart of leadership reporting
4. Implement data governance on the dataset including data lineage, data quality, fine grain access control, etc.
5. Innovate on the technical stack of compute, storage and visualization
About the team
Daily Revenue Platform is a brand new team and its mission is to be the Authoritative Source of truth for Daily GAAP financials. The datasets generated by this team powers other AWS Finance applications, Forecasting team, Leadership reporting and BI systems. This team will be responsible to drive the AWS Fintech organizations vision forward in terms of proactive insights, metrics and drive better business decisions.
BASIC QUALIFICATIONS
- 4+ years of data engineering experience
- Experience with data modeling, warehousing and building ETL pipelines
- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
- Experience with SQL
- Bachelor's degree
- Knowledge of distributed systems as it pertains to data storage and computing
PREFERRED QUALIFICATIONS
- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
- Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
- Knowledge of professional software engineering & best practices for full software development life cycle, including coding standards, software architectures, code reviews, source control management, continuous deployments, testing, and operational excellence
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.
Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $118,900/year in our lowest geographic market up to $205,600/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit https://www.aboutamazon.com/workplace/employee-benefits. This position will remain posted until filled. Applicants should apply via our internal or external career site.
Job details
- USA, WA, Seattle
- USA, TX, Dallas
Recommended jobs
Based on your recent activity, you may be interested in:
- Location: US, Virginia, Arlington(Updated about 2 months ago)
- Location: US, Washington, Seattle(Updated about 2 months ago)
- Location: US, Washington, Seattle(Updated 16 days ago)
- Location: US, Virginia, Arlington(Updated about 2 months ago)
- Location: US, Washington, Seattle(Updated about 1 month ago)
