Data Engineer

United States (US)•San Jose, United States

Remote

Senior

Full Time

2 days ago

💰$214,666 - $321,999

Data EngineerData EngineeringCloudSparkFlinkSQLNoSQLBig Data

Requirements

•Bachelor’s Degree in Computer Science
•At least 7+ years of experience in Data Engineering with significant focus on Data Marts
•Solid experience with data processing tools such as Spark and Flink
•Solid experience implementing batch and streaming data pipelines
•In-depth knowledge of both SQL and NoSQL databases, including performance tuning and troubleshooting
•Proficient in SQL, familiar with advanced SQL features such as window functions, aggregate functions and creating scalar functions/user-defined functions
•Proven successful and trackable experience in full end-to-end data solutions involving data ingestion, data persistence, data extraction and data analysis

•Design, build, and maintain analytics-ready Data Marts using best-practice dimensional modeling (star/snowflake schemas)
•Partner with analytics and business teams to understand requirements and deliver trusted, well-documented datasets
•Design and build resilient and efficient data pipelines for both batch and real-time streaming data
•Architect and design data infrastructure on cloud using industry standard tools
•Ensure data integrity and scalability through enforcement of data standards
•Improve data validation and monitoring processes to proactively prevent, identify and resolve issues
•Define, understand, and test external/internal opportunities to improve our products and services

•Experience with Data Analysis platforms like Datawind
•Experience in Big Data tools such as Ali Cloud DataWorks, MaxCompute, AWS DataBricks, Hadoop, Hive, Spark and HBase