San Jose, California, United States•San Jose, United States (US)
Remote
Senior
Full Time
💰$178,888 - $268,333
machine_learningdata_infrastructuredistributed_systemspythonsqlsparkdatabrickssenior
Requirements
- •Experience building and operating distributed systems, ML infrastructure, or data platforms with ownership of meaningful production components
- •Hands-on experience improving production model performance such as latency, throughput, resource utilization, or cost
- •Strong experience with Databricks and Spark or comparable offline data platforms including execution plans, distributed query optimization, storage layouts, data correctness, and workload cost management
- •Experience with the model lifecycle including training and serving integration, validation, deployment, observability, and rollback
- •Strong Python and SQL skills, plus proficiency in at least one backend or systems language such as Java, Scala, Go, or C++
- •Ability to work independently through loosely defined problems, make sound implementation decisions, and deliver maintainable systems with limited guidance
What You'll Do
- •Improve model inference latency, throughput, resource utilization, and cost
- •Profile the prediction path from feature retrieval and preprocessing to model execution and implement measurable improvements while preserving model quality
- •Build and maintain infrastructure for model packaging, versioning, deployment, serving, monitoring, and rollback across cloud platforms and regions
- •Develop and optimize offline data pipelines using Databricks, Apache Spark, and warehouse or lakehouse technologies
- •Work on offline and online feature pipelines supporting point-in-time correctness, consistent feature definitions, freshness, lineage, and reproducible backfills
- •Build and maintain reliable feature services and data integrations for risk models and decision systems
- •Take ownership of projects and operational issues, communicate progress and tradeoffs, and collaborate with ML, data engineering, cloud infrastructure, security, and product teams
- •Contribute to technical discussions, share knowledge, and help teammates through code reviews and collaboration
Nice to Have
- •Experience with SageMaker, Alibaba Cloud PAI/EAS, or comparable ML platforms
- •Inference optimization using tools such as ONNX Runtime, TensorRT, or Triton
- •Experience with Delta Lake, MLflow, feature stores, Kafka, Flink, and low-latency data stores
- •Experience with fraud detection or financial risk systems
- •Fluency in Mandarin
Benefits
- •Competitive total compensation package
- •L&D programs for employees' growth and development
- •Various team building programs and company events
- •Wellness and meal allowances
- •Comprehensive healthcare schemes for employees and dependants
- •Additional perks disclosed during the hiring process
