Data Engineer

Afresh Technologies · San Francisco, CA/Austin, TX

Engineering Food & Agriculture Poverty Alleviation & Economic Development Posted 3 weeks ago

Excel
Pandas
Kubernetes
Python
Heroku
SQL
ExpressJS
Machine Learning
Claim this company
Featured Job

Afresh is on a mission to reduce food waste and increase access to nutritious food globally by transforming the fresh food supply chain. By 2021, we're aiming to reduce food waste by a quarter billion pounds per year!

Our Data team plays a critical role in this mission by writing code that processes customer-provided data to power both the ordering application and the recommendations within, allowing us to optimize our grocery partner's ordering and business processes. Our customers give us large amounts of data, and ensuring that our system can accurately, reliably and scalably process that data is key to our success.

If you're interested in building software to support our mission, we hope you'll join us!

What you will do

  • Implement fast, reliable, scalable data pipelines in Python (and Pandas and Spark) and SQL to process billions of historical data points collected from tens of thousands of retail stores across the US

  • Build out, scale up, and deploy our compute platform (running on Azure cloud infrastructure using Kubernetes) and data platform (powered by a combination of traditional databases, data warehouses, and data lakes) that power our recommendation engine and ordering system

  • Implement reusable libraries and abstractions for ensuring that we can scale our services to more, bigger customers and different departments and domains

  • Work with our customers to integrate, triage issues, and find novel workarounds to extract the signal that we need from the data provided by our customers

  • Monitor, analyze, and understand the data flowing through our system by adding the necessary visualizations, dashboards, and health checks

  • Collaborate with an interdisciplinary team of experts in machine learning, data scientists, design, software engineering, and business operations to ensure that the resulting data is as expected

What skills and experience do you need?

  • 4+ years of professional experience building, deploying, and maintaining production software and systems at scale using modern development practices and programming languages (preferably Python)

  • 2 years of professional experience writing data pipelines that clean up, process, and provide access to data using high-level programming languages, such as Python or Scala, and SQL

  • Strong understanding and experience with various data stores (databases, data warehouses, key/value stores, etc.)

  • Experience with Apache Spark or other Big Data frameworks; working with cloud infrastructure; data visualization tools; and applied statistics preferred

  • Dedication to code quality, testing, design processes, automation, and operational excellence

  • Excellent written and verbal communication, collaboration, and social skills

  • Bachelors or Masters in Computer Science or equivalent

The above represent attributes our ideal candidate possesses. We encourage all highly-qualified candidates to apply, even if they do not fulfill all the listed criteria.

About Afresh:

Founded in 2017, Afresh is the first A.I.-powered fresh food optimization platform for grocery chains. We have partnered with several large grocers representing hundreds of stores and >$10B in revenue. Our cutting-edge AI research has been published in top journals (e.g., ICML). We’re backed by some of the top investors in grocery and tech including Innovation Endeavors (former Google CEO Eric Schmidt’s firm), Baseline Ventures (first money in Stitch Fix, SoFi, Heroku, Instagram), Food Retail Ventures, Maersk Growth, and Impact Engine.

We are building a vibrant, diverse, and inclusive team that embodies our company’s values: proactivity, kindness, candor, and humility. We aspire to continually grow as individuals and as an organization to live these values and realize our mission. We earnestly believe that Afresh represents a one-of-a-kind opportunity to have massive social impact at scale by employing novel technology—and to have a ton of fun along the way.

Afresh provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, sexual orientation, gender identity/expression, marital status, pregnancy or related condition, or any other basis protected by law.

Related Jobs

Lead Software Engineer, ML Platform - Afresh Technologies
San Francisco, CA - Posted 1 week ago
Lead Full-Stack Engineer - Afresh Technologies
San Francisco, CA - Posted 1 week ago

Connect with your next key hire on Tech Jobs for Good.

Post a featured job Schedule a demo