Senior Data Engineer

A bit about our technology

We are big believers in the Modern data stack. We utilise AWS, Snowflake and dbt for the bulk of our data processing, Lightdash for visualisations. In terms of data ingestion we currently run Segment & Meltano and we’re constantly looking at ways of improving this. Terraform is our tool of choice for IAC and like a lot of companies out there we use Github to store our code. 

From powering our A/B tests and personalising the shopping experience to reporting on the state of the business, data is at the heart of what we do!

So, what will you be doing?

You will be joining our Data and Analytics team, architecting and building the next generation of our Data Platform at Beauty Pie. So what does this mean?

• Gather, analyse, and transform data from diverse sources, ensuring cleanliness and quality.
• Construct data models, pipelines, and stores to facilitate seamless data flow
• Collaborate with business stakeholders to understand requirements and tailor data solutions accordingly
• Drive the evolution and maturation of our Data Platform, focusing on scalability, reusability, and governance
• Embrace a high-performance, open, and honest team culture, embodying a strong work ethic and passion for data excellence

We believe it's all about mindset, great skills and attitude and a fantastic work ethic being key. We’re a high-performance, open and honest team. If you’re excited about the opportunity, and you’re passionate about data (even if you don’t tick all the boxes) apply anyway!

Requirements

• Proficiency in AWS, including Lambdas and Serverless
• Experience with various programming paradigms, such as object-oriented and functional programming
• Familiarity with streaming/event-driven architecture, including tools like Kafka and Kinesis/Firehose
• Expertise in data ingestion techniques, encompassing both stream and batch processing
• Hands-on experience with cloud and SaaS-based data storage solutions like Snowflake
• Understanding of data lake and data warehousing patterns
• Knowledge of containerization technologies
• Proficiency in monitoring, alerting, and Infrastructure as Code (IAC) principles using tools like Terraform for AWS infrastructure management
• Experience in continuous delivery, testing automation, and version control systems like Git and GitHub

And finally

The code we write is largely based on Javascript, although we’re not afraid to explore new and emerging technologies and tools if they are right for us. Our progressive storefront uses Next.js for a lightning fast user experience that is discoverable by search engines. We use Chakra UI for our React component library to build a world class customer experience. We’ll likely build native at some point too, though we haven’t yet decided whether to build native or use React Native. No need to rush into decisions!

Our clients are separated from our core services by a GraphQL BFF, providing a clean abstraction and allowing the frontend to iterate independently from backend services. We use a combination of third party solutions and our own services built using node.js. We host all most of our technical estate within AWS, using Terraform to create consistent and reproducible environments.

It’s not all about the languages and tools we use. Continuously delivering business value through rapid delivery, learning and adapting is our mantra. We use the latest modern software delivery processes with an ambition to automate everything, branch, build, deploy, test, ship, watch, monitor and alert all fully automated, so we can focus on building an awesome experience for our customers and back office business.