Principal Data Engineer
Beamly is a fast-growing next generation digital marketing and technology agency with gross revenues of $120m+ and a team of 160+ sitting primarily in London and New York but with broader delivery teams right across the world.
Beamly’s product team of 70+ product managers, engineers, designers and data scientists sit entirely in our Covent Garden, London offices. Beamly was acquired by COTY Inc in October 2015, which as the 3rd largest beauty company in the world has opened up uniquely rich engagement across global brands including Calvin Klein, Gucci, Burberry, Rimmel, Max Factor, Covergirl, Sally Hansen, Wella and Clairol. Further Beamly has a growing client base outside of COTY and outside of beauty.
About the role
As the Principal Data Engineer at Beamly, you’ll be responsible for ensuring the development of our robust data platform.
The vision for our data platform is to empower our brand partners to achieve high-impact business outcomes through data management and associated analytics.
Our data platform’s purpose is to improve consumer experience and communications activity performance, to mitigate risk, drive product innovation and achieve operational excellence. You will lead the implementation of the platform from data collection through storage and on to processing.
Your expertise and judgement must ensure that we make the right product decisions to reflect scalability needs, balance latest innovations with development speed and system stability. At all times considering budget and optimisation of existing assets.
As a Principal, you will also lead the Data Engineering ‘Guild’ within Beamly. We seek individual excellence within collaborative teams.
What you'll do
- Proactively scans the marketplace for innovative new ways to collect, store, process or activate data for analytics and / or consumer experience automation.
- Works seamlessly in Tribe / Squad with Data Scientists and other software engineers to:
- Operate and innovate Beamly data platform and associated data products.
- Continuously improve the design and architecture of the data platform.
- Productionises the management of data and the connection of data with marketplace partners to power analytics services and to activate tailored solution decisioning tools.
- Build batch processing systems, ETLs and data ingestion flows
- Build event driven processing systems
- Build API’s to front-end data science models with appropriate levels of security, authentication, logging, and modelling.
- Proactively leads work with the wider engineering team to find opportunities for improvement and delivering solutions
- Leads the development of new processes and ways of working to ensure continuous improvement and innovation
- Delivers continuous service improvement through interfacing across the service management team
- Enhances delivery by supporting internal teams and external service providers to understand and drive full utilization of the platform
- Demonstrates initiative proactively suggesting ways to further improve data platform and analytics capability within context of broader infrastructure and capability suite
- Contributes to the achievement of exceptional deployment and operational standards by defining the opportunity for data engineering driven advancements
- Inspire confidence and credibility amongst your squad and tribe peers of the engineering delivery
- Proactively brings forward innovation ideas to your guild, sharing knowledge and experience
- Seeks opportunity to own key components of project delivery
- Inspires a sense of team and collaboration
- Contributes to exceptional recruitment and development processes
- Leads by example through living the Beamly values
- Passionate about data engineering and delivering highly performant quality maintainable systems
- Demonstrates intellectual curiosity about how new innovation can further improve infrastructure and shared services
- Makes data driven decisions and drives the systems and processes to make this possible
- Sets clear and measurable objectives with stretch outcomes
- Drives personal development across guild members, defining priority areas of domain expertise and paths to get there
- Defines and improves the on-call support rota
- Sets and raises standards for the guild each quarter
- Appoints and inspires deputies in other tribes to drive progression
- Hires high performing guild members across tribes in conjunction with the VPs
- Performs 360 reviews of guild members to support the divisions
What you'll bring to the role
Brings professional experience across the following:
- At least two systems/scripting languages (including Python)
- Expert knowledge of UNIX and networking
- Expert in running a Continuous deployment environment
- Expert in running production services on AWS
- A degree in Computer Science or a related field, or 7 years of practical experience with any of the above
- Knowledge of Data Modelling systems and technologies such as R, Pandas, NumPy, Scikit-learn, Matplotlib
- Knowledge of platforms such as Airflow, AWS EMR, Docker, AWS Lambda, AWS SageMaker, AWS DataPipeline, AWS Kinesis Jupyter Qubole
- Knowledge of Databases / Processing such as RedShift, Athena, Postgres, Spark, Hive, Pig.
- Production experience with containerization
- An end-to-end understanding of modern web architectures from CDN to persistence layers
What’s it like to work at Beamly?
Working at Beamly means joining a world-class team working on exciting challenges. Fortnightly we have ‘Scoff & Share’ lunches where we share knowledge across teams, and the whole company gathers together for Friday ‘Show and Tell’ with drinks. We also set time aside for continuous improvement and take the professional development of our team members seriously.
We enjoy a dynamic working environment in Covent Garden – very well-connected and surrounded by loads of shops, bars and restaurants. Team members have also organised a lunchtime pool league, weekly football game, visiting manicure service, and deals on local gym classes.
As a Beamly employee, you'll also benefit from...
- a high spec MacBook Pro with a choice of peripherals
- private medical insurance (taxable)
- life assurance (4 x base salary)
- 25 days’ holiday per annum
- Extra day's holiday on your birthday
- childcare vouchers
- flexible office hours
What is the hiring process?
We believe that diverse teams build better products and strive to offer equal opportunity to all applicants. If your application is successful you will move through three short phases:
- We'll check your CV meets the requirements for the role, which are detailed above.
- We'll arrange a 45-minute phone interview with you to talk about you and the role and gauge the relevance of your experience.
- We'll invite you to our office to meet our team
Any questions? If you have any queries whatsoever, there’s a box on the application form where you can let us know. We'll address them by e-mail or during the phone interview.
Unfortunately, only applicants who have the right to work in the UK will be considered. Visa sponsorship is not available at this time.
Recruiters: Unsolicited applications submitted by recruitment agents will not be considered.