Sr Lead Big Data Developer

Job description
About Lumen

Lumen connects the world. We are igniting business growth by connecting people, data and applications – quickly, securely, and effortlessly. Together, we are building a culture and company from the people up – committed to teamwork, trust and transparency. People power progress. We’re invested in providing the flexibility you need to thrive and deliver lasting impact. Apply now to continue digitally connecting the world and shaping the future.
The Role

We are looking for a Lead Big Data Developer who is passionate about working with large-scale systems using cutting-edge technologies and tools to help identify and disrupt malicious threats on the Internet. This role is on Lumen’s Black Lotus Labs organization. As the Threat Research and Operations arm of Lumen, we leverage our unmatched network visibility to protect your business and help keep the internet clean. You will be part of a dynamic and collaborative team with an opportunity to lead the team that develops software to help identify and find threats within network-like datasets.

Location

This role is designated as a fully remote position within the United States.

The Main Responsibilities
• Provide technical direction in the creation, implementation, and integration of complex big data solutions
• Collaborate and translate business requirements into implementation design and participate in the design, evaluation, and selection of best software solutions to achieve business objectives
• Design, develop, test, and deploy scalable and reliable data pipelines using technologies like Spark, Kafka, Hadoop, and other big data technologies
• Extract, transform, and load data from various sources and formats, such as relational databases, APIs, JSON, XML, CSV, etc.
• Perform data quality checks and validations, and handle data anomalies and issues
• Collaborate with other developers, data engineers, data analysts, and business stakeholders to understand data requirements and deliver data solutions
• Develop scalable systems that enable real-time validation of identified resources
• Mentor junior developers and engineers on the team and champion industry best practices
• Explore, evaluate, and conduct PoC to determine new technology solutions that would improve our ability to detect newer threats or add efficiency to current processes

What We Look For in a Candidate
• 7+ years of experience. Master’s or Bachelor's degree in Computer Science, Engineering, Mathematics, or related field, or equivalent work experience
• Can demonstrate past experience in developing and working with big data technologies, such as Spark, Kafka, Hadoop, Hive, etc.
• Proficient in programming languages, such as Python, Java, Scala, or SQL
• Strong analytical and problem-solving skills, and attention to detail
• Good communication and teamwork skills, and ability to work independently and proactively
• Eager to learn new skills and technologies, and willing to take on challenges

Compensation

This information reflects the anticipated base salary range for this position based on current national data. Minimums and maximums may vary based on location. Individual pay is based on skills, experience and other relevant factors.

Location Based Pay Ranges

$129,639 - $172,852 in these states: AL AR AZ FL GA IA ID IN KS KY LA ME MO MS MT ND NE NM OH OK PA SC SD TN UT VT WI WV WY
$136,121 - $181,494 in these states: CO HI MI MN NC NH NV OR RI
$142,603 - $190,137 in these states: AK CA CT DC DE IL MA MD NJ NY TX VA WA

#LI-VK1

Lumen offers a comprehensive package featuring a broad range of Health, Life, Voluntary Lifestyle benefits and other perks that enhance your physical, mental, emotional and financial wellbeing. We're able to answer any additional questions you may have about our bonus structure (short-term incentives, long-term incentives and/or sales compensation) as you move through the selection process.

Learn more about Lumen's:

Benefits*

Bonus Structure

Requisition #: 337761

Background Screening

If you are selected for a position, there will be a background screen, which may include checks for criminal records and/or motor vehicle reports and/or drug screening, depending on the position requirements. For more information on these checks, please refer to the Post Offer section of our FAQ page. Job-related concerns identified during the background screening may disqualify you from the new position or your current role. Background results will be evaluated on a case-by-case basis.

Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Equal Employment Opportunities

We are committed to providing equal employment opportunities to all persons regardless of race, color, ancestry, citizenship, national origin, religion, veteran status, disability, genetic characteristic or information, age, gender, sexual orientation, gender identity, gender expression, marital status, family status, pregnancy, or other legally protected status (collectively, “protected statuses”). We do not tolerate unlawful discrimination in any employment decisions, including recruiting, hiring, compensation, promotion, benefits, discipline, termination, job assignments or training.

Disclaimer

The job responsibilities described above indicate the general nature and level of work performed by employees within this classification. It is not intended to include a comprehensive inventory of all duties and responsibilities for this job. Job duties and responsibilities are subject to change based on evolving business needs and conditions.

In any materials you submit, you may redact or remove age-identifying information such as age, date of birth, or dates of school attendance or graduation. You will not be penalized for redacting or removing this information.

Please be advised that Lumen does not require any form of payment from job applicants during the recruitment process. All legitimate job openings will be posted on our official website or communicated through official company email addresses. If you encounter any job offers that request payment in exchange for employment at Lumen, they are not for employment with us, but may relate to another company with a similar name.

Application Deadline
08/01/2025 Read more