Software Developer II (OSINT & web scraping)

Opportunity & Role

We are seeking a talented and motivated Mid-Level Software Developer to join our development team. In this role, you will be instrumental in developing and maintaining our cutting-edge drone threat intelligence platform. You will be involved in all aspects of the software development lifecycle, from designing and implementing web scrapers to building and enhancing the platform's features and performing in-depth data analysis to extract valuable insights. This is an exciting opportunity to work on a unique and impactful product in a rapidly evolving field.

Your work will directly influence the C-UxS mission and understanding of countering the growing threat of UxS. You will interact with the collection team to assemble, fuse, and deliver tailored data rich answers to requests for information (RFI) from various customers.

Key Responsibilities

• Design, develop, and maintain robust and efficient web scrapers to collect data from various online sources (both Publicly Available Information and some restricted access locations).

• Contribute to the architecture, design, and development of our drone threat intelligence platform and Open-Source Intelligence (OSINT) capabilities.

• Write clean, well-documented, and testable code.

• Knowledge about secure code or secure coding practices.

• Perform data wrangling, including cleaning, transforming, and visualizing data to work with the threat analysts to identify trends and patterns related to drone threats.

• Perform data insertion into globally distributed databases. 

• Collaborate with data scientists and other engineers to enhance the platform's analytical capabilities.

• Troubleshoot and resolve software defects and issues.

• Participate in code reviews to ensure code quality and adherence to best practices.

• Stay up-to-date with the latest technologies and trends in web scraping, data analysis, and threat intelligence.

• Contribute to the continuous improvement of our development processes.

Other Responsibilities

• Document infrastructure, workflows and onboarding process documentation

• Assist with the DroneSec platform product(s) roadmap and requirements.

Required Skills and Qualifications

• Bachelor's degree in Computer Science, Software Engineering, or a related field.

• 3+ years of experience in software development.

• Strong proficiency in at least one programming language such as Python, Java, or Go. Python is highly preferred for web scraping and data analysis tasks.

• Strong proficiency in PHP / Laravel.

• Proven experience in developing and deploying web scrapers using frameworks and libraries like Scrapy, Beautiful Soup, or similar.

• Experience with data analysis libraries and tools such as Pandas, NumPy, and Matplotlib in Python, or similar tools in other languages.

• Solid understanding of data structures, algorithms, and software design principles.

• Experience working with databases (e.g., PostgreSQL, MySQL, MongoDB).

• Familiarity with RESTful APIs and microservices architecture.

• Experience with version control systems (e.g., Git).

• Excellent problem-solving and analytical skills.

• Strong communication and collaboration skills in the English language.

Nice to haves

• Familiarity with (either piloting and/or building) UxS platforms. 

• Experience with cloud platforms such as AWS, Azure, or Google Cloud.

• Familiarity with threat intelligence concepts and frameworks.

• Experience with big data technologies (e.g., Spark, Hadoop).

• Knowledge of data visualization tools (e.g., Tableau, Grafana, Power BI).

• Knowledge of web based data visualization tools (e.g., Leaflet, D3, Recharts).

• Understanding of cybersecurity principles and practices.

• Prior working background in defence, intelligence or web-scraping technology companies.

• Experience working in an Agile development environment.

What We Offer

• Opportunity to work on a global, cutting-edge and impactful capability.

• Collaborative and supportive work environment.

• Proprietary software and intelligence collection technologies.

• The chance to contribute to a safer and more secure world.

• Access to all DroneSec training platforms and databases.

  
  

Equal Opportunity Employer

We are committed to creating a diverse and inclusive work environment. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, or any other protected characteristic.