We are looking for a detail-oriented and technically proficient Social Media Data Crawler to design and manage tools that automate data extraction from social media platforms such as LinkedIn, Facebook, X (formerly Twitter), Instagram, and others. The ideal candidate will have strong skills in web scraping, data analysis, and working with social media APIs. This role is vital for providing valuable data insights to support our marketing, research, and analytics teams.
- Develop and maintain automated scripts and tools for extracting data from social media platforms, including LinkedIn, Facebook, X, Instagram, and more.
- Ensure compliance with the terms of service and privacy policies of each platform.
- Continuously monitor and troubleshoot crawling systems to ensure consistent, accurate data collection.
- Analyze collected data to identify key trends, insights, and patterns aligned with business goals.
- Work closely with data scientists, marketing, and research teams to deliver relevant data for their initiatives.
- Optimize crawling systems for performance, scalability, and adaptability to platform changes.
- Stay up-to-date with changes in social media platforms and APIs to adjust crawling strategies as needed.
Requirements
- Bachelor’s degree in Computer Science, Information Technology, or a related field.
- Proven experience in web crawling, scraping, or data extraction from social media.
- Proficiency in programming languages such as Python, Java, or similar.
- Familiarity with social media APIs (e.g., LinkedIn API, Facebook Graph API, Twitter API, Instagram API).
- Strong understanding of HTML, CSS, and JavaScript.
- Knowledge of data privacy laws and ethical considerations related to data scraping.
- Excellent problem-solving skills with keen attention to detail.
- Ability to work independently and collaboratively within a team.
Preferred Skills:
- Experience with big data technologies such as Hadoop or Spark.
- Familiarity with data visualization and reporting tools.
- Understanding of natural language processing (NLP) techniques.
Minimum Technical and Work Environment Requirements:
- Internet Connection:
- Primary internet connection with a minimum speed of 15 Mbps.
- Backup internet connection with at least 10 Mbps.
- Backup connection must be capable of supporting work during a power outage.
- Primary Device:
- Desktop or laptop equipped with at least:
- Intel Core i5 (8th generation or newer), Intel Core i3 (10th generation or newer), AMD Ryzen 5, or an equivalent processor.
- A minimum of 8 GB RAM.
- Backup Device:
- Must meet or exceed the performance of an Intel Core i3 processor.
- Must be functional during power interruptions.
- Peripherals and Workspace:
- A functioning webcam.
- A noise-canceling USB headset.
- A quiet, dedicated home office space.
- A smartphone for communication and verification purposes.
Benefits
Join Our Dynamic Team: Experience our fun, inclusive, innovative culture that values your unique contributions and supports your professional growth.
Embrace the Opportunities: Seize daily chances to learn, innovate, and excel. Make a real impact in your field.
Limitless Career Growth: Unlock a world of possibilities and resources to propel your career forward.
Fast-Paced Thrills: Thrive in a high-energy, engaging atmosphere. Embrace challenges and reap stimulating rewards.
Flexibility, Your Way: Embrace the freedom to work from home or any location of your choice. Create your ideal work environment.
Work-Life Balance at Its Best: Say goodbye to stressful commutes and hello to quality time with loved ones. Achieve a healthy work-life integration to perform at your best.
Originally posted on Himalayas
Apply Now