Data Engineer Required Urgently To Focus On Web Scraping & Front-end Development
Job Description
At our company, the main focus of our operations is: security. For ourselves as well as our clients, security must remain at the core of everything we do.
Our data engineers work to transport and transform data that can be easily analyzed. We work to develop, test, and maintain data infrastructure using tools built in-house. Data engineers will work closely with our data scientists with the goal of cohesive pipeline development driving our clients’ desired analytics.
Skills:
- Any Degree
- Any Diploma
- Back Office
- Coding
- Collaboration
- Communication
- Communication Skills
- Computer Operator
- Creativity
- CSS3
- Engineering
- HTML5
- IT
- JavaScript
- PHP
- Problem Solving
- Python
- Software
- Staffing
- Support
- UI Frameworks
Responsibilities
-
Extract and verify data ingested from various websites.
-
Develop tooling to efficiently monitor websites for changes and produce clean change sets.
-
Maintain and scale scraping infrastructure as needed.
Requirements
-
Experience running large scale web scrapes.
-
Solid Python knowledge.
-
Familiarity with Linux/UNIX, HTTP, HTML, JavaScript and Networking
-
Familiarity with techniques and tools for crawling, extracting and processing data (e.g. Scrapy, pandas, mapreduce, SQL, BeautifulSoup, etc).
-
Experience with system monitoring/administration tools.
-
Experience with version control, open source practices, and code review.
-
Experience with applications designed to display archived web content.
-
Great communication skills (written and Spoken in English).
Other Points
-
Cell phone reimbursement.
-
Commuter assistance.
-
Internet reimbursement.
-
Paid time off.
-
Day shift.
-
Monday to Friday work.
-
Performance bonus.
-
Yearly bonus.
Job Summary
About
Similar Jobs
The largest community on the web to find and list jobs that aren't restricted by commutes or a specific location.
-
Data Entry Job: Vacancy for Data Entry Executive
- ETEAM Inforservices Pvt Ltd
- •
- Office
hiring "Data Entry / Process Associate" for Bangalore, Whitefield Location with our client "Harman".
-
Vacancy for User Interface Designer || User Experience Designer
- Pure Code Software
- •
- Remote
Designer vacancy
-
Hiring For Senior Backend Developer Python
- Technix Technology
- •
- Office
We're in search of a Senior Backend Developer to spearhead the development of robust server-side logic and maintain scalable, secure database architectures. The ideal candidate will thrive in writing clean, maintainable code, optimizing database performance, and creating user-friendly REST APIs to bolster our advanced data processing and analytics capabilities.