Data Engineer Required Urgently To Focus On Web Scraping & Front-end Development
Job Description
At our company, the main focus of our operations is: security. For ourselves as well as our clients, security must remain at the core of everything we do.
Our data engineers work to transport and transform data that can be easily analyzed. We work to develop, test, and maintain data infrastructure using tools built in-house. Data engineers will work closely with our data scientists with the goal of cohesive pipeline development driving our clients’ desired analytics.
Skills:
- Adaptability
- Any Degree
- Any Diploma
- Back Office
- Coding
- Collaboration
- Communication
- Communication Skills
- Computer Operator
- Creativity
- CSS3
- Engineering
- Graduate
- HTML5
- IT
- JavaScript
- PHP
- Problem Solving
- Python
- Software
- Staffing
- Support
- UI Frameworks
Responsibilities
-
Extract and verify data ingested from various websites.
-
Develop tooling to efficiently monitor websites for changes and produce clean change sets.
-
Maintain and scale scraping infrastructure as needed.
Requirements
-
Experience running large scale web scrapes.
-
Solid Python knowledge.
-
Familiarity with Linux/UNIX, HTTP, HTML, JavaScript and Networking
-
Familiarity with techniques and tools for crawling, extracting and processing data (e.g. Scrapy, pandas, mapreduce, SQL, BeautifulSoup, etc).
-
Experience with system monitoring/administration tools.
-
Experience with version control, open source practices, and code review.
-
Experience with applications designed to display archived web content.
-
Great communication skills (written and Spoken in English).
Other Points
-
Cell phone reimbursement.
-
Commuter assistance.
-
Internet reimbursement.
-
Paid time off.
-
Day shift.
-
Monday to Friday work.
-
Performance bonus.
-
Yearly bonus.
Job Summary
About
Similar Jobs
The largest community on the web to find and list jobs that aren't restricted by commutes or a specific location.
-
Java Developer Vacancy At Singapore Cluster Solutions
- Cluster Solutions
- •
- Office
We are looking for a Java developer at Singapore location.
-
Delivery Boy Required For Railofy To Deliver Packages To Customers
- Railofy
- •
- Office, Remote
We are looking to hire a reliable delivery boy to deliver packages to customers.
-
Bajaj Allianz Life Insurance Company – Retail Partner Required
- bajaj allianz life insurance
- •
- Home, Office, Remote
Bajaj Allianz Life Insurance Company - Retail Partner Required. work form home
