A Web Scraper is a program that quite literally scrapes or gathers data off of job's website.

This is capstone project of Microverse Ruby Curriculum.Project Name is Console Jobs. Web scraping is the process of gathering information from the Internet. Even copy-pasting the lyrics of your favorite song is a form of web scraping! However, the words “web scraping” usually refer to a process that involves automation. In my case, I gather data from one of the most popular job site from myanmar that name is jobnet. In my project, ther is three part.
- Job Function
- Each Position Job Listing
- Job Detail
For the whole project, I used following tools and language.
This is an example of how you may give instructions on setting up your project locally. To get a local copy up and running follow these simple example steps.
This is an example of how to list things you need to use the software and how to install them.
- ruby
https://www.ruby-lang.org/en/downloads/
- gem
gem install nokogiri
gem install colorize
- Clone the repo
git clone https://github.com/konyan/ruby-job-scrapper.git
- Install gem packages
gem install
- Run main.rb file
ruby bin/main.rb
This is an example of how to list things you need to use the software and how to install them.
- ruby
gem install rspec
- Run spec files at Spec Folder
rspec spec/job_spec.rb
rspec spec/joburl_spec.rb
rspec spec/position_spec.rb
Contributions are what make the open source community such an amazing place to be learn, inspire, and create. Any contributions you make are greatly appreciated.
- Fork the Project
- Create your Feature Branch (
git checkout -b feature/AmazingFeature
) - Commit your Changes (
git commit -m 'Add some AmazingFeature'
) - Push to the Branch (
git push origin feature/AmazingFeature
) - Open a Pull Request
Distributed under the MIT License. See LICENSE
for more information.
@devkonyan - [email protected]
Project Link: https://github.com/your_username/repo_name