Skip to main content

Job Scraper App Configuration

This repository contains the configuration file for the Job Scraper app. The configuration options allow you to customize various settings for different job platforms.

How to launch the scrapper?

Simple type the command at the root of the scrapper backend(but configure it before, see below):

npm start

How it works ?

The configuration is a simple javascript object located in the /config/config.ts

Common Configuration

The common configuration applies to all scrapers and includes the following properties:

  • jobSearch: The keyword for the job search.
  • location: The desired job location.
  • numOfPages: The number of pages to scrape for each job platform.

Welcome to the Jungle Configuration

To be able to scrap jobs on welcome to the jungle, you need to configure :

 interface WelcomeToTheJungleConfig {
account?: {
email: string;
password: string;
};
filters?: {
contractType?: WTTJGLContractType | number[];
remote?: string;
experienceLevel?: WTTJGLExperience;
};
}

setting the account obj is not recommended. Just set the filters if you want to filter the jobs by:

  • contrat type

  • remote or not

  • experience level

    1 - contractType type :

 WTTJGLContractType | number[];
 type WTTJGLContractType =
| "Permanent contract"
| "Work-study"
| "Internship"
| "Fixed-term / Temporary"
| "Other"
| "Freelance"
| "all"
| 1
| 2
| 3
| 4
| 5
| 6;

You can set an array of number: the 1 correspond to the permanent contrat and so on.

For exemple contractType: [6,1, 4] if you want jobs from different type of contract.

2 - remote type: is a string than can be either :

no
punctual
partial
fulltime

3 - experienceLevel type:

type WTTJGLExperience = Array<0 | 1 | 2 | 3 | 4>;

experienceLevel: The experience you want to choose Can be a number from 0 to 4. Or an array of number. Each number correspond to : 0: 0 to 1 year exp 1: 1 to 3 year exp 2: 3 to 5 year exp 4: 5 to 10 year exp

You can also pass an array of number for contractType

LinkedIn Configuration (working on linkedin, do not use it now)

The LinkedIn configuration includes the following properties:

  • email: Your LinkedIn email address.

  • password: Your LinkedIn password.

  • remote: The number representing your preferred date posted filter.

    • 1: Past 24 hours
    • 2: Past week
    • 3: Past month
  • experienceLevel: The number representing your preferred experience level filter.

    • 1: Internship
    • 2: Entry level
    • 3: Associate
    • 4: Mid-Senior level
    • 5: Director
    • 6: Executive
  • workplaceType: The number representing your preferred workplace type filter.

    • 1: On-site
    • 2: Remote
    • 3: Hybrid

To configure the LinkedIn options, update the linkedin object in the configuration file with your desired values.

Note: Make sure to store your LinkedIn email and password securely and avoid committing them to version control.