Skip to content

An application that scrapes current news articles from KXAN news. The articles are displayed for the user to save, comment or delete for later use. The user will also be given an option to scrape the site again to keep the articles recent.

Notifications You must be signed in to change notification settings

corey-mitchell/webScraper

Repository files navigation

webScraper

Description

webScraper scrapes current Ausin local news from KXAN and stores the articles in a database. It stores the article, along with the article link and a short summary of the article, and allows the user to save, comment on or delete the current articles.

Demo

You may test out a demo version of this application here.

Getting Started

Installation

To install the application, please run the following commands into your Bash terminal:

git clone [email protected]:corey-mitchell/webScraper.git

cd friendfinder

npm install

Setting up database

Prerequisite

You will need to have MongoDB set up and a database to store the information.

Running Locally

Once it is, you will need to navigate to the server.js file in the global application folder.

folderstructer

Inside of the server.js file, locate line 37. Should look like so,

mongosetup

The name of the database we are using in the above photo is 'mongoHeadlines'. Change this line to fit your database name, e.g.

const MONGODB_URI = process.env.MONGODB_URI || "mongodb://localhost/<yourDBnamehere>";

Author

About

An application that scrapes current news articles from KXAN news. The articles are displayed for the user to save, comment or delete for later use. The user will also be given an option to scrape the site again to keep the articles recent.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published