Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Spider #595

Closed
wants to merge 57 commits into from
Closed

Spider #595

wants to merge 57 commits into from

Conversation

RyanLIL-XwX
Copy link

Issue

Note which issue number(s) this Pull Request closes. All pull requests should close an issue, if one does not exists, make one. This helps us plan and discuss before we decide on implementation

Example:

closes #113

Database Changes/Migrations

If you added/modified a table, notify people of schema change here

Example:

Added table account_semester_selection for a mapping from a students account and semester to a class and section (aka class/section selections)

Test Modifications

Note added unit/integration tests: (all backend changes should contain unit/integration tests with pytest)

Example:

Added test tests/api/db/test_classinfo.py:test_crn_uniqueness to ensure all classes returned from API call don't have repeat CRNs

Test Procedure

Show procedure to test functionality with a clear procedure

Example:

  1. Create a branch
  2. Commit a change to that branch
  3. Push branch
  4. Create Pull Request and fill in PR template

Photos

Show before and after, capture screenshot/gif of finished feature/bug

Additional Info

More info that would help people review your change

DarknessUnder and others added 30 commits October 4, 2021 21:49
@DarknessUnder
Scrape data
3799032 
Scraping data from RPI Catalog using scrapestorm
@DarknessUnder
Create gradetamplate.vue
15b9844
@zwirvinpeng
Create to_json.py
9df6351
@zwirvinpeng
JSON converter
965e896
@DarknessUnder
parser for pathway and clean data
14cbc0a
@DarknessUnder
front-end of pathway
d325b1b
@DarknessUnder
some UI change
7f8aa4a
@DarknessUnder
styling
e8ad492
@DarknessUnder
Update Pathway.vue
a19be8c
@DarknessUnder
Merge branch 'master' into Degree_Requirements
43746d0
@DarknessUnder
UI changes
9bda3d2
@zwirvinpeng
scraper for major requirements
82e36e7
@zwirvinpeng
Update major_scrap.py
b1479cb
@DarknessUnder
get URL for 2021majors
5e412dd
@zwirvinpeng
major_scrap updated
1efa1a0 
Debugged with Harry Tan
@zwirvinpeng
Update major_scrap.py
4f70d3e
@DarknessUnder
Merge branch 'master' of https://github.com/YACS-RCOS/yacs.n
0f588fd
@zwirvinpeng
updated major_scrap to generate a list of postgresql commands
80ae15d
@zwirvinpeng
a list of postgreSQL command of major requirement information
70e7c7a
@DarknessUnder
Turning the data into postgresSQL
8e71258
@DarknessUnder
Merge branch 'master' of https://github.com/YACS-RCOS/yacs.n
47098d8
@Jimmers2001
Update major_scrap.py
57bca95
@DarknessUnder
Merge branch 'master' into Degree_Requirements
88f9186
@DarknessUnder
Create pathwayV2.json
5b277c3
@Jimmers2001
Merge branch 'Degree_Requirements' of https://github.com/YACS-RCOS/ya…
8a6c92a 
…cs.n into Degree_Requirements
@jxlyn @YTWTY
Update pathwayV2.json
c85be00 
Co-Authored-By: YTWTY <[email protected]>
@jxlyn
Merge branch 'Degree_Requirements' of https://github.com/YACS-RCOS/ya…
7fa8b20 
…cs.n into Degree_Requirements
@Katherineweng
get started with new Pathway UI
23c665b
@Katherineweng
Merge branch 'Degree_Requirements' of https://github.com/YACS-RCOS/ya…
a50ad65 
…cs.n into pathways_FE
@Katherineweng
Completed categorized Pathway UI, but still need to work on click event
1a1bd5c
Katherineweng and others added 27 commits February 25, 2022 17:06
@Katherineweng
tried to implement the click event
e34c170
@Katherineweng
moved everything into one vue file; deleted pathway.json and pathwayc…
47d05fe 
…omponent.vue (which is combined into pathway.vue)
@jxlyn
Update pathwayV2.json
5c2af95 
updated some new pathways on rpi website
@DarknessUnder
Merge branch 'pathways_FE' into Degree_Requirements
50c4319
@DarknessUnder
add ability to change list order
87f974f
@jxlyn
Update CoursePage.vue
18d5f0d
@jxlyn
Merge branch 'Degree_Requirements' of https://github.com/YACS-RCOS/ya…
b713928 
…cs.n into Degree_Requirements
@jxlyn
change the color for category title
9979631
@jxlyn
change the arrangement for categories names
ddb1481 
the arrangement for the categories name will be up to down, instead of left to right
@YTWTY
Start code for course suggestion
87732ea
@DarknessUnder
Obtain the URL list for fall 2022
42000fc
@RyanLIL-XwX
Create ideal.json
91de0ec
@xingsixue123
Update html_parser.py
54bdbe5
@RyanLIL-XwX
Update pathwayData.txt
22a1e4a
@RyanLIL-XwX
Update DBCommands.txt
432c6c6
@RyanLIL-XwX
pathway -> major
195061b 
change all the pathway files to the major file, and change the parameters in the original functions.
@xingsixue123
Merge branch 'spider' of https://github.com/YACS-RCOS/yacs.n into spider
24b7aa1
@xingsixue123
new .json converter
c83623f 
new json converter and bug report
@xingsixue123
2 out files with bugs
49b90e0
@RyanLIL-XwX
new file
eaa8d56
@RyanLIL-XwX
update
d2d1e38 
I wrote a readme.txt file to show the functions of most of the files. And update the new json and txt files. Also we write a new to_json_2022.py to generate the json file.
@xingsixue123
to_json_2022.py update
f6af2d1
@RyanLIL-XwX
get the final json
c8712a8
@RyanLIL-XwX
last submission
946c896
@xingsixue123
Last submission of majorData2022.json
dea2a25 
final version, no bugs in json
@xingsixue123
Update to_json_2022.py
4c376eb
@RyanLIL-XwX
update
aa5cc39 
new Database.txt no environmental science.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Ops — Create Pull Request template
8 participants
@RyanLIL-XwX @DarknessUnder @zwirvinpeng @Jimmers2001 @jxlyn @Katherineweng @YTWTY @xingsixue123