Skip to content

Project Dataset Uploads/Records #115

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
lperry022 merged 9 commits into from
Sep 22, 2025
Merged

Project Dataset Uploads/Records #115

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
f8fcd26
Create Readme.md
Kados47 Sep 21, 2025
e88db14
Create Readme.md
Kados47 Sep 21, 2025
1d732ed
Add files via upload
Kados47 Sep 21, 2025
154738e
Create Readme.md
Kados47 Sep 21, 2025
b96c4ae
Add files via upload
Kados47 Sep 21, 2025
369c825
Update project-2-datasets.csv
Kados47 Sep 21, 2025
da9785f
Update Readme.md
Kados47 Sep 21, 2025
96eb95f
Delete Project_GitHub_File_Uploads/Project_2/Readme.md
Kados47 Sep 21, 2025
f0d6b3b
Delete Project_GitHub_File_Uploads/Project_3/Readme.md
Kados47 Sep 21, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
15 changes: 15 additions & 0 deletions Project_GitHub_File_Uploads/Project_2/project-2-datasets.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,15 @@
Dataset Name,Source GitHub Paths,Target Location,File Type,Project,Preprocessing Required,Upload Timestamp,Deleted,Documentation Updated
HandTremorDataset.csv,https://github.com/Redback-Operations/redback-senior-tech/blob/main/data_science/wrist_mounted_parkinsons_disease_prediction/datasets/HandTremorDataset.csv,dw-bronze,CSV,project-2,No,"9/3/2025, 5:45:22 PM",Yes,n/a
parkinsons.csv,https://github.com/Redback-Operations/redback-senior-tech/blob/main/data_science/parkinsons_disease/parkinsons.csv,dw-bronze,CSV,project-2,No,"9/3/2025, 5:58:47 PM",Yes,n/a
HeartAttackPredictionDataset.csv,https://github.com/Redback-Operations/redback-senior-tech/blob/main/data_science/heart_attack_prediction/datasets/heart_attack_prediction_dataset.csv,dw-bronze,CSV,project-2,No,"9/3/2025, 6:02:37 PM",Yes,yes
HealthData.csv,https://github.com/Redback-Operations/redback-senior-tech/blob/main/data_science/health_monitoring_dashboard/HealthData.csv,dw-bronze,CSV,project-2,No,"9/3/2025, 6:08:40 PM",Yes,yes
accgyr.csv,https://github.com/Redback-Operations/redback-senior-tech/blob/main/data_science/fall_detection/data/acc_gyr.csv,dw-bronze,CSV,project-2,No,"9/3/2025, 6:24:26 PM",Yes,n/a
Diabetes012HealthIndicatorsBRFSS2015.csv,https://github.com/Redback-Operations/redback-senior-tech/blob/main/data_science/diabetes_prediction/codes/current_datasets/diabetes_012_health_indicators_BRFSS2015.csv,dw-bronze,CSV,project-2,No,"9/3/2025, 6:32:57 PM",Yes,yes
DiabetesPredictionDataset.csv,https://github.com/Redback-Operations/redback-senior-tech/blob/main/data_science/diabetes_prediction/data/previous/diabetes_prediction_dataset.csv,dw-bronze,CSV,project-2,No,"9/3/2025, 6:37:15 PM",Yes,yes
DiabetesDataUploadRandomized.csv,https://github.com/Redback-Operations/redback-senior-tech/blob/main/data_science/diabetes_prediction/data/previous/diabetes_data_upload_randomized.csv,dw-bronze,CSV,project-2,No,"9/3/2025, 6:38:54 PM",Yes,yes
AlzheimersDataset.csv,https://github.com/Redback-Operations/redback-senior-tech/blob/main/data_science/alzheimers_prediction/Data_processing/Alzheimer's_dataset.csv,dw-bronze,CSV,project-2,No,"9/3/2025, 6:55:42 PM",Yes,yes
mostCommonDiseaseFeatureDataset20142019.csv,https://github.com/Redback-Operations/redback-senior-tech/blob/main/data_analytics/most_common_disease_feature/dataset/2014-2019.csv,dw-bronze,CSV,project-2,No,"9/3/2025, 7:00:04 PM",Yes,n/a
DiabetesBinaryHealthIndicatorsBRFSS2015.csv,https://github.com/Redback-Operations/redback-senior-tech/blob/main/data_science/diabetes_prediction/codes/current_datasets/diabetes_binary_health_indicators_BRFSS2015.csv,dw-silver,CSV,project-2,No,"9/3/2025, 7:00:05 PM",Yes,Yes
DiabetesBinary5050SplitHealthIndicatorsBRFSS2015.csv,https://github.com/Redback-Operations/redback-senior-tech/blob/main/data_science/diabetes_prediction/codes/current_datasets/diabetes_binary_5050split_health_indicators_BRFSS2015.csv,dw-silver,CSV,project-2,No,"9/3/2025, 7:00:05 PM",Yes,Yes


65 changes: 65 additions & 0 deletions Project_GitHub_File_Uploads/Project_3/project-3-datasets.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,65 @@
Dataset Name,Source GitHub Paths,Target Location,File Type,Project,Preprocessing Required,Upload Timestamp,Uploaded to Warhouse ,Deleted From GitHub
battingData.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Cricket_Analysis/Batting_Analysis/batting_data.csv,dw-silver,CSV,project-3,No,"9/3/2025, 7:25:03 PM",Yes,No
BattingDataWithPerformance.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Cricket_Analysis/Batting_Analysis/batting_data_with_performance_index.csv,dw-silver,CSV,project-3,No,"9/3/2025, 7:29:50 PM",Yes,No
PlayerDetails2023WC.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Cricket_Analysis/Cricket_WC2023_Analysis/Data/player_details_2023WC.csv,dw-silver,CSV,project-3,No,"9/10/2025, 5:23:38 PM",Yes,No
MatchSummary2023WC.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Cricket_Analysis/Cricket_WC2023_Analysis/Data/match_summary_2023WC.csv,dw-silver,CSV,project-3,No,"9/10/2025, 5:24:40 PM",Yes,No
BowlingSummary2023WC.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Cricket_Analysis/Cricket_WC2023_Analysis/Data/bowling_summary_2023WC.csv,dw-silver,CSV,project-3,No,"9/10/2025, 5:25:07 PM",Yes,No
BattingSummary2023WC.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Cricket_Analysis/Cricket_WC2023_Analysis/Data/batting_summary_2023WC.csv,dw-silver,CSV,project-3,No,"9/10/2025, 5:25:32 PM",Yes,No
BattingSummaryIPL2023.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Cricket_Analysis/IPL_2023_Cricket_analysis/Data/Batting_Summary_IPL_2023.csv,dw-silver,CSV,project-3,No,"9/10/2025, 5:29:54 PM",Yes,No
BowlingSummaryIPL2023.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Cricket_Analysis/IPL_2023_Cricket_analysis/Data/Bowling_Summary_IPL_2023.csv,dw-silver,CSV,project-3,No,"9/10/2025, 5:30:09 PM",Yes,No
IPLMatchSummary.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Cricket_Analysis/IPL_2023_Cricket_analysis/Data/IPL_Match_Summary.csv,dw-silver,CSV,project-3,No,"9/10/2025, 5:30:40 PM",Yes,No
PlayerInfoUpdatedImage.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Cricket_Analysis/IPL_2023_Cricket_analysis/Data/Player_Info_Updated_image.csv,dw-silver,CSV,project-3,No,"9/10/2025, 5:31:34 PM",Yes,No
TeamLogo.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Cricket_Analysis/IPL_2023_Cricket_analysis/Data/Team_Logo.csv,dw-silver,CSV,project-3,No,"9/10/2025, 5:32:05 PM",Yes,No
AdelaideTossData.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Cricket_Analysis/T20-Toss_decision-analysis/T20-Toss_decision-main/cleaned%20data/adilade_cleaned.csv,dw-silver,CSV,project-3,No,"9/10/2025, 5:59:03 PM",Yes,No
BrisbaneTossData.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Cricket_Analysis/T20-Toss_decision-analysis/T20-Toss_decision-main/cleaned%20data/brisbane_cleaned.csv,dw-silver,CSV,project-3,No,"9/10/2025, 5:59:47 PM",Yes,No
2022T20WorldCupData.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Cricket_Analysis/T20-Toss_decision-analysis/T20-Toss_decision-main/cleaned%20data/cleaned_t20.csv,dw-silver,CSV,project-3,No,"9/10/2025, 6:00:54 PM",Yes,No
GeelongTossData.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Cricket_Analysis/T20-Toss_decision-analysis/T20-Toss_decision-main/cleaned%20data/geelong_cleaned.csv,dw-silver,CSV,project-3,No,"9/10/2025, 6:01:52 PM",Yes,No
HobartTossData.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Cricket_Analysis/T20-Toss_decision-analysis/T20-Toss_decision-main/cleaned%20data/hobart_cleaned.csv,dw-silver,CSV,project-3,No,"9/10/2025, 6:02:32 PM",Yes,No
MelbourneTossData.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Cricket_Analysis/T20-Toss_decision-analysis/T20-Toss_decision-main/cleaned%20data/melbourne_cleaned.csv,dw-silver,CSV,project-3,No,"9/10/2025, 6:03:10 PM",Yes,No
PerthTossData.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Cricket_Analysis/T20-Toss_decision-analysis/T20-Toss_decision-main/cleaned%20data/perth_cleaned.csv,dw-silver,CSV,project-3,No,"9/10/2025, 6:03:41 PM",Yes,No
SydneyTossData.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Cricket_Analysis/T20-Toss_decision-analysis/T20-Toss_decision-main/cleaned%20data/sydney_cleaned.csv,dw-silver,CSV,project-3,No,"9/10/2025, 6:04:14 PM",Yes,No
EPLResults2023.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Football%20Analysis/data/epl_results_2023.csv,dw-silver,CSV,project-3,No,"9/10/2025, 7:44:19 PM",Yes,No
EPLResults2022.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Football%20Analysis/data/epl_results_2022.csv,dw-silver,CSV,project-3,No,"9/10/2025, 7:45:01 PM",Yes,No
EPLResults2021.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Football%20Analysis/data/epl_results_2021.csv,dw-silver,CSV,project-3,No,"9/10/2025, 7:45:36 PM",Yes,No
EPLResults2020.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Football%20Analysis/data/epl_results_2020.csv,dw-silver,CSV,project-3,No,"9/10/2025, 7:46:12 PM",Yes,No
EPLResults2019.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Football%20Analysis/data/epl_results_2019.csv,dw-silver,CSV,project-3,No,"9/10/2025, 7:46:45 PM",Yes,No
EPLResults2018.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Football%20Analysis/data/epl_results_2018.csv,dw-silver,CSV,project-3,No,"9/10/2025, 7:47:19 PM",Yes,No
EPLResults2017.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Football%20Analysis/data/epl_results_2017.csv,dw-silver,CSV,project-3,No,"9/10/2025, 7:48:00 PM",Yes,No
EPLResults2016.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Football%20Analysis/data/epl_results_2016.csv,dw-silver,CSV,project-3,No,"9/10/2025, 7:48:44 PM",Yes,No
EPLResults2015.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Football%20Analysis/data/epl_results_2015.csv,dw-silver,CSV,project-3,No,"9/10/2025, 7:49:20 PM",Yes,No
EPLResults2014.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Football%20Analysis/data/epl_results_2014.csv,dw-silver,CSV,project-3,No,"9/10/2025, 7:49:59 PM",Yes,No
EPLResults2013.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Football%20Analysis/data/epl_results_2013.csv,dw-silver,CSV,project-3,No,"9/10/2025, 7:55:20 PM",Yes,No
EPLResults2012.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Football%20Analysis/data/epl_results_2012.csv,dw-silver,CSV,project-3,No,"9/10/2025, 7:55:53 PM",Yes,No
EPLResults2011.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Football%20Analysis/data/epl_results_2011.csv,dw-silver,CSV,project-3,No,"9/10/2025, 7:56:20 PM",Yes,No
EPLResults2010.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Football%20Analysis/data/epl_results_2010.csv,dw-silver,CSV,project-3,No,"9/10/2025, 7:56:54 PM",Yes,No
EPLResults2009.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Football%20Analysis/data/epl_results_2009.csv,dw-silver,CSV,project-3,No,"9/10/2025, 7:57:28 PM",Yes,No
EPLResults2008.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Football%20Analysis/data/epl_results_2008.csv,dw-silver,CSV,project-3,No,"9/10/2025, 7:58:07 PM",Yes,No
EPLResults2007.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Football%20Analysis/data/epl_results_2007.csv,dw-silver,CSV,project-3,No,"9/10/2025, 7:58:40 PM",Yes,No
EPLResults2006.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Football%20Analysis/data/epl_results_2006.csv,dw-silver,CSV,project-3,No,"9/10/2025, 7:59:15 PM",Yes,No
ConsolEPLResultsRaw.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Football%20Analysis/data/consol_epl_results_raw.csv,dw-silver,CSV,project-3,No,"9/10/2025, 8:01:13 PM",Yes,No
SleepEfficiency.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/TrainingLoad/Sleep_Efficiency.csv,dw-silver,CSV,project-3,No,"9/17/2025, 6:27:47 PM",Yes,No
SimuVO2Activities.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/VO2max/predict%20VO2%20max/Simu_VO2_activities.csv,dw-silver,CSV,project-3,No,"9/17/2025, 6:30:27 PM",Yes,No
SimuVo2ActivitiesWithFtp.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/VO2max/predict%20VO2%20max/simu_vo2_activities_with_ftp.csv,dw-silver,CSV,project-3,No,"9/17/2025, 6:31:29 PM",Yes,No
FixedCleanedActivities.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Running_Archive/Fixed_cleaned_activities.csv,dw-silver,CSV,project-3,No,"9/17/2025, 6:33:45 PM",Yes,No
response.json,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Running_Archive/response.json,dw-bronze,JSON,project-3,No,"9/17/2025, 6:35:32 PM",Yes,No
20kmTimeTrialCycling.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Cycling%20Analysis/data/20km_time_trial_cycling.csv; https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/DataVisualisationPracticeWebDev/data/20km_time_trial_cycling.csv,dw-silver,CSV,project-3,No,"9/17/2025, 6:43:12 PM",Yes,No
3117764808.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/DataVisualisationPracticeWebDev/data/3117764808.csv; https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Cycling%20Analysis/data/3117764808.csv,dw-silver,CSV,project-3,No,"9/17/2025, 6:44:04 PM",Yes,No
ActivitiesCleaned.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Cycling%20Analysis/data/activities_cleaned.csv; https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/DataVisualisationPracticeWebDev/data/activities_cleaned.csv,dw-silver,CSV,project-3,No,"9/17/2025, 6:45:41 PM",Yes,No
CyclistData23T2.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/DataVisualisationPracticeWebDev/data/cyclist_data_23T2.csv; https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Cycling%20Analysis/data/cyclist_data_23T2.csv,dw-silver,CSV,project-3,No,"9/17/2025, 6:47:02 PM",Yes,No
ActivitiesCleanedTRI001.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Cycling%20Analysis/data/activities_cleaned_TRI001.csv,dw-silver,CSV,project-3,No,"9/17/2025, 6:47:38 PM",Yes,No
CyclingDataWithFtp.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Cycling%20Analysis/data/cycling_data_with_ftp.csv,dw-silver,CSV,project-3,No,"9/17/2025, 6:49:00 PM",Yes,No
DataCleanedRunningData.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Cycling%20Analysis/data/datacleaned_running_data.csv,dw-silver,CSV,project-3,No,"9/17/2025, 6:49:42 PM",Yes,No
ExtendedActivities.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Cycling%20Analysis/data/extended_activities.csv; https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/DataVisualisationPracticeWebDev/data/extended_activities.csv,dw-silver,CSV,project-3,No,"9/17/2025, 6:52:16 PM",Yes,No
ExtendedActivitiesWithFtp.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/DataVisualisationPracticeWebDev/data/extended_activities_with_ftp.csv; https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Cycling%20Analysis/data/extended_activities_with_ftp.csv,dw-silver,CSV,project-3,No,"9/17/2025, 6:53:09 PM",Yes,No
ExtendedActivitiesTRI001.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Cycling%20Analysis/data/extended_activities_TRI001.csv,dw-silver,CSV,project-3,No,"9/17/2025, 6:53:44 PM",Yes,No
RedbackUser8.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Cycling%20Analysis/data/redback_user_8.csv; https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/DataVisualisationPracticeWebDev/data/redback_user_8.csv,dw-silver,CSV,project-3,No,"9/17/2025, 6:56:57 PM",Yes,No
StravaActivities.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Cycling%20Analysis/data/strava_activities.csv; http://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/DataVisualisationPracticeWebDev/data/strava_activities.csv,dw-silver,CSV,project-3,No,"9/17/2025, 6:57:54 PM",Yes,No
Activities215078188.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Running%20Analysis/Working%20File/KG_running_files/activities_215078188.csv,dw-silver,CSV,project-3,No,"9/17/2025, 6:59:38 PM",Yes,No
UpdatedRunning.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Running%20Analysis/updated_running.csv,dw-silver,CSV,project-3,No,"9/17/2025, 7:00:22 PM",Yes,No
Activities.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Running%20Analysis/activities.csv,dw-silver,CSV,project-3,No,"9/17/2025, 7:01:07 PM",Yes,No
ActivitiesCleaned.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Running%20Analysis/activities_cleaned.csv,dw-silver,CSV,project-3,No,"9/17/2025, 7:02:54 PM",Yes,No
WindSummary.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Running%20Analysis/Wind_Analysis_Dhivyaa/wind_summary.csv,dw-silver,CSV,project-3,No,"9/17/2025, 7:03:40 PM",Yes,No
ExerciseSleepCombined.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Running%20Analysis/RecoveryTimeEstimator/data/curated/exercise_sleep_combined.csv,dw-silver,CSV,project-3,No,"9/17/2025, 7:04:43 PM",Yes,No
RecoveryTimeReadyForModel.csv,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Running%20Analysis/RecoveryTimeEstimator/data/curated/recovery_time_ready_for_model.csv,dw-silver,CSV,project-3,No,"9/17/2025, 7:05:37 PM",Yes,No
exercise.json,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Running%20Analysis/RecoveryTimeEstimator/data/processed/exercise.json,dw-silver,JSON,project-3,No,"9/17/2025, 7:06:01 PM",Yes,No
sleep.json,https://github.com/Redback-Operations/redback-fit-sports-performance/blob/main/Running%20Analysis/RecoveryTimeEstimator/data/processed/sleep.json,dw-silver,JSON,project-3,No,"9/17/2025, 7:08:36 PM",Yes,No
55 changes: 55 additions & 0 deletions Project_GitHub_File_Uploads/Readme.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,55 @@
# Project Dataset Uploads

This repository contains records of datasets uploaded into the **Redback Operations Data Warehouse** via the file upload service. The datasets originate from the public Redback Operations GitHub repositories and have been processed for:

- **Security & Privacy**: Sensitive or unnecessary raw files have been migrated out of public view.
- **Repository Maintenance**: Cleaning up GitHub repositories by removing datasets once safely stored in the warehouse.

---

## Completed Uploads

The following projects have been fully uploaded to the Data Warehouse:

- **Project 2**
- **Project 3**

> Note: All datasets from **Project 2** have been deleted from the public GitHub repository after successful migration.

---

## Documentation

For detailed information about the Data Warehouse processes, storage, and access, please see the official documentation:
[Data Warehousing Documentation](https://redback-operations.github.io/redback-documentation/docs/category/data-warehousing-team)

---

## Continuing This Work

To support future dataset uploads, a companion tool has been developed to track records of file uploads and processing steps:
[GitHub Data Scribe](https://github-data-scribe.lovable.app/)

This software helps contributors record what has been uploaded, what preprocessing (if any) was performed, and ensures continuity for ongoing work.

---

## Repository Purpose

This repository serves as a **logbook and reference** for dataset migration efforts. It ensures:

- Transparency of what has been uploaded
- Traceability for dataset lifecycle management
- A clean and secure state for public-facing GitHub repositories

---

## Credits

This work was carried out by:

**Kadyn Trayford (s223308953)**

---