-
Notifications
You must be signed in to change notification settings - Fork 10
FairGBM openml API implementation #116
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
Note: this CI build fail is related to the FairGBM repo not being public as of yet; I'll have to change the |
...htgbm-provider/src/main/java/com/feedzai/openml/provider/lightgbm/FairGBMDescriptorUtil.java
Show resolved
Hide resolved
c9d6487 to
23ca156
Compare
23ca156 to
8b5d405
Compare
...lightgbm-provider/src/main/java/com/feedzai/openml/provider/lightgbm/LightGBMAlgorithms.java
Outdated
Show resolved
Hide resolved
...tgbm/lightgbm-provider/src/main/java/com/feedzai/openml/provider/lightgbm/SWIGTrainData.java
Outdated
Show resolved
Hide resolved
...tgbm/lightgbm-provider/src/main/java/com/feedzai/openml/provider/lightgbm/SWIGTrainData.java
Outdated
Show resolved
Hide resolved
...gbm/lightgbm-provider/src/test/java/com/feedzai/openml/provider/lightgbm/TestParameters.java
Show resolved
Hide resolved
| .add(new FieldSchema("is_fraud_label", 7, | ||
| new CategoricalValueSchema(true, ImmutableSet.of("FALSE", "TRUE")))) | ||
| .add(new FieldSchema("is_fraud_label", 8, | ||
| new CategoricalValueSchema(true, ImmutableSet.of("False", "True")))) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yes, I added a new "sensitive_attribute" column using a few lines of Python and the True/False values changed after saving the new dataframe 😅
...ghtgbm/lightgbm-provider/src/test/java/com/feedzai/openml/provider/lightgbm/TestSchemas.java
Show resolved
Hide resolved
...tgbm/lightgbm-provider/src/main/java/com/feedzai/openml/provider/lightgbm/SWIGTrainData.java
Outdated
Show resolved
Hide resolved
...tgbm/lightgbm-provider/src/main/java/com/feedzai/openml/provider/lightgbm/SWIGTrainData.java
Outdated
Show resolved
Hide resolved
...tgbm/lightgbm-provider/src/main/java/com/feedzai/openml/provider/lightgbm/SWIGTrainData.java
Outdated
Show resolved
Hide resolved
...t/java/com/feedzai/openml/provider/lightgbm/FairGBMBinaryClassificationModelTrainerTest.java
Outdated
Show resolved
Hide resolved
...gbm/lightgbm-provider/src/test/java/com/feedzai/openml/provider/lightgbm/TestParameters.java
Outdated
Show resolved
Hide resolved
...tgbm/lightgbm-provider/src/main/java/com/feedzai/openml/provider/lightgbm/SWIGTrainData.java
Show resolved
Hide resolved
…bility with cpp code
Codecov Report
@@ Coverage Diff @@
## master #116 +/- ##
============================================
+ Coverage 79.90% 80.21% +0.30%
- Complexity 428 465 +37
============================================
Files 43 47 +4
Lines 1498 1607 +109
Branches 138 157 +19
============================================
+ Hits 1197 1289 +92
- Misses 224 231 +7
- Partials 77 87 +10
Continue to review full report at Codecov.
|
...-provider/src/test/java/com/feedzai/openml/provider/lightgbm/FairGBMParamParserUtilTest.java
Outdated
Show resolved
Hide resolved
Co-authored-by: ipiresmac <93192669+ipiresmac@users.noreply.github.com>
.../lightgbm-provider/src/test/java/com/feedzai/openml/provider/lightgbm/FairProvidersTest.java
Outdated
Show resolved
Hide resolved
Co-authored-by: ipiresmac <93192669+ipiresmac@users.noreply.github.com>
Co-authored-by: ipiresmac <93192669+ipiresmac@users.noreply.github.com>
...htgbm-provider/src/main/java/com/feedzai/openml/provider/lightgbm/FairGBMDescriptorUtil.java
Outdated
Show resolved
Hide resolved
...main/java/com/feedzai/openml/provider/lightgbm/LightGBMBinaryClassificationModelTrainer.java
Outdated
Show resolved
Hide resolved
…edzai-openml-java into fairgbm-api-implementation
|
Are we ready to merge this? 🎉 |
AlbertoEAF
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yup, it's ready :) 🎉
I'd say let's just wait for @gandola 's ok but we're done, we can then squash it :)
|
LGTM! 🥇 Cheers |
Implementation of the Java openml API for the C++ FairGBM algorithm (to be open-sourced soon).
As FairGBM was built on top of LightGBM, I just hijacked the current LightGBM openml API implementation and added a new algorithm descriptor for the new FairGBM parameters.
Other considerations: