Skip to content

add 3rd-party jars via python  #10

@bjuergens

Description

@bjuergens

currently you need to call this with something like this:

pyspark --jars $HOME/dev/dirhash/target/sparkhacks-0.0.1-SNAPSHOT.jar dirhash.py /smartdata/ugfam/dev/test_data/raw/

But it would be better with something like this:

pyspark dirhash.py /smartdata/ugfam/dev/test_data/raw/

You can add the jars via python, as suggested here.

Metadata

Metadata

Assignees

No one assigned

    Labels

    refactorimprove code quality

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions