Skip to content

Conversation

@sgarg-CS
Copy link
Contributor

@sgarg-CS sgarg-CS commented Jan 19, 2026

PLUGIN-1940

This change introduces support for mapping ServiceNow glide_list fields to BigQuery ARRAY<STRING> types in the ServiceNow CDAP plugin.

New Flag added: enableNewDataTypes
If this flag is true, then the fields with glide_list type are mapped to Array of Strings in BigQuery, otherwise, it is mapped to String

image image



Note: There was no option to specify base type while defining List as the type of a column in ServiceNow.

image

@sgarg-CS sgarg-CS added the build label Jan 19, 2026
@sgarg-CS sgarg-CS marked this pull request as ready for review January 20, 2026 15:39
try {
if (results == null) {
fetchData();
fetchData(false);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why is this false always


private void fetchData() throws ServiceNowAPIException {
private void fetchData(Boolean enableNewDataTypes) throws ServiceNowAPIException {
this.enableNewDataTypes = enableNewDataTypes;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

where are we using this

for (Schema.Field field : tableFields) {
String fieldName = field.getName();
ServiceNowRecordConverter.convertToValue(fieldName, field.getSchema(), row, recordBuilder);
ServiceNowRecordConverter.convertToValue(fieldName, field.getSchema(), row, recordBuilder,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is this passed by DTS separately because everytime it seems like it is false

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants