Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unable to create tables automatically with Iceberg REST and AWS Glue #11921

Open
AnatolyPopov opened this issue Jan 7, 2025 · 0 comments
Open
Labels
question Further information is requested

Comments

@AnatolyPopov
Copy link

Query engine

No response

Question

I was trying to set up Kafka connector against AWS Glue with rest catalog type and with S3FIleIO.
What I faced with is that I did not managed to configure the location for tables in Glue with iceberg.tables.auto-create-enabled being enabled. The only way that worked for me to connect to Glue is by specifying my AWS account id as warehouse in config and in the end as far as I understand the connector is not able to figure out what should be the location for table it is trying to create.
I'm getting Malformed request: Cannot parse missing string: location as a response from AWS API since REST catalog is not providing the location because it is not specified here

return createTable(identifier, schema, spec, null, properties);

Is there any known workaround to make this working? Or am I doing something wrong?

@AnatolyPopov AnatolyPopov added the question Further information is requested label Jan 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

1 participant