Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Build error against PostgreSQL 14 #269

Open
devrimgunduz opened this issue Jun 4, 2021 · 21 comments
Open

Build error against PostgreSQL 14 #269

devrimgunduz opened this issue Jun 4, 2021 · 21 comments

Comments

@devrimgunduz
Copy link

Hi,
1.4.0 fails to build also against PostgreSQL 14. Log is attached. Can you please take a look?

Regards, Devrim

multicorn-pg14.txt

@devrimgunduz
Copy link
Author

Anyone around?

@devrimgunduz
Copy link
Author

ping.

@fjf2002
Copy link

fjf2002 commented Oct 15, 2021

I'm having the same problem.

@devrimgunduz
Copy link
Author

Anyone around ?

@fjf2002
Copy link

fjf2002 commented Oct 20, 2021

I have forked this repo and tried to make it compatible with PostgreSQL 14 (and Python 3.9) experimentally at https://github.com/fjf2002/Multicorn .

Disclaimer: I am not sure what I am doing. I think PostgreSQL extension experts are needed.

What I have done:

  • applied the Debian bullseye pg13 patch from https://packages.debian.org/source/bullseye/postgresql-multicorn
  • replaced PyUnicode_AS_DATA calls by PyUnicode_AsUTF8
  • added PlannerInfo parameters to pull_varnos call and calling methods in stacktrace where possible
  • as far as I understand, I have currently disabled WHERE condition pushdown(?) (this is because multicornBeginForeignScan has no reference to PlannerInfo, but pull_varnos needs it in PostgreSQL 14)
  • as far as I understand, I have currently disabled data modification(?) - that's because of further compile errors due to PostgreSQL 14 changes I did not know how to solve).

@fjf2002
Copy link

fjf2002 commented Feb 24, 2022

Any news here?

@df7cb
Copy link
Contributor

df7cb commented Feb 24, 2022

The state is still that someone needs to fix all the problems. Does your fork work now?

@fjf2002
Copy link

fjf2002 commented Feb 24, 2022

My fork works FOR ME. I just use SELECT to retreive some foreign tables. Please see my comment above, especially the sentences "as far as I understand ..."

@fjf2002
Copy link

fjf2002 commented Feb 24, 2022

https://github.com/pgsql-io/Multicorn/commits/master and #272 see to be further developed than mine (https://github.com/fjf2002/Multicorn). Take them.

@denishpatel
Copy link

@devrimgunduz @df7cb @fjf2002 is anyone able to build multicorn with Postgres 14 yet? Any pointers and help will be appreciated.

@fjf2002
Copy link

fjf2002 commented Mar 25, 2022

@denishpatel: Affirmative. My build code is approx.

	apt-get install -y build-essential postgresql-server-dev-14 python3-dev python3-setuptools
	# anticipating a following installation error "dir not found":
	mkdir -p /usr/share/doc/postgresql-doc-14/extension
	cd /usr/local/src/
	wget https://github.com/credativ/Multicorn/archive/refs/heads/pg14.zip
	unzip pg14.zip
	cd Multicorn-pg14
	# silence python3 complaints
	echo > preflight-check.sh
	make
	make install

@denishpatel
Copy link

@fjf2002 Thanks for the details. However, it looks like you disabled WHERE clause push down so it's not working for my case because i'm using Multicorn for BigQuery FDW. Is it easy to enable WHERE push down?

@fjf2002
Copy link

fjf2002 commented Mar 28, 2022

@denishpatel: Look closely at my build code. I abandoned https://github.com/fjf2002/Multicorn, instead use the https://github.com/credativ/Multicorn fork. Whether this fork can pushdown conditions I do not know.

@denishpatel
Copy link

@fjf2002 Thanks. Looks like WIP patch might have broke WHERE clause condition credativ@4bde5a1 /cc @df7cb

@luss
Copy link

luss commented Apr 5, 2022

In pgsql-io/multicorn, I've got the code in the master branch now compiling against PG14. Now on to testing.

@df7cb
Copy link
Contributor

df7cb commented Apr 8, 2022

@fjf2002 Thanks. Looks like WIP patch might have broke WHERE clause condition credativ@4bde5a1 /cc @df7cb

It's still WIP, I never claimed it was finished...

I eventually gave up on fixing it since the project was pretty dead in general.

@luss
Copy link

luss commented Apr 19, 2022

pgsql-io/multicorn2 is now up to version 2.2 and is working for pg14 including WHERE pushdowns. More testing by others is needed.

@fjf2002
Copy link

fjf2002 commented Apr 20, 2022

@luss Thanks, I have switched to pgsql-io/multicorn2. It works - but I am just using ldap with a simple SELECT.

@cerdman
Copy link

cerdman commented Aug 7, 2022

Any updates on this ?

@luss
Copy link

luss commented Oct 11, 2022 via email

@fjf2002
Copy link

fjf2002 commented Oct 11, 2022

@luss: Your link does not work, at least for me. Private Repo?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants