duplicate key value violates unique constraint - postgres error when trying to create sql table from dask dataframe
I was reading this.It seems this error rises when you are creating/updating the same table with parallel processing. I understand it depends because of this (as explained on the google group discussion).
So I think it depend from PostgreSQL itself and not from the connection driver or the module used for the multiprocessing.
Well, Actually, the only way I found to solve this is to create chunks big enough to have back a writing process slower than the calculation itself.With bigger chunks this error doesn't rise.
I had the same error with ponyORM on PostgreSQL in Heroku.I solved it by locking the thread until it executes the DB operation. In my case:
lock = threading.Lock()with lock: PonyOrmEntity(name='my_name', description='description') PonyOrmEntity.get(lambda u: u.name == 'another_name')
In PostgreSQL that helps me.
set enable_parallel_hash=off;After u can turn it on
set enable_parallel_hash=on;