How can I migrate PostgreSQL database to Memgraph? - memgraphdb

Can I migrate PostgreSQL database to Memgraph? Do I need to export the database in some format and then import it?

You can use tool mgmigrate to migrate your running PostgreSQL database into a running Memgraph instance.
The detailed instruction can be found on documentation page Migrate PostgreSQL database to Memgraph

Related

How can I migrate MySQL database to Memgraph?

How can I migrate MySQL database to Memgraph? Do I need to dump the database in some format and then import it?
You can use tool mgmigrate to migrate your running MySQL database into a running Memgraph instance.
The detailed instruction can be found on the documentation page Migrate MySQL database to Memgraph

What is the fastest way to import data into Memgraph from MySQL database?

I have a rather large dataset (a few million nodes and relationships) in the MySQL database. I want to import that data into Memgraph. What is the fastest way to do the import?
For data migration from MySQL to memgraph you can use the tool called mgmigrate. This tool can be used for migration from running instances of MySQL and PostgreSQL. The bonus is that you can also use it for data migration between Memgraph instances.
To do the migration you need
mgmigrate tool
A running PostgreSQL instance with the database you wish to migrate.
A running Memgraph instance where you want to migrate the data.
Once you have everything in place you can use this code for migration:
build/src/mgmigrate --source-kind=mysql /
--source-host 127.0.0.1 /
--source-port 33060 /
--source-username root /
--source-password mysql /
--source-database=exampledatabase /
--destination-host 127.0.0.1 /
--destination-port 7687 /
--destination-use-ssl=false
The documentation is on the GitHub repo and the Memgraph website.

Airflow with oracle backend

In my company we are evaluating the use of Airflow mainly to run ML model.
In the documentation they suggest to use Postgres or MySQL, but we prefer to stick with our tools, in this particular scenario we'd like to give to Airflow a dedicated schema in Oracle Database Enteprise Edition 19.
Is it possible to have oracle as a backend db? Are there any drawback?
It seams that Oracle is not supported as a backend for Airflow corresponding to the Jira ticket: AIRFLOW-3994
From this link, it seems that you can use Oracle with airflow.
Airflow can run with any DB supported by SqlAlchemy. For example:
PostgreSQL
MySQL
SQLite
Oracle
Microsoft SQL Server
List of supported dialects: https://docs.sqlalchemy.org/en/13/dialects/
Although from my experience I recommend using Postgres from my experience and for performance reasons.

How to migrate from DB2 or Oracle to TiDB?

I want to try TiDB and I am working on data migration. Is there any way of migrating data from DB2 or Oracle to TiDB?
If using OGG to sync data to TiDB, you should set global tidb_constraint_check_in_place = 1 to disable the lazy-constraint-check in TiDB.
To migrate all the data or migrate incrementally from DB2 or Oracle to TiDB, you can use one of the following solutions:
Use the official migration tool of Oracle, such as OGG, Gateway, CDC (Change Data Capture).
Develop a program for importing and exporting data.
Export Spool as text file, and import data using Load infile.
Use a third-party data migration tool.
Currently, it is recommended to use OGG.
Oracle SQL Developer will capture and convert your LUW DB2 database and create it in an existing Oracle Database as new schema(s). It will move the data for you too.
Here's where you can go to learn more

PostgreSQL to Oracle Database with Oracle GoldenGate 11.2.1

I've spent 2 days to sync postgresql database to oracle. Read few books, googled many times..
1. I have setup PostgreSQL on CentOS 6.5 (A) also installed oracle database on this VPS. copied GoldenGate to it.
2. I have already setup 2 oracle VPS using Goldengate and setup as Source (B) and Target (C). I'm trying to sync PostgreSQL to Target VPS.
3. GoldenGate runs on A server without error.
The problem is when I setting up it requires ODBC config (page 14). I'm new to PostgreSQL so little confusing for this..
Also when I google i find only to postgresql from oracle.
Main doc I'm following is http://docs.oracle.com/cd/E35209_01/doc.1121/e29642.pdf
Actually I have found Oracle Golden Gate new features https://blogs.oracle.com/dataintegration/resource/2013-DIFamily/OGG_WinUnix_Rel_Notes_11.2.1.0.7.pdf
Oracle Golden Gate don't support what I want to do.
They say:
Oracle GoldenGate introduces support for PostgreSQL. This support includes the mapping, manipulation,
filtering, and delivery of data from other types of databases to a PostgreSQL database. Oracle GoldenGate
does not support the capture of data from PostgreSQL to other PostgreSQL databases or to other kinds of
databases.
GoldenGate does not support Postgres as a source - only target.
Check out Attunity for what you are trying to do.
Postgres support was only for delivery in Oracle GoldenGate 12.2. Oracle is working on a full capture/delivery support for Postgres. It will be out in a later release post 19c. Please check the OTN website for versions.

Resources