I am trying to get my Oracle DB content into GCP - BigQuery specifically, and then keep both in synch. I have not been able to find a standard way of doing this using GCP tools without using third-party software. Has anyone tried this? Any recommendations?
Related
I have an ETL project running on-premises using ODI.
This ETL is quite customized with python scripts to perform tasks such as download/uploading files to Sharepoint, reading and parsing Excel files etc...
If I would want to migrate this to OCI, what would be the best service(s) for it? Is it a simple migration or a redo using a new approach?
I see that we have Data Integration workspaces but it seems not to be able to handle this type of customization...
Not sure about Data Flows. I am definitely not familiar with all Oracle stack, so I need some help :)
Thank you
I need some example where we can version control our db creation for google cloud datastore.
I can see example for the google cloud mysql https://medium.com/#ramzi.maalej/micronaut-using-google-cloud-sql-9b2fc466c01a but is there any documentation by google cloud to work with the google cloud datastore and liquibase.
Any help or example on how to setup liquibase with cloud datastore will be really appreciated
Even datastore does not offer a versioning system, maybe this could be created from the scratch using the export tool and some code in the back.
https://cloud.google.com/datastore/docs/export-import-entities#rest
For example Visual Studio has a tool to make migrations between the structure of the database, this is aimed to Entity Framework that maps relational databases,
But the most important approach is the thing that NoSQL databases maybe doest have context in each change.
https://guptakumartanuj.wordpress.com/2017/09/04/approaches-to-support-versioning-through-nosql-database-like-document-db/
I was wondering how I can deploy a JDBC connector in Google Big Query/Google Cloud.
Or is it even possible to do ?
So far, I didn't find any information on the internet nor in the Google Big Query documentation.
Feel free to provide me any links.
Thank you very much in advance!
Assuming you're really asking "how to connect to BigQuery using JDBC", you can download the official BigQuery JDBC drivers from Google's site:
https://cloud.google.com/bigquery/providers/simba-drivers/
You'll then need to deploy that driver wherever your application is running e.g. a GCP Compute instance.
You cannot deploy anything "in" BigQuery itself as it's a managed service.
I'm working on a project to create hybrid SQL database per tenant model. While we were able to replicate the on-premise databases to databases in Azure. I'm not able to find a way to continuously sync both on-prem DB and cloud DB (We cannot use data sync agent or transaction replication). We are looking for any other alternatives that we can try to achieve our purpose.
Also, how does synchronization works when the internet is down and cannot sync with cloud?
Sorry for my ignorance since I'm new to this field.
Thanks.
why can't you use data sync agent? It can be installed in other machine that has access to the database and internet.
I have an Oracle database installed in a Google Cloud Platform instance, is there any plugin for monitoring it?
What options do I have?
Thank you!
Depending on Oracle version that you are using, you could download Oracle Enterprise Manager.
Also note that Google does not guarantee any setup related to third party sw/db (including Oracle).
Stackdriver for Oracle Database support is now available via the Google Stackdriver integration with BindPlane which provides metric and log monitoring for non-GCP data sources for Stackdriver.
It is fully supported by Google and is free (other than typical Stackdriver consumption fees).
More info can be found here:
https://cloud.google.com/solutions/monitoring-on-premises-resources-with-stackdriver-and-blue-medora
Info specifically around Bindplane for Oracle Database here:
https://docs.bindplane.bluemedora.com/docs/oracle-database