On Prem to Cloud with Data Factory - oracle

I have one On Prem Oracle database and one Azure SQL Database and want to use a Copy Data activity to transfer this data.
I have now created a Self Hosted IR for the Oracle database, and I am able to connect to it and preview data from Data Factory editor:
I have a Azure SQL Database that I want to recieve data, and it is set up with AutoResolveIntegrationRuntime, with Connection successful. I am also able to preview data from this database:
When I try to run this Copy Data activity I get following error message:
ErrorCode=SqlFailedToConnect,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Cannot connect to SQL Database: 'sqlsrv', Database: 'database', User: 'user'. Check the linked service configuration is correct, and make sure the SQL Database firewall allows the integration runtime to access.
Based on all Docs/Tutorials I have read this should not be failing. I have tried to open up the SQL Server to allow all IP adresses in firewall rules.
Any ideas what I might be doing wrong here?

Since the integration runtime is a bridge across on prem and cloud , you need to check whether you are able to access the onprem database and the Azure SQL database through the VM in which the IR is installed.
The VM hosting the IR should be able to access both the source and sink for the copy activity to be successful in case if either of source or sink is using the self hosted runtime.
So the issue is not w.r.t Azure SQL database but in the VM hosting the IR

Related

Is there a way to connect to on prem oracle database using azure pipeline?

I need to connect to on-prem Oracle Database using Azure pipeline. I have created self-hosted agent which runs on the same subnet as the database. I have created a deployment group as well. However, I am not able to find a task that I could add as a stage to the release pipeline that could authenticate the db server using the credentials and run a GET query to pull data. Am I on the right track? Are there other alternatives? Thanks.
please use data factory in Azure to connect Oracle database on-premise. Yes, you should install a self-host Integration runtime for data factory. setup "Linked services" in data factory, so that you can input the credentials/connection string there.
please reference this URL: https://learn.microsoft.com/en-us/azure/data-factory/introduction

How can I run my project on client pc without installing SQL server on client pc

I have developed a c# windows application which uses SQL server 2012 database in Visual Studio 2015 which is running well on my pc.
I am to install this application on a number of computers without SQL server installed on it, but when I run the application, its gives me database connection error.
My question is, how can I create the setup file to be able to run the app on those clients pc without installing SQL server on all those computers. Please I need your help.
Thank you.
Am Emmanuel.
Use an Azure database and have the clients connect to that.
Have a look at https://azure.microsoft.com/en-us/services/sql-database/
Alter your application connection string and make sure you keep the connection string secret.
Server=tcp:myserver.database.windows.net,1433;Database=myDataBase;User ID=mylogin#myserver;Password=myPassword;Trusted_Connection=False;Encrypt=True;MultipleActiveResultSets=True;
An important fact is that the clients need to allow communication via port 1433.
If this is not an option create an API application and query the database via that.
If you need a private database per client you can use a database file and connect to the file
https://learn.microsoft.com/en-us/sql/database-engine/configure-windows/sql-server-express-localdb?view=sql-server-ver15
Update based on reply
You can create a pop-up on the application allowing the users to add valid settings and credentials when your appsettings.json is blank or "a test connect" to the database fails.

Connect JDeveloper application to Oracle Live SQL

I am new to ADF/JDeveloper. I'd like to configure my ADF Web application to Oracle Live Server, since I'm using a Mac computer, which are not supported by Oracle's database distribution, I have tried to use Oracle VM but it freezes my Mac.
Needs information on database configuration panel are:
Host name
JDBBC port
SID
Oracle does not provide database connection information for the database behind livesql.oracle.com. If you want your own cloud database, you should look into setting up an Oracle Cloud Free Tier database. If you configure your database using the Always Free options, you should be able to have your database around for free forever.

Supported data providers for Oracle in Azure Data Factory SSIS IR

We are trying to use Azure Data Factory SSIS Integration Runtime service to run a set of existing SSIS packages (basically to transfer data from oracle to SQL Server).
However, when deploying, there is a validation error saying "Package xxx: Connection xxx contains unsupported provider."
We tried using the following two providers in the SSIS packages, both of them were reported as unsupported:
"Oracle Provider for OLE DB"
"OracleClient Data Provider"
What are the supported providers for accessing Oracle in ADF with SSIS IR?
When connecting to Oracle using a provider such as "Oracle Provider for OLE DB" we need to install that to the node(s) running SSIS IR. This can be done by customizing the SSIS IR using the portal.
https://learn.microsoft.com/en-us/azure/data-factory/how-to-configure-azure-ssis-ir-custom-setup
Steps summary:
Download and edit the sample script (main.cmd) provided in the above
link (from the publicpreview container)
Upload it with the ODAC122010Xcopy_x64.zip file to an Azure
Blob Container.
Get a "Shared Access Signature" uri for this folder.
Shutdown SSIS IR.
Go to customize the SSIS IR and provide the link copied.
Restart SSIS IR.
Your SSIS package is access on-premise local Oracle DB.
As you know, Azure can not connect to on-premise resource directly. For example, when we need access the local SQL server, we must use Self-host integration runtime.
When deploy it to Azure and run the package in Data Factory, you will get the error.
We can get the reason from the document: Azure-SSIS Integration Runtime:
Azure-SSIS IR network environment
Azure-SSIS IR can be provisioned in either public network or private network. On-premises data access is supported by joining Azure-SSIS IR to a Virtual Network that is connected to your on-premises network.
The solution: Join an Azure-SSIS integration runtime to a virtual network:
If your SSIS packages access data stores/resources that allow only specific static public IP addresses and you want to secure access to those resources from Azure-SSIS IR, you can bring your own public IP addresses for Azure-SSIS IR while joining it to a virtual network and then add an IP firewall rule to the relevant resources to allow access from those IP addresses.
I'm sorry I can't test it for you because I don't Oracle environment.
Hope this helps.

Error when adding Oracle DB to ODBC connection

Hi everyone here,
I am pretty new to Oracle DB configurations as I have been using SAS and Microsoft SQL all this while.
What i want to do is to add Oracle DB to ODBC(64-bit) in a new server.
This is the scenario:
Server A:- Existing Application server that has Oracle configured in ODBC(64-bit)(Been using for the past 3 years, configured by other people).
Server DB:- The Database server
Server B:- Brand new server that i want to configure Oracle DB in ODBC(64-bit)(Brand new).
I copy every single details of the server information in Server A ODBC for the same Oracle DB and put it in Server B ODBC. I have both Server A and Server B remote connection side by side and do "Test Connection".
Server A can connect successfully. However, Server B is giving me this error:
SQLState=08004
This is my first time trying to configure for ODBC to Oracle DB. I have previously configured many Microsoft SQL DB without any issue. Do take note that i have not installed any Oracle driver or any necessary-tool needed for ODBC to link with Oracle as i do not know of any. Is there anything i have to install for this to work or any necessary settings need to be done before configuring it?
All this while for Microsoft SQL connection to ODBC, i just put in the DB credentials and voila.
Your help is very much appreciated.

Resources