Knime automatic Workflow with a Database - oracle

I want to create multiple Workflows in Knime with a Oracle Database so that i have one big Database in the end with the customized tables i need. The final Knime Data i want to upload to PowerBI to create a kind of Reporting.
**Is it possible to automize the Workflow at a certain time?

Yes - there are two approaches:
KNIME server (cloud or on premise), which is a paid license. It allows you to schedule workflows to run at set times or intervals
Via batch command - see https://www.knime.com/faq#q12 for the details. If you go this way, it is easiest to set up a .bat or .sh file (depending on whether you are on Windows or Linux) to run the workflow, and then schedule it using either crontab -e on Linux of the Windows Task Scheduler

Related

Apache Airflow to manage Windows Batchs files execution

My boss asked me to use Airflow to manage many batch file executions on two Windows Servers.
His concern is that he doesn’t like the e-mail system for reporting each batch execution at the end, indicating success or problems.
He wants a “cool” web page to manage and start batch files from there if need be (really rare, only when there is a failure you have to manually start a batch file).
I did setup Airflow using WSL2, it is working, and I’m able to launch a Windows batch from Airflow. The problem is that it always report errors (red dot in the Airflow interface).
I did search a lot, and I didn’t find anyone who seems to be using Airflow for Windows Servers batch control.
I must mention that the batch files mainly just transfer files from local servers to other clients via FTP.
It seems to me that Airflow is not the solution here, and it is like using a tank to kill a bee…
I’m I right? I want to make it clear to my boss that this is spending money and hour of work on something that is not needed here.
Please share your thought! Thanks!

Is it possible to run a .exe in windows through pgAgent?

My company currently applies PostgreSQL 10 and windows server 2008 OS.
I need to run a C wrote calculation program in .exe file each month.
However, it is not perfect to double click and run it every month. Furthermore, I would like to be able to run it at anytime where most of the resources are free (like mid-night). So I would like to ask if any of the following would be possible?
Setup a job in pgAgent to auto-run .exe file each month?
And is there a way to get returned info from the running results?
Thanks for anyone who gives any clue.
Windows Task Scheduler would be better suited for this task. You can select your .exe, set a run date/time and frequency. If you provide a user/password, it can run the task even if you are not logged in. See here for a tutorial.

Windows to Windows Connectivity

I want to automate a job in my windows server,Can any one please share some idea or initiation for this scenario?
I like to connect from my windows server to another windows server and download the oracle database table in .csv format and place in my system folder.And this job should run every day.
Basically, i'm into UNIX platform but i want to do this in WINDOWS platform, Thank you for your support!!
You need to create a small application to do that, you can use ASP.NET to build the application, or PHP, but the latter will require more effort to setup the environment. After the application built, you will have to create windows task scheduler to execute the application at a specified time.

PowerShell script not properly e-mailing Excel report file when ran automatically in the scheduler

When I run the PowerSheel script manually - through a .bat file that executes it with the PowerShell interpreter - it correctly executes an SQL query and creates an Excel file and e-mails it.
If I automate it - run the .bat file that runs the PowerShell file with the interpreter through the Windows job scheduler every night - then the e-mail is sent without the file.
It is difficulty to copy the code here because I made a nice framework many functions deep with lambda-functions and all, but generally:
$ExcelWorkBook.SaveAs($Filename)
$ExcelWorkBook.Close()
$ExcelApp.Quit()
(...)
Sleep -Seconds 500
(...)
$MailMessage.Attachments.Add($Filename)
$SMTP.Send($MailMessage)
I have heard that Excel does not actually support GUI-less automation (windows task scheduler) but that actually worked for me through a different framework.
What can I do to make it work, if cannot how can I generate Excel files from PowerShell in a different way, or how can I just easily generate and e-mail reports in PowerShell?
if you are running windows 2008 or above, then the job is probably executed in session0 (read about session0 isolation at microsoft).
You have to create Desktop-Folders for session0, read more here:
http://social.msdn.microsoft.com/Forums/en/innovateonoffice/thread/b81a3c4e-62db-488b-af06-44421818ef91
Windows 2008 Server x64
Please make this folder
C:\Windows\SysWOW64\config\systemprofile\Desktop
Windows 2008 Server x86
Please make this folder
C:\Windows\System32\config\systemprofile\Desktop
Then restart machine and try again.
I got it working with GUI-less Excel automation via task scheduler and powershell, done by creating those folders.
#Dan yes I do. CSV is a really poor report format for corporate reporting, no colors, no formatting, nothing. A manager would be insulted to find that in his inbox.
#VonPryz - but manually it works! So you say debug the scheduling?

Scheduling jobs on windows

What is the best way of scheduling simple batch jobs on windows? My current need is to dump some SVN repositories each night and FTP the dumps to our external FTP side and then e-mail one or more people that the backup has completed/failed.
This sounds like the sort of thing I would usually do in a unix script + cron. Is that possible on windows? Perhaps using Cygwin?
Windows Scheduled Tasks. This area is available through the control panel and may require administrative rights. It's basically crontab for Windows. Run a Windows batch file (or any executable) at a specified interval using a specified user.

Resources