Pentaho data integration, Move Files ERROR: Could not rename file - shell

I'm running a job with Pentaho Data Integration 8.1, I retrieve a file frop ftp, work on it and move it to a folder.
I tried, as I did many other times with no problems, to use 'Move Files', but I get this error:
Move Files - ERROR (version 8.1.0.0-365, build 8.1.0.0-365 from 2018-04-30 09.42.24 by buildguy) : There was an error moving file [file:///C:.../file.csv] to [file:///C:.../file.csv] : [Could not rename "file:///C:.../file.csv" to "file:///C:.../file.csv".
I checked permissions on the file and on the destination folder, everything's fine.
I tried to use "Process result filenames" step with no success.
I tried to rename or delete the file instead of moving it, same error.
I tried to move this job into a new parent one, with "Move Files" step in it, same error again.
I also tried not including the filename to result prior to the Move Files step: nothing.
Then I wrote a simple shell script:
cd\
cd C:\...\working_directory
move "filename with spaces.csv" /destination_folder
and I get this (I translated it from italian):
ERROR (version 8.1.0.0-365, build 8.1.0.0-365 from 2018-04-30 09.42.24 by buildguy) : (stderr) No access to the file. The file Š is used in another process.
The file isn't used in any other process, I can move it manually without the spoon process running, so I think the ftp step, or the transformation one I use to work on the file (simple 'CSV Input' and ETL) somehow keep the file open.
Any idea as to how to "unlock" the file, so that it can be moved?

Related

LibClamAV Error:cl_load:No such file or directory: C:\Users\my-pc\Desktop\clamav-win32-clamav-0.99\contrib\msvc\Debug\Win32\db

I downloaded Clamwin source code and loaded the clamwin solution to visual studio(2010 professional) and successfully built all project without any errors. After clicking start without debugging(seting clamscan project as startup ) I'am getting bellow error on cmd-prompt.
LibClamAV Error:cl_load:No such file or directory: C:\Users\my-pc\Desktop\clamav-win32-clamav-0.99\contrib\msvc\Debug\Win32\db
-----------SCAN SUMMARY-------------
Known viruses: 0
Engine version: 0.97.8
Scanned directories: 0
Scanned files: 0
Infected files: 0
Data scanned: 0.00 MB
Data read: 0.00 MB (ratio 0.00:1)
Time: 0.003 sec (0 m 0 s)
Press any key to continue . . .
I searched solution online and I got Clam is looking for it's database files and the directory doesn't have them, doesn't exist, or Clam doesn't have sufficient rights to access the files.
But how should I solve this? should I create file or directory in that path or should I make it find itself?
Just run freshclam -> downloads fresh vc db to predefined dir (DatabaseDirectory in freshclam.conf). Before you do this, you must set up the freshclam.conf.
Then set up the same DatabaseDirectory in clam.conf.
(There was a bug here for me. I was installing on Windows and used forward slashes all over the config files as dir delimiter of path. At DatabaseDirectory value i had to change my forward slashes to backslashes to be able to run clamdscan successfully)
Finally, try run clamscan.
Please, tell me, if it did not help.
As specified in question Clam is looking for it's database files and the directory, directory /db should be updated with database by Running the freshclam tool,to run freshclam(if there is an Error), download the freshclam.conf file and edit the file as required.Then click on start debugging from the debug menu. Clamscan scans current working directory. For more information on clamscan

Creating Setup of large data with NSIS Script

I am creating setup of large data approximetly 10 GB with NSIS Script and trying to create a single setup (exe). Its giving an Error -
Internal compiler error #12345: error mmapping file (xxxxxxxxxx, xxxxxxxx) is out of range.
Note: you may have one or two (large) stale temporary file(s) left in your temporary directory (Generally this only happens on Windows 9x).
Please tell me how to solve this issue ?
Is there any other way to create a setup for this kinda situation ?
NSIS installers are limited to 2Gb.
If you absolutely need it to be one file and you want to continue to use NSIS you have to append the data to the end of the generated setup. I'm not sure I would recommend that approach but it could work if the appended data is a zip file (or some other format with the header at the end) and you use one of the NSIS zip plugins to extract at run-time...
I have used https://sourceforge.net/projects/nsisbi/ instead of normal NSIS. It solved the problem.
I was using Silent Install Builder 5 and received this same error with a package installer that had LESS that 2 GB total. Once I determined that the NSIS compiler was to blame, I began experimenting with several possible solutions and here's what worked: I downloaded the newer NSISBI compiler from here https://sourceforge.net/projects/nsisbi/ and then did these 3 steps:
Go to C:\Program Files (x86)\Silent Install Builder 5 and renamed the default NSIS folder to a new name.
Copied the NSISBI folder into the C:\Program Files (x86)\Silent Install Builder 5 directory and renamed IT to NSIS.
Tries to compile some large packages above and just below 2GB and the first few tries I would get missing file errors in the Silent Install Builder 5 compiling box. No worries because the missing files are in the old NSIS folder, that's why y9u don't delete it.
Each time find the missing file error displays, find the missing files and copy them into the same folder location in the new NSIS folder. About 3 times you will do this until there are no more errors at all and you can then include the large files without generating the "internal compiler error #12345: error mmapping file xxxx is out of range." error message. NSISBI works!

Clearcase UCM: rebase fails - error (apparently) is a lie - what's the root cause?

I have a rather standard setup with a development stream (devStream) that delivers to and rebases from an integration stream (intStream).
I have a file in my development view (devView) that I can checkout, modify, and checkin normally.
However, when I attempt to deliver (and later rebase) however I get an error that baffles me... (especially as I have been delivering and rebasing for the past 6 months) It may be worth noting that we recently upgraded from Rhapsody 8.0.2 to 8.0.4 (and correspondingly upgraded the diffmerge tool that clearcase's map file points to for rhapsody files), however given when the errors are arising I can't see how this could be at fault.
Since the graphical mode can be hard to get enough debug info from I captured the results of some command line runs.
Here's the (annonymized) result for
starting a rebase
cleartool> rebase -recommended
*SNIP*
Creating integration activity...
Setting integration activity...
Merging files...
Checked out "C:\CCVs\myDevView\shortenedPath\theFile.sbs" from version "\main\intStream\devStream\9".
Attached activity:
activity:NSSLB00001350#\projects "rebase devStream on 20131120.195128."
Needs Merge "C:\CCVs\myDevView\shortenedPath\theFile.sbs" [to \main\intStream\devStream\CHECKEDOUT from \main\intStream\9 base \main\intStream\8]
cleartool: Error: Unable to access "C:\CCVs\myDevView\shortenedPath\theFile.sbs": No such file or directory.
cleartool: Error: An error occurred while merging file elements in the target view.
cleartool: Error: Unable to perform merge.
cleartool: Error: Unable to perform integration.
cleartool: Error: Unable to rebase stream "devStream".
attempting to resume the rebase
cleartool> rebase -resume
Rebase in progress on stream "devStream".
Started by "XXXXX" at 11/20/2013 7:51:28 PM.
Merging files...
cleartool: Error: Unable to access "C:\CCVs\myDevView\shortenedPath\theFile.sbs": No such file or directory.
cleartool: Error: Some files are already checked out to a non-integration activity in the target view.
cleartool: Error: Unable to perform merge.
cleartool: Error: Unable to perform integration.
cleartool: Error: Some files are already checked out to a non-integration activity in the target view.
cleartool: Error: Unable to resume rebase.
listing the information associated with the thusly created integration rebase activity
cleartool> lsactivity -long NSSLB00001350
activity "NSSLB00001350"
2013-11-20T19:52:00-06:00 by XXXXXX
"Integration activity created by rebase on 11/20/2013 7:51:28 PM.
"
owner: XXXXX
group: XXXXX
stream: devStream#\projects
current view: myDevView
title: rebase devStream on 20131120.195128.
change set versions:
C:\CCVs\myDevView\shortenedPath\theFile.sbs##\main\intStream\devStream\CHECKEDOUT.94426
clearquest record id: NSSLB00001350
clearquest record State: Active
cleartool>
listing checkouts for anyone, on any stream, anywhere in this portion of the directory structure
cleartool> lsco -r
--11-20T19:51 XXXXX checkout version ".\shortenedPath\theFile.sbs" from \main\intStream\devStream\9 (reserved)
Attached activity:
activity:NSSLB00001350#\projects "rebase devStream on 20131120.195128."
At this point I'm confused about how to proceed. Googling isn't bringing up anything that seems relevant (or maybe my google skills are weak).
It's also worth pointing out that my clearcase skills are entirely self-taught on an as-needed basis... so I'm sure I've got holes in my knowledge. Meaining even if something seems like it would have been obvious to do, please point it out; I may be unaware.
Requested Info
With no rebase being attempted
C:\CCVs\myDevView\shortenedPath>cleartool ls
theFile.sbs##\main\intStream\devStream\9 Rule: ...\devStream\LATEST
theFile.sbs.merge
theFile.sbs.merge.1
theFile.sbs.merge.2
theFile.sbs.merge.3
theFile.sbs.merge.4
*snip (other files)*
In middle of failed rebase
theFile.sbs##\main\intStream\devStream\CHECKEDOUT from \main\intStream\devStream\9 [not loaded, checkedout but removed]
*snip*
theFile.sbs.merge.5
So... the rebase is doing something odd to the file; but why does it dissapear when doing a rebase/deliver and not when doing a normal checkout?
To debug this, you must go to the command line, in a shell, and go to the parent folder of the missing file:
cd /path/to/target/view/path/to/parent/folder
# in your case
cd C:\CCVs\myDevView\shortenedPath\
cleartool ls
cleartool lsvtree -graph .
The status of the file returned by the cleartool ls can give you a clue as to what is going on.
For instance "checkout but removed" would means the mergetool tried to access/open that file, but somehow it was deleted: that happens when said file is taken by a process, and cannot be completely checked out.
The lsvtree can also give you clues regarding the parent folder (to see if it was merged or not).
Another approach is to cancel that rebase, and try it again in a dynamic view instead of a snapshot view, in order to avoid any side-effect with a snapshot view not correctly updated.
The OP Khanmots concludes in the comments:
I undid the rebase (to get a copy of the file) and started it again.
When it bombed out I copied the file back in then hit to restart the rebase. Deleted it again.
I then replaced the file while leaving the prompt to start the diffmerge tool open, this allowed diffmerge to actually launch... but when I tell the diffmerge to save (after resolving differences) it deletes the file and creates another .merge.# file.
At this point it's looking like it's a diffmerge issue and not a clearcase issue.

File Replace during upgrade

We use Inno Setup(version 5.4.2) as the packaging tool to generate our installer. While upgrading our software from older version to current version,
we try to overwrite existing binaries/drivers. This is often leading to issues as some monitoring software like 'HP ArcSight Logger/Connector', 'SplunkUniversalForwarder' etc. are holding file handles on our binaries and casuing overwrite to fail. Our installer shows beolow popup message on encountering this issue each time.
"C:\Windows\System32\drivers\xxx.sys
An error occurred while trying to replace the existing file:
DeleteFile failed; code 5.
Access is denied.
Click Retry to try again, Ignore to skip this file(not recommended), or Abort to cancel installation"
Interestingly, even after above getting above pop-up, we were able to rename xxx.sys to xxx.sys.old manully. We used to suggest cusotmers to rename
xxx.sys to xxx.sys.old and 'Retry' the installation. After renaming, upgrade used to complete without any issues.
Questions
1) Is it possible to rename xxx.sys through program always, when we hit this issue.
2) Any process to reproduce the DeleteFile failed; code 5 issue?
Using the installer you can rename the existing file and install the new file using the correct file name with help from the windows registry.Remember to ask the user to reboot their computer to complete the install.Another option would be to either use the installer to rename the file and again using the window's registry to delete the unneeded file.
Window's registry allows you to delete or rename files on reboot as part of an install.
Reference to use of PendingFileRenameOperations:
http://support.microsoft.com/kb/181345
Example to rename from microsoft support:
The syntax used is (without quotes):
"\??\source file !\??\target file"
HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Control\Session Manager
Value name: PendingFileRenameOperations Data type : REG_MULTI_SZ
Value data: \??\c:\temp\win32k.sys !\??\c:\winnt\system32\win32k.s
The same command can be used to delete a file as well although requires the use of nulls.
http://www.pcreview.co.uk/forums/pendingfilerenameoperations-delete-file-t1715654.html
Same example used to delete a file:
HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Control\Session Manager
Value name: PendingFileRenameOperations Data type : REG_MULTI_SZ
Value data: \??\c:\temp\win32k.sys\0\0\0
I hope this helps you!

Why is xcode giving me these building warnings and errors?

I created an app that plays a sound when you press a button and it was working fine initially. I'm not sure what happened, I deleted one of the files and now xcode keeps giving me a warning in reference to a file Not being found. I've deleted and recreated the file, commented out the code using the file, and cleared but build but nothing seems to be working. I'm new to xcode and app development. Here's the errors I keep getting:
Check dependencies
[WARN]Warning: Multiple build commands for output file /Users/adrienneiverson/Library/Developer/Xcode/DerivedData/SpeakUp1-aoakahingahxuwfhopwfckqlxewc/Build/Products/Debug-iphonesimulator/SpeakUp1.app/Bye.mp3
Warning: Multiple build commands for output file /Users/adrienneiverson/Library/Developer/Xcode/DerivedData/SpeakUp1-aoakahingahxuwfhopwfckqlxewc/Build/Products/Debug-iphonesimulator/SpeakUp1.app/Bye.mp3
CpResource ../../Sounds/Mp3/Bye.mp3 /Users/adrienneiverson/Library/Developer/Xcode/DerivedData/SpeakUp1-aoakahingahxuwfhopwfckqlxewc/Build/Products/Debug-iphonesimulator/SpeakUp1.app/Bye.mp3
cd "/Users/adrienneiverson/Desktop/SURE PROGRAM 2011 - GA TECH/SpeakUp1"
setenv PATH "/Developer/Platforms/iPhoneSimulator.platform/Developer/usr/bin:/Developer/usr/bin:/usr/bin:/bin:/usr/sbin:/sbin"
builtin-copy -exclude .DS_Store -exclude CVS -exclude .svn -exclude .git -resolve-src-symlinks "/Users/adrienneiverson/Desktop/SURE PROGRAM 2011 - GA TECH/SpeakUp1/../../Sounds/Mp3/Bye.mp3" /Users/adrienneiverson/Library/Developer/Xcode/DerivedData/SpeakUp1-aoakahingahxuwfhopwfckqlxewc/Build/Products/Debug-iphonesimulator/SpeakUp1.app
error: /Users/adrienneiverson/Desktop/SURE PROGRAM 2011 - GA TECH/SpeakUp1/../../Sounds/Mp3/Bye.mp3: No such file or directory
error: /Users/adrienneiverson/Desktop/SURE PROGRAM 2011 - GA TECH/SpeakUp1/../../Sounds/Mp3/Bye.mp3: No such file or directory
I have no idea what multiple build commands they're talking about and the file is located in the directory that they're saying its not in...I'm lost....
Have you cleared the build folder?
Or is that what you meant by I've deleted and recreated the file, commented out the code using the file, and cleared but build but nothing seems to be working.?
Tjeu

Resources