How to download a bunch of files from many links on an open browser window? - download

Okay, this one is hard to classify for me because I don't know the solution yet.
There are these credit card statements that I have to download from my bank's website, but the crazy thing is that they have one separate pdf file for each month - that's like 60 files for last 5 years - and I need to go through all those transactions!
So, being lazy as I am not to just download them one by one, I was wondering if I could write a script or a simple program that can just download these files once I have the browser window open.
Now the key is this - the program cannot directly make an http call to the bank's website, because this window is behind an account authorization screen, after a few clicks to get to credit card statements. What I want to do, is just open the window, and then run some program, and voila, all the files are downloaded.
And just for some super-kicks, it would be awesome if the program could read those pdf files, parse the tables in the pdf and put them into a spreadsheet or something - if someone tells me how to do that in a few hours, you'll get some serious respect and love.. but even the above should be good enough..

Related

How do I create a file to open many different Chrome Browser websites at once on OS 10.13.6

MacOS 10.13.6 Chrome Version 77.0.3865.90
I would like to open 20 different Facebook Group Pages with Chrome (I Do Not EVER Use Safari) with a "batch" file. I know that's a 'Windows' term but that's all I know...
Here's What I Do Now:
Once the Chrome Browser is up, I can open them one at a time from 'Notes' with all the links in one file and then clicking on one link, then click back to notes and click on the next link...
I'd like to save a lot of Daily labor by creating a desktop file I can click on to open them all at once...
I have 41 different groups I use but on my system Chrome can open 20 at a time without a lot of 'WAIT' Time...
I'm REALLY IGNORANT! All the Experience I have is DOS 3.1, from the 1980s-90s I hope one of You WIZARDS can help me with this problem...
Note: I Tried to post what I know how to do but the system won't allow me to put it in since it's now BAD Code(Example I know...Start “facebook-1” www.facebook.com/The Holy Bible).
Thanx HEAPS!
Welcome to Stackoverflow!
I would say the most user-friendly way to achieve this is using Apples build in Automator App.
Here is what I did:
Create a new Automator Program.
I added a "Get Specified URLs" block. Here you can add all the websites you want to open up.
Then I added a "Run Shell Script" block that contains the code to open up Chrome for every url you entered above. Just make sure to pick "As Argument" in the top right of the block.
Once saved all your websites should open up at once.
My system language is set to german but you should be fine to follow along.

Writing a c# or c++ application which can detect if browser is going to download a file

I am going to write an application which runs in the background on windows platform. If user is working on any browser (IE, Firefox, Chrome, etc) and any of the user action results in downloading activity, the background program should take control. The background program pop-ups a window asking user, if they want to download. If user proceeds with OK, then background program sends signal to browser to stop its download process and the background program will do download. If user rejects download by the background program, then default download of browser can go on.
For this please suggest if any working model is there in c#/VB.NET/C++ or how to achieve this activity.
Will very much appreciate your kind help.
Thanking you very much in advance.
I don't think you understand the whole notion of downloading. Any resource you get from the Internet is downloaded. Hence, anything would trigger your application. You can, however, try to "parse" URL to see the extension but this does not have to mean nothing, since you can give any file an arbitrary extension (well not exactly arbitrary, but you know.. ). Another option is detecting FTP downloads ( i assume this might be of more interest ). This way you'd "only" have to check for a specific protocol. The reason i quoted only in the last sentence is that none of these tasks is a simple one.
You basically want to write a Proxy, or use an existing one.
You might wanna take a look at WinPcap
Finally, none of this options really give you the infromation whether user is going to download a file. But if you write a proxy, you could stop the endpoint application of obtaining that file once you download it.

How can I grab a streaming video manifest from a web page?

Inspired by Christmas, I started writing a Linux shell script that essentially grabs today's episode of the daily children's Christmas show from a TV station's online library. My script does the following:
check how many episodes are already downloaded to identify which is next,
open the TV station's web page for that next episode,
programmatically click in the embedded streaming object to activate the stream,
programmatically click "pause" so it doesn't actually play out loud,
missing: grab the video manifest from the browser,
use the AdobeHDS script to download the fragments and join them into one FLV file,
use avconv to convert the FLV file into a friendlier MP4 format.
Well, my step "5" is broken, and that's where I need your help! My problem is that the manifest file doesn't become available until after the streaming object has been activated, and I don't know how to access that programmatically. Here's my manual workaround:
once the web page loads and the script has clicked on "play", the manifest becomes available,
I use Adblock's "open blockable items" to search for "manifest" in the page's resources,
I manually(!) copy the manifest URL into a shell read prompt. From here, the script continues automatically.
Obviously, this manual step prevents me from setting the script up as a cron task.
Here's a Pastebin snapshot of my script.
Disclaimer: I'm totally new to programming, and I realize that a shell script is not really "programming" but sort-kinda is. I am doing this as an interesting exercise and to learn some basic concepts. You can say it's not mission-critical ;-) but you know how you start doing something, only to realize you need to dig deeper into some detail, and then deeper still, and so on. This is where I am finding myself right now. I didn't expect things to become this complicated, but I guess most programmers have that experience at some point :-)
You can use
HDS Link Detector
to capture this information. Example output
http://drod01c-vh.akamaihd.net/z/all/clear/streaming/ca/547d12116187a20e4c6282ca/Jullerup-Faergeby--3-24-_ecfaae965b3344f2907ebf19d852761a_,1125,562,248,.mp4.csmil/manifest.f4m?g=REZLVPFXIRIX&hdcore=3.5.0&plugin=aasp-3.5.0.151.81

Always show file browser in TextMate 2

I've been working for a while with TextMate 2 and there's something I've never been able to solve.
Is it possible to always show the file browser at launch?
I know you can show it with ctrl+alt+cmd+D but I'd like it to always show at launch without having to make this shortcut (as I launch/quit TextMate many times in a day).
I'd be really grateful if anyone had a solution for this problem.
Thanks very much
5 months ago, I contacted Michael Sheets from MacroMates Support and here's his answer:
The file browser is shown when directories are opened or a favorite is open that is a directory. It is not shown when a single file is opened. If you want the file browser shown you should either open the directory itself or take advantage of the Favorite system.
I'm interested to. Did you already find out how to always show the file manager? Maybe it's possible through .tm_properties file?

Open Excel files on a remote computer

I want to programmatically open Excel files on a user's computer, read what is in the first cell, then save this to a mysql db on my webapp with the following info:
cell content (text)
file_updated_date (date)
Is this possible?
Will the user have to install a desktop application for me to open files on their computer, or can I get permission to run a script and return information from a website?
What language or technologies are available to open Excel files, read content, and send to an http endpoint? Is this a Ruby program?
RailsCast is going to be your friend. Learn it, like it, love it. That link should take your straight to his CSV/Excel importing video that can walk you through basically exactly what you're trying to do. As far as reading from the file goes anyways. As for writing back to the webserver, if the webserver doesn't move you can embed the address into your code and work from that. HTTPClient should be able to help you with that part.

Resources