I am trying to scrape subfolders in the form of tabs on the product URL below. I placed the markers before and after, as is needed in the desktop version of outwit hub pro, but nothing happens when I scrape the two URLs (Features & Techdata) in the fast scape option.
The URLs are as follows
Product URL
Features Tab URL
Techdata Tab URL
Am I missing something or is the program unable to scrape sub folders in a secure protocol?
I have the solution. I used Firebug, as I am using Firefox.
What I did was the following:
Went to NET tab in Firebug then the XHR tab.
Clicked on the tab ‘Features & Application’ (the tab that I wanted
to scrape).
Which then turned up the AJAX request URL.
Used the marker before and after as normal, then applied the scraper to the URL that was shown in the XHR tab.
# Arthur : Thank you for your input Arthur I truly appreciate it! May you also find many that people that can help you on your path.
Related
Is there a way to keep Firebug on a single page, so that when I switch pages it remains on the page I want it set to?
For example, I'm working on a project and I get an error that I want to search for on Stack Overflow, but when I navigate here, the console changes to reflect this site. I'd like to stop that from happening.
There is no option to "pin" a page's data in Firebug (as of version 2.x). As far as I know this also doesn't work in any of the browser built-in dev tools.
Though the simple solution for your problem is to open the other page in a separate tab or window. Doing so keeps all the data of the page saved when you switch back to the tab containing your project's page.
Note that Firebug's activation model is based on URLs following the same origin policy. I.e. if you open it for your project's page, it will always get opened for your projects page, even on other tabs, but not for any other site.
I've found it useful to split the tab of interest off into a new window and to activate Firebug on that window. That way I can continue using my original tab collection/window without it changing as I link-hop.
I uploaded some images to a public folder in my Google Drive and would like to display them in a Fusiontable. I defined a column "link" as "Four line image" and store a link to the image there in the following format (provided by #Mori)
https://drive.google.com/uc?id=FILE-ID
example: https://drive.google.com/uc?id=0B6qZJQj7B-4ERS1KZ3p2SE9IbkU
I also tried the following format (provided by #niutech)
http://googledrive.com/host/<folderID>/<filename>
Unfortunately the result looks like this (screenshot 1)
Only after right click onto the image placeholder and selecting "View image", the image is displayed in a separate window. Now going back to the fusiontable the image appears correctly, see screenshot 2:
What could be the solution to this problem? I would like to see all images without need to right click first. Btw, I'm using Firefox.
EDIT: I now set the Fusiontable to "visible to anybody with link" and tested with Google Chrome and Opera. There it works fine. Firefox still does not work. Seems to be a browser issue...
I now set the Fusiontable to "visible to anybody with link" and tested with Google Chrome and Opera. There it works fine. Firefox still does not work. Seems to be a browser issue...
After many attempts I was only able to upload my own images to fusion tables via Dropbox and not Drive. I could not find a way to automate this, so for many images it might be better to go to another visualization platform.
Upload the images to your personal Dropbox (mine were .png)
For each image:
Click on Share -> Create a Link -> Copy link.
Open the 'shareable link' in a new tab. It might help to open the link in a private browser to check that anyone not logged in to Dropbox can view the image. Then right click on your image and go to 'Copy Image Location' (Firefox) or 'Copy Image Address' (Chrome). You will notice if you put this link in a new tab it will prompt you to automatically start downloading the image.
Paste this image location URL into the appropriate fusion table cell and make sure the column attribute is defined as e.g. "Four line image" and not 'URL'.
You almost had the correct answer. You have to change your picture's URL from the one for viewing the picture, to a direct URL for download.
See https://www.labnol.org/internet/direct-links-for-google-drive/28356/ for details.
I managed to do this in a calculated column (I use google form to gather info, then google spreadsheet and than synchronized fusion table). I changed the URL with spreadsheet formula:
=CONCAT("https://drive.google.com/uc?export=download&id=",right(left('URL',(len('URL')-17)),len('URL')-49))
Where 'URL' is the URL for viewing your picture in the browser.
Hope it helps anyone else!
I am making a firefox pluggin and I want to open a "topbar" on a few websites. Realy, it would be a few informations about the curent page a link back to my own website. What would be te best way to do that ?
My first idea was to use content script, but that seems to be a very bad practice. I also read about panels, here are my questions :
How can I add my pannel just under the adressbar ?
How can I only open in it on the website I need ?
thx.
Using content script is completely fine.
It is modern, simple, less-code, more compatible way
to add top-panel to some web pages.
Also, code of content script is not injected to the web page, it just uses the dom and context; page script has no access (if you do not provide it explicit) to content script.
The only possible disadvantage is that panel would not look like native part of the browser.
If I convienced you to use content script:
The module you really need in your plugin page-mod
Using Add-on Builder you make have your plugin in a day
I've looked around online for this but can't seem to find an answer anywhere so hopefully someone can help.
I'm getting a "Windows Security" popup appearing on a site I've created (and so are others which is who I need to fix it for rather than myself) when trying to download a word document or excel file. PDFs seem fine.
An example page is http://www.christletonhigh.co.uk/school_information/uniform.php if you click to download the “Uniform Prices & Order Form” in the bottom right.
There’s no SSL on the site and the error only comes up on IE (I'm using IE9 on Windows 7 which I've seen others mentioning online as their setup with this happeneding) and doesn’t seem to effect all files so it’s a bit confusing. Clicking cancel on the popup causes the document to open anyway.
Anyone have any ideas please? The client tells me that the documents causing the problems have never been password protected.
For the reference, here's the detailed explanation why this happens: http://support.microsoft.com/kb/2019105
Solution mentioned by Anshuman should work: create script that adds "Content-Disposition" header with "attachment" value. For example: Content-Disposition: attachment; filename="myfile.doc". This will force all the content (including PDF, images, etc.) to be downloaded.
Security settings aside, other browsers seem to handle this more gracefully than IE9. Chrome, for example, seems to handle the download of the document with ease, and not result in a Windows Security dialog prompting for credentials to their network...
The users can disabled the 'protected view' settings from Word options | Trust Center, and the document will open with no dialog (probably not desirable to instruct them to do this)
I suppose this is the risk one takes when having users download content which require other applications to handle. a PDF would be better (hence the "P" for "Portable"), so if they can use PDF, that would be my first advice.
This issue comes when you give the direct URL path of the file and let the browser handle the file. To resolve this create a php script that explicitly downloads the file. Hope this helps :)
I use Conkeror on a daily basis except at work where I need Firebug, since I'm a web developer. I really miss having the "follow link" ability in Conkeror but I don't want to resort to using Vimperator to get it.
Is there any Firefox extension which lets me follow links by hitting a key followed by the link text like in Conkeror?
There are many ways you can already use only the keyboard to browse with Firefox.
Searching pages
The find-as-you-type feature was an epiphany. While Google is great at getting you to the right web page, Firefox's find-as-you-type feature gets you the rest of the way.
Find as you type text: /
Find as you type link: '
Regular old find: Ctrl/Cmd+F
The link search is very useful, especially when used in conjunction with...
Opening pages
Unless you do all of your browsing in one page, these shortcuts are huge when you don't want to go running for your mouse.
Open link in new window: Shift+Enter
Open link in new tab: Ctrl/Cmd+Enter
Open address/search in new tab: Alt/Option+Enter
Used together with their respective shortcuts (address and search bar shortcuts and the find-as-you-type link shortcut), the page opening shortcuts go a long way toward mouse-less browsing.
Of course, you can also use the Mousless Browsing plugin.
Mouseless Browsing (MLB) enables you to browse the web entirely with the keyboard. The basic principle is to add small boxes with unique ids behind every link and/or form element. You just have to type in the id to trigger the corresponding action i.e. following a link, pressing a button or selecting a textfield...
There's Pentadactyl - and all firefox extensions work well with it.
https://addons.mozilla.org/en-US/firefox/addon/8781
Works even better with Linkification, I might add.