yahoo pipes not integrating all the feed - yahoo-pipes

i created this yahoo http://pipes.yahoo.com/lifestream_ashu/7ba696f34ae17b6fa8f5d4de13064de'>pipe to integrate my twitter+last.fm+picasa feed ..now when i am redering it as json all i can see is the last.fm feed.why is it so ?
link
http://pipes.yahoo.com/lifestream_ashu/7ba696f34ae17b6fa8f5d4de13064dea

seems like now they are .. probably it was a temporary gitch on the server.

Related

Structure of amadeus api https

usualy when I use API's I paste the entire url in browser and it print it out json format using json pro extension in chrome. Like this is a lot easier to copy the path of some data and render it to the page.But my problem is I don't know structure of https. I am not sure where I have to insert the key and secret code. In command line I print all data but I cannot get the path of specific data without using json probextension. Help please. Thank you
I recommend to read the following article:
https://developers.amadeus.com/self-service/apis-docs/guides/authorization-262
and later, review the following repository, you could tinker with the curl request here:
https://github.com/amadeus4dev/amadeus-code-examples
https://github.com/amadeus4dev/amadeus-code-examples/blob/master/airline_code_lookup/v1/get/curl/airline_code_lookup.sh

File Uploading to Google Drive

I am just starting with the Google Drive API. The quick start is quite handy, but it only explains file listing feature.
Cannot find the file upload feature in the Upload file data page.
The RI documentation for Google::Apis only contains hundreds of new line characters (1128 to be specific), and nothing interesting.
How do I upload files to google drive using the Ruby API?
Here are two upload examples using Drive V2 (one resumable, one not), and here you can see the method you should be using in V3 (create_file instead of insert_file), as well as an explanation of all the possible parameters you can provide.
The first example could be written in V3 like this:
drive_service.create_file({title: 'My Favorite Movie'}, upload_source: 'mymovie.m4v',
content_type: 'video/mp4')
Reference:
Class: Google::Apis::DriveV3
create_file

How to get the direct link from a twitter short link

twitter rss feed links comes short (like http://t.co/rwkYrSPD)
I want to get the direct link with using yahoo pipes
How to do it?
Well, obviously you can simply go to the page. for example, http://t.co/rwkYrSPD becomes http://trailers.apple.com/trailers/focus_features/paranorman/
Does Yahoo Pipes have the ability to execute a HEAD request against a URL? If you run a HEAD against that url (curl -I 'http://t.co/rwkYrSPD') you'll get back an HTTP/1.1 301 Moved Permanently response with the actual URL as the Location header.
I realise it's quite a bit later, now, but check out the source of this Pipe, which uses the LongURL API (e.g., http://api.longurl.org/v2/expand?url=http://t.co/rwkYrSPD) together with YQL.

How to extract email id from rss feed with yahoo pipes

I am using a rss feed from Craigslist using yahoo pipes which is working fine. After getting the feed i just want to extract email id from the feed . Can anyone please guide me?
I Link to your pipe would have been useful. Anyways, using rename module create a copy of whatever node that contains the email address to a node say "email". Now use a regex module to effect
In items.email replace ^.*\s([a-zA-Z0-9._]*?#[a-zA-Z0-9._]?)\s.$ with $1
this should work fine

How do I scrape google readers with mechanize (using cookies)

I'm trying scrape google readers but I've got problems...I wish to log in google readers and get a valid cookie...then try enter in this page:
'http://www.google.es/reader/atom/user/-/state/com.google/reading-list'
if my cookies work and I'm logged in I only need to put "user/-/" and it will enter inside my google reader's XML version....
It's in theory ... I log in inside google readers and it redirects ... then I copy my SID .... and I create a manual cookie using this and the google reader's API info
http://code.google.com/p/pyrfeed/wiki/GoogleReaderAPI
name SID
domain .google.com
path /
expires 1600000000
with my cookie create I try enter inside:
'http://www.google.es/reader/atom/user/-/state/com.google/reading-list'
but it don't work .... I think I'm creating my cookie in a bad way but I read the API about CookieJar and Mechanize::Cookie, but I don't find any example about how to use it ... I've tried in different ways but none work ... please someone can help me about how use this cookie....
We do all our web scraping with iMacros (partly free/open source, partly commercial). That works well. No matter what you use, you need something that automates a real web browser. Other options are Selenium or Watir, although these are more geared towards web testing.

Resources