As it currently stands, this question is not a good fit for our Q&A format. We expect answers to be supported by facts, references, or expertise, but this question will likely solicit debate, arguments, polling, or extended discussion. If you feel that this question can be improved and possibly reopened, visit the help center for guidance.
Closed 10 years ago.
From the extense list of Quantum and Molecular Dynamics packages, which ones can be easily "interconnected" to a cluster which works with the queueing systems PBS and Sun Grid Engine?
Or is it there some program or method that allows "packing" all jobs in a PBS or SGE way?
Thanks
I'll be very surprised if many of the packages on your list cannot be easily run on a cluster under PBS, SGE or both. At their simplest they are just batch job managers so if you can write a command line to execute your chosen program you can write a job script for submission. With SGE, I'm not so familiar with PBS, you can even run interactive jobs on a cluster.
You probably want to know about executing parallel versions of your packages under PBS and SGE. Again, very straightforward if (a) the package is parallelised and (b) the cluster has the right parallelisation system configured.
If you have any more specific questions about particular packages perhaps, you could try posting again, though I suspect that the producers of the package, or their website, is a better place to start than SO.
Related
As it currently stands, this question is not a good fit for our Q&A format. We expect answers to be supported by facts, references, or expertise, but this question will likely solicit debate, arguments, polling, or extended discussion. If you feel that this question can be improved and possibly reopened, visit the help center for guidance.
Closed 10 years ago.
I want to start development on some big data application based on apache hadoop. I want to know what is the best way to start development hadoop for novice. what are the available development framework and tools other than the Apache hadoop core ?
Further, Is there a good tutorial on Spring hadoop development on eclipse ?
Eclipse is just fine for hadoop development. In my expierance you do not need nothing special above of Java dev environment. Hadoop has very nice local mode when all deamons are running in one process and you can easily debug your MapReduce code.
In practice it is usually enough to debug 99% of problems.
It is also possible to set up Hadoop dev environment with Eclipse on Windows. You will need cygwing, but aside of it is easy.
As it currently stands, this question is not a good fit for our Q&A format. We expect answers to be supported by facts, references, or expertise, but this question will likely solicit debate, arguments, polling, or extended discussion. If you feel that this question can be improved and possibly reopened, visit the help center for guidance.
Closed 10 years ago.
I see two gems whenever and rufus-scheduler for running cron jobs in ruby. Which is the better choose ?
It depends.
Whenever is backed by the cron daemon of your system (so if your system has no cron daemon it won't work).
Rufus-scheduler is running inside of your Ruby runtime, it's not depending on a cron daemon, but if your Ruby runtime is going down, the schedules will be lost.
Please make sure you understand those differences, then decide, for yourself.
Do you need to run background jobs or cron jobs? What is your frequency of scheduling jobs?
There are some RailCast episodes on the background jobs topic: Starling and Workling, Delayed Job, Resque, Beanstalkd and Stalker, Queue Classic. Some episodes are pre 2010 and RoR evolves fast...
There are couple of cooler options than u mentioned in your question
one is Resque. here is railscasts for same.
other one is SideQik. Here is railscasts for same. Sideqik is new kid in the town and is doing pretty awesome.
As it currently stands, this question is not a good fit for our Q&A format. We expect answers to be supported by facts, references, or expertise, but this question will likely solicit debate, arguments, polling, or extended discussion. If you feel that this question can be improved and possibly reopened, visit the help center for guidance.
Closed 11 years ago.
In what ways are scripting languages (especially bash) is used to manage large C++/C programming projects?
It will be helpful if someone can list some clever uses of scripts in their programming projects at automating certain tasks.
I personally used shell scripting to invoke my program multiple times for different inputs, for loading the necessary modules before I try to run my program, for automatic graph plotting with gnuplot etc. When I was working on huge clusters I also found a script very useful when I had to set/query some runtime settings to launch my tasks on the cluster. I always use GNU Make to build my programs, but if you have extremely small non-critical projects, you can use scripts to even build your code.
I am sure that there are a lot of other innovative ways to use bash scripts, but whatever I just said is from the perspective of an ordinary developer who does a lot of (almost) mundane stuff everyday. And bash scripts have made my life a lot easier, to say the least.
As it currently stands, this question is not a good fit for our Q&A format. We expect answers to be supported by facts, references, or expertise, but this question will likely solicit debate, arguments, polling, or extended discussion. If you feel that this question can be improved and possibly reopened, visit the help center for guidance.
Closed 10 years ago.
Is still worth learning expect? Because I have not seen any new books on this topic? What would anyone recommend for a good book on this?
expect is best used for controlling scripts that output queries and require a response. Many other languages struggle with this and create deadlocks on stdin/stdout when trying to use both. Expect also overcomes some issues with password entry (like when scripting SSH).
Having said that it isn't necessary to know expect because many other languages have an expect module (tcl and python come to mind) which provide the same behaviour.
I would have to say it depends on your job. If you spend a lot of time interacting with repetitive commandline scripts or FTP then expect is well worth adding to your scripting arsenal.
SpliFF wrote above about "... interacting with repetitive commandline script or FTP ..." While I'm all for automation, and regard Expect as indispensable, Expect is NOT necessary in 2010 for FTP or many other roles where it once was necessary. Fifteen years ago, for example, Expect was an appropriate way to automate FTP; now, most scripting languages already build in capabilities sufficient to replace Expect's use with FTP. Many, many automations can be done with what Perl, Python, Tcl, ... already build in, and Expect is not essential for these applications.
It never hurts to have another tool in your kit. Expect really does fill its niche extremely well.
The quintessential Expect book is Exploring Expect. It's the only Expect book you need.
As it currently stands, this question is not a good fit for our Q&A format. We expect answers to be supported by facts, references, or expertise, but this question will likely solicit debate, arguments, polling, or extended discussion. If you feel that this question can be improved and possibly reopened, visit the help center for guidance.
Closed 11 years ago.
I am currently working on software that must emit SNMP traps for SNMP versions 1 & 2 and possibly v3 in the future. I have downloaded several and found them to be either too complex or too simplistic. All I want is to view traps and analyze the data structures within them, and the ability to import my custom MIB's. The best I have found so far is ireasonings MIB Browser, but would be greatful for any nice alternatives.
netsnmp - should do everything you're after, with a variety of language bindings to suit every taste.
The only monitoring tools I've used that utilize SNMP monitoring are Nagios, Zenoss, OpenNMS, and the proprietary product from my company - but they're for full network monitoring.
How many devices are you looking to monitor? If it's only a couple, #Andrew's suggestion of netsnmp may be sufficient.