The Source for Java Technology Collaboration

Home » java.net Forums » JDK » Java SE

Thread: Java Cluster, whats the best way?

Welcome, Guest Help
Login Login
Guest Settings Guest Settings
This question is not answered. Helpful answers available: 2. Correct answers available: 1.

Reply to this Thread Reply to this Thread Search Forum Search Forum Back to Thread List Back to Thread List

Permlink Replies: 4 - Last Post: May 1, 2007 11:24 AM by: sprhodes
ryujin

Posts: 2
Java Cluster, whats the best way?
Posted: Apr 29, 2007 7:32 AM
 
  Click to reply to this thread Reply

I am in the process of setting up a cluster of Linux computers at Southern Utah University and wanted Java support, what are some of the currently used ways to invoke a Java cluster for Java programs. I was hoping to set it up to use the now native java concurrency rather than javampi.
What is the best way to do it?

dma02

Posts: 28
Re: Java Cluster, whats the best way?
Posted: Apr 30, 2007 3:05 AM   in response to: ryujin
 
  Click to reply to this thread Reply

This link may help, http://www.javaworld.com/jw-02-2001/jw-0223-extremescale.html?page=1

timeck

Posts: 6
Re: Java Cluster, whats the best way?
Posted: Apr 30, 2007 11:34 AM   in response to: ryujin
 
  Click to reply to this thread Reply

Terracotta (open source -- http://www.terracotta.org/) can help you write clustered java applications. With terracotta, you can share object state and do thread coordination/signaling within a cluster of VMs. Feel free to jump over to our forums or mailing lists for more information.

disclosure: I am a Terracotta employee

rickcarson

Posts: 85
Re: Java Cluster, whats the best way?
Posted: Apr 30, 2007 4:35 PM   in response to: ryujin
 
  Click to reply to this thread Reply

Jini is a really good way to do a clustered supercomputer.

What you do is on each of the computers you put a Jini client. Then you expose a Jini service. What happens is that the client goes to the service and asks for work. The service gives it some work to do. The client does the work. The client goes back to the service to ask for more work.

Jini is nice in this case because it has the concept of expiry. Eg if one of the clients bursts into flame its lease will expire, and the service can figure out that if the lease expires whatever piece of work it last handed to that client needs to be handed to a different client.

Moreover, real users can be using the computers for other stuff, and you can run the Jini clients highly niced and in the background, just using the spare cpu cycles without stealing from the users.

There is almost certainly some optimisation around the size of the chunks of work vs network traffic, that is, fewer larger chunks of work may be much more efficient than a great number of tiny calculations, where the work of wrapping the request/result in a network message exceeds the difficulty of just doing the calculation yourself.

sprhodes

Posts: 5
Re: Java Cluster, whats the best way?
Posted: May 1, 2007 11:24 AM   in response to: ryujin
 
  Click to reply to this thread Reply

If you're *really* bored and have some programmers with spare cycles, grab the Lionra Threads stuff from http://lionra.dev.java.net and hack away. It works, more or less, but is a long way from being ready for any serious use.

More pragmatically, Terracotta is probably the best answer. :-)

(Disclaimer: Lionra Threads is my project, and no I'm not seriously advocating it as an option. But if anybody does want to chip in and contribute to the project, give me a buzz).




 XML java.net RSS