Hi,
We need to create a distributed file system as part of an academic project. We'll be making the system an abstraction over the GNU/Linux FS. The user needs to start up a shell that we provide, and then he is on the DFS. The DFS is spread across about 8 machines in a LAN.
Since this is an abstraction over an existing FS, implementation details a not relevant. However, we were wondering over what would be a sound policy of data distribution across the machines? If a user creates a new file, how does the system decide on which machine to actually store it? Storing on the m/c that has maximum free space seems logical, but at the same time a lame policy (or is it the best way?).
Currently we are not considering fault tolerance, i.e. each file is stored at a single place (no duplicates). However, if anyone could, please do shed some light on that as well.
Warm Regards, Nikhil.
PS: We are using PVM and pthreads for programming. _______________________________________________________________________ Odomos - the only mosquito protection outside 4 walls - Click here to know more! http://r.rediff.com/r?http://clients.rediff.com/odomos/Odomos.htm&&o...
You might want to first read about various distributed file systems like andrew, CODA, intermezzo, before you start designing your own.
NFS is also a distributed file system. You have to ask yourself what are the goals of your distributed file system? Why NFS is not sufficient? (or is it?)
Amitay.
On Mon, 2003-03-24 at 00:43, Nikhil Karkera wrote:
Hi,
We need to create a distributed file system as part of an academic project. We'll be making the system an abstraction over the GNU/Linux FS. The user needs to start up a shell that we provide, and then he is on the DFS. The DFS is spread across about 8 machines in a LAN.
Since this is an abstraction over an existing FS, implementation details a not relevant. However, we were wondering over what would be a sound policy of data distribution across the machines? If a user creates a new file, how does the system decide on which machine to actually store it? Storing on the m/c that has maximum free space seems logical, but at the same time a lame policy (or is it the best way?).
Currently we are not considering fault tolerance, i.e. each file is stored at a single place (no duplicates). However, if anyone could, please do shed some light on that as well.
Warm Regards, Nikhil.
PS: We are using PVM and pthreads for programming. _______________________________________________________________________ Odomos - the only mosquito protection outside 4 walls - Click here to know more! http://r.rediff.com/r?http://clients.rediff.com/odomos/Odomos.htm&&o...
hi,
am interested in a 1 to 2 day kind of workshop to teach all of star office - writer, calc, draw, impress, etc... there will be about 6 of us, we are all good users of ms office and have recently bought star office 6.0 from sun. we are considering such a workshop to make sure we get the best out of star office and use it to the max..... a lot of knowledge of word, excel, powerpoint can be taken for granted from us and the workshop should focus on the unique features and powers of star office.
if anyone can help, it would be great..
abhijit
Hi
We have been using OpenOffice, which is almost same as star office, for the last 2 months. There is not much to learn for a person migrating from ms office to star office. The only thing to remember in excel (calc) is that you use ";" instead of "," in the formulae. However, we would also benefit is someone is able to give a detailed tutorial on the same.
If possible, 2 people from my office would like to join any tutorial you attend on star office 6 / Open Office. On cost sharing, if you wish.
Regards Saswata
----- Original Message ----- From: "Abhijit Bhabhe" e_abhijit@vsnl.net To: linuxers@mm.ilug-bom.org.in Sent: Tuesday, March 25, 2003 12:05 AM Subject: [ILUG-BOM] star office tutorial
hi,
am interested in a 1 to 2 day kind of workshop to teach all of star
office -
writer, calc, draw, impress, etc... there will be about 6 of us, we are
all
good users of ms office and have recently bought star office 6.0 from sun. we are considering such a workshop to make sure we get the best out of
star
office and use it to the max..... a lot of knowledge of word, excel, powerpoint can be taken for granted from us and the workshop should focus
on
the unique features and powers of star office.
if anyone can help, it would be great..
abhijit
--
Hi there, interesting project! Deciding where to store the files will depend on: a) Locality of use - Ideally store it as close as possible
to user(not necessarily the creator) b) Availability of space c) Bandwidth between creator and store d) Location of Backup capabilities
Usually you wouldnt have only servers in a DFS environment -it would be a grouping of servers and storage devices -so try not be too OS dependent. Also, if you want more complexity - consider the effects of caching also...(different filesystems will have different caching mechnisms..how do you ensure consistency of a shared file? )
Have a look at a product called Centera from EMC Corp - it has an inbuilt mechanism of providing for file safety that might interest you.
regards, Kishor
--- Nikhil Karkera ianmalc@rediffmail.com wrote:
Hi,
We need to create a distributed file system as part of an academic project.
__________________________________________________ Do you Yahoo!? Yahoo! Platinum - Watch CBS' NCAA March Madness, live on your desktop! http://platinum.yahoo.com
One more thought for storing files... You can have a look at various algorithms used for RAID subsystem when disk striping is used (without parity)...and now relate them to your project using following questions 1. Are you considering to split large files and store them on different servers which participate in DFS? 2. If no, how will u convince user e.g. he will see combined 10gb space free but since largest chunk u may have is 500mb, how will u tell user that file cannot be stored?? 3. If yes (for q1), how can u increase performance while working with data? i mean here if u distribute the files accross the participants...user may get better performance.
the thing seems interesting and just might grow complex if brainstormed enough...and then it would be real fun to implement and learn along...
Kiran Ghag Software Engineer @ Patni Computers, India Work Phone: +91 (22) 2829 1454 Extension 5236 Web Page: http://kiran7.freeservers.com ---------------------------------------------------------------------------- ----
ASCII: The control code for all beginning programmers and those who would become computer literate. Etymologically, the term has come down as a contraction of the often-repeated phrase "ascii and you shall receive." -- Robb Russon
--- Nikhil Karkera ianmalc@rediffmail.com wrote:
Hi,
We need to create a distributed file system as part of an academic project.
-
Abhijit Bhabhe -
Amitay Isaacs -
Kiran Ghag -
kishor bhagwat -
Nikhil Karkera -
Saswata Banerjee & Associates