How to setup a 1 Petabyte (1000TB) server at home
#1


I, being poor, have only my dreams; I have spread my dreams under your feet; Tread softly because you tread on my dreams.
Reply
#2

I am aiming for 50T but raid-2...my machine learning data is expanding fast.

Any experts out there on storage appreciate if you can give advice.

I will be ordering all the parts next week.

I, being poor, have only my dreams; I have spread my dreams under your feet; Tread softly because you tread on my dreams.
Reply
#3

(04-02-2022, 11:16 AM)sgbuffett Wrote:  I am aiming for 50T but raid-2...my machine learning data is expanding fast.

there is no point to keep big data if it is for self learning.
most of the time, after you have learnt, you have no practical use of the data.
even your machine learning knowledge is very specialised and has no practical use unless your work/job requires it.
it is learning for learning sake or hobby sake. 

are you keeping the data for commercial use ?
Reply
#4

Last time I read this new before, a kid or teen set up mega data base system lots of HDD etc to sell " hosting services "
till he open business as Host provider.

But this is not simple, need a lot maintenance etc, also prevent get hack, or else your client subscribe your hosting services will be piss off etc , down times, get hack etc stuffs.
Reply
#5

(04-02-2022, 12:28 PM)forum456 Wrote:  there is no point to keep big data if it is for self learning.
most of the time, after you have learnt, you have no practical use of the data.
even your machine learning knowledge is very specialised and has no practical use unless your work/job requires it.
it is learning for learning sake or hobby sake. 

are you keeping the data for commercial use ?

I am doing it because I attended online course abs became interested...its not for job or anything.

The data can be use later when I change model or add more data to the set and need to retrain.

I, being poor, have only my dreams; I have spread my dreams under your feet; Tread softly because you tread on my dreams.
Reply
#6

(04-02-2022, 12:33 PM)sgbuffett Wrote:  I am doing it because I attended online course abs became interested...its not for job or anything.

The data can be use later when I change model or add more data to the set and need to retrain.

You can host sammyboy forum Big Grin

Wherever you go, no matter what the weather, always bring your own sunshine Big Grin
Reply
#7

With that number of HDD, you'd better make sure your cooling is good. And your electricity bill will explode.
Reply
#8

(04-02-2022, 12:33 PM)sgbuffett Wrote:  I am doing it because I attended online course abs became interested...its not for job or anything.

The data can be use later when I change model or add more data to the set and need to retrain.

when you change model or retrain, there is little to learn.
It is a repetitive process.
It is not worth to keep the big data.

even if your model has become better, it has no practical use since it does not add value to your job or your life.
Reply
#9

I understand this is just an experiment. The video is made only to attract viewers, but why would an ordinary person install a 1000TB server at home? Moreover, you probably need to spend a lot of money and time on this. And in general, I have never liked anything related to the network. If networkers are required for my business, then I usually hire specialists from networklondon.co.uk. Otherwise, I have no other options. But thank you so much for sharing this video. Just for fun, I'll watch this video. Why not.
Reply
#10

(04-02-2022, 11:16 AM)sgbuffett Wrote:  I am aiming for 50T but raid-2...my machine learning data is expanding fast.

Any experts out there on storage appreciate if you can give advice.

I will be ordering all the parts next week.


wah.................50TB ah....................my entire porn collection since year 2000....................only less than 200GB..................i very selective one..............
Reply
#11

Is ah butt still doing his AI or no more already?
Reply
#12

Setting up a 1 Petabyte server at home is no small feat! It's impressive to see your ambition and dedication to such a massive project.
If you're aiming for military-grade computing capabilities, this military computer manufacturer offers specialized solutions tailored for federal and military applications. With their expertise in providing reliable and secure systems, they could be an invaluable resource for your project. You can explore their range of offerings and find solutions that meet your specific needs by visiting their website.
Reply
#13

Wah hard working ahbutt the ultimate amdk arse lickers stooge’s collecting data for his daddies liao lah LMAO 😬🤣😂👍
Reply
#14

Another kokkup idea with 1 petabyte of garbage?
Reply
#15

Heng ar


i used EMC Isilon 20PB system


Heng ar
Reply


Forum Jump:


Users browsing this thread: 1 Guest(s)