CSNbbs

Full Version: How is Big Data actually stored
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
We all know the buzz words, The Cloud and Big Data, but I was wondering how is the data physically stored? What electromechanical devices are used in the giant server farms? Is it traditional disk drives? Flash? Something else? All of the above?

What I'm really interested in knowing is what companies are manufacturing the data storage devices.
Here's an article on Google's server farm in Iowa:

http://www.datacenterknowledge.com/archi...rver-farm/

Manufacturers are the usual suspects in computing: Seagate, Western Digital, Intel, Cisco, etc.

Solid state drives have been the norm at the server/NAS level for a while.


Sent from my iPhone using Tapatalk
I'm curious....why the concern? privacy or investment or both?
What happens when the Server crashes ?
(04-11-2016 06:34 AM)CardFan1 Wrote: [ -> ]What happens when the Server crashes ?

Believe me, they have it taken care of. Generators for loss of electricity, redundancy, all that jazz. Servers are frequently being backed up.
(04-11-2016 06:34 AM)CardFan1 Wrote: [ -> ]What happens when the Server crashes ?

I'm sure there are redundancies but if all the residencies failed like deep water we are in deep water without a boat
(04-11-2016 05:43 AM)stinkfist Wrote: [ -> ]I'm curious....why the concern? privacy or investment or both?

Barrons has an article recommending Seagate. The article suggests that larger drives than in your laptop will be needed and that flash is still too expensive. STX does have a 7% dividend which makes it attractive, a low PE and is well off its highs. So just trying to get a better handle on its prospects. I'm leaning towards placing a buy.

I bought EMC a few years ago because of their involvement with the Cloud and it hasn't done anything.
(04-10-2016 11:17 AM)QuestionSocratic Wrote: [ -> ]We all know the buzz words, The Cloud and Big Data, but I was wondering how is the data physically stored? What electromechanical devices are used in the giant server farms? Is it traditional disk drives? Flash? Something else? All of the above?

What I'm really interested in knowing is what companies are manufacturing the data storage devices.

"Big data" is about how data is processed not necessarily on what media it's stored. I've set up systems on traditional mechanical platters and flash storage.

If you want to play with it to learn more you can go with Hadoop, that is free and a mid range linux server can give you a chance to feel it out.
(04-11-2016 08:07 AM)QuestionSocratic Wrote: [ -> ]
(04-11-2016 05:43 AM)stinkfist Wrote: [ -> ]I'm curious....why the concern? privacy or investment or both?

Barrons has an article recommending Seagate. The article suggests that larger drives than in your laptop will be needed and that flash is still too expensive. STX does have a 7% dividend which makes it attractive, a low PE and is well off its highs. So just trying to get a better handle on its prospects. I'm leaning towards placing a buy.

I bought EMC a few years ago because of their involvement with the Cloud and it hasn't done anything.

I figured that's what you were 'driving' at (pardon the pun)....I've been out of the market for some time...after the collapse at the 'turn of', coupled with where I saw things headed, I only look at tangibles and dividend returns at this point

IMO, the tech market is too risky as tech changes like this country's infrastructure erodes...tech mfg only gets cheaper as time moves forward with the slimmest of margins due to competition

topic talking points:

tech, like biotech or bitcoin or tulips, is only as good as the moment

PE is a fallacy once product has developed....law of diminishing

nasdaq ratio vs dow is historically 5:1.....look at the current ratio

that's as much as I'll divulge w/o going into deep specifics....
(04-11-2016 07:23 AM)nomad2u2001 Wrote: [ -> ]
(04-11-2016 06:34 AM)CardFan1 Wrote: [ -> ]What happens when the Server crashes ?

Believe me, they have it taken care of. Generators for loss of electricity, redundancy, all that jazz. Servers are frequently being backed up.

An low atmosphere nuke?
(04-13-2016 07:22 AM)stinkfist Wrote: [ -> ]
(04-11-2016 08:07 AM)QuestionSocratic Wrote: [ -> ]
(04-11-2016 05:43 AM)stinkfist Wrote: [ -> ]I'm curious....why the concern? privacy or investment or both?

Barrons has an article recommending Seagate. The article suggests that larger drives than in your laptop will be needed and that flash is still too expensive. STX does have a 7% dividend which makes it attractive, a low PE and is well off its highs. So just trying to get a better handle on its prospects. I'm leaning towards placing a buy.

I bought EMC a few years ago because of their involvement with the Cloud and it hasn't done anything.

I figured that's what you were 'driving' at (pardon the pun)....I've been out of the market for some time...after the collapse at the 'turn of', coupled with where I saw things headed, I only look at tangibles and dividend returns at this point

IMO, the tech market is too risky as tech changes like this country's infrastructure erodes...tech mfg only gets cheaper as time moves forward with the slimmest of margins due to competition

topic talking points:

tech, like biotech or bitcoin or tulips, is only as good as the moment

PE is a fallacy once product has developed....law of diminishing

nasdaq ratio vs dow is historically 5:1.....look at the current ratio

that's as much as I'll divulge w/o going into deep specifics....

Thank you for demonstrating your accumulated investment wisdom. I needed a laugh and your arrogance provided that respite.03-lmfao
(04-13-2016 07:41 AM)Paul M Wrote: [ -> ]
(04-11-2016 07:23 AM)nomad2u2001 Wrote: [ -> ]
(04-11-2016 06:34 AM)CardFan1 Wrote: [ -> ]What happens when the Server crashes ?

Believe me, they have it taken care of. Generators for loss of electricity, redundancy, all that jazz. Servers are frequently being backed up.

An low atmosphere nuke?

An electromagnetic pulse (EMP) detonation would very likely wipe out virtually everything within its range. If it were to happen, I suspect that we would need to retaliate in kind which would likely lead to an all out nuclear war, so protecting data might be the least of our problems.

As an aside, during the 1980s, one of the divisions of the company I worked for, manufactured cockpit equipment for the military that was EMP protected. I suspect that today, the one thing we can assume is fully protected is our ability to engage in a nuclear conflict. Of course retaliating would be dependent upon who was in the White House at the time.
(04-11-2016 07:23 AM)nomad2u2001 Wrote: [ -> ]
(04-11-2016 06:34 AM)CardFan1 Wrote: [ -> ]What happens when the Server crashes ?

Believe me, they have it taken care of. Generators for loss of electricity, redundancy, all that jazz. Servers are frequently being backed up.

Back up Data Centers have been common for a long time now.
Ideally you have you primary offsite, in case your HQ gets hit with
a fire, bomb, flooding etc. Also common for some companies
to lease colocation space. So in essence you outsource disaster recovery.
I don't see google doing that of course.

During 9/11 at WTC I know Morgan Stanley and the big law firm there
were well prepared for disaster recovery.
(04-13-2016 08:02 AM)QuestionSocratic Wrote: [ -> ]
(04-13-2016 07:22 AM)stinkfist Wrote: [ -> ]
(04-11-2016 08:07 AM)QuestionSocratic Wrote: [ -> ]
(04-11-2016 05:43 AM)stinkfist Wrote: [ -> ]I'm curious....why the concern? privacy or investment or both?

Barrons has an article recommending Seagate. The article suggests that larger drives than in your laptop will be needed and that flash is still too expensive. STX does have a 7% dividend which makes it attractive, a low PE and is well off its highs. So just trying to get a better handle on its prospects. I'm leaning towards placing a buy.

I bought EMC a few years ago because of their involvement with the Cloud and it hasn't done anything.

I figured that's what you were 'driving' at (pardon the pun)....I've been out of the market for some time...after the collapse at the 'turn of', coupled with where I saw things headed, I only look at tangibles and dividend returns at this point

IMO, the tech market is too risky as tech changes like this country's infrastructure erodes...tech mfg only gets cheaper as time moves forward with the slimmest of margins due to competition

topic talking points:

tech, like biotech or bitcoin or tulips, is only as good as the moment

PE is a fallacy once product has developed....law of diminishing

nasdaq ratio vs dow is historically 5:1.....look at the current ratio

that's as much as I'll divulge w/o going into deep specifics....

Thank you for demonstrating your accumulated investment wisdom. I needed a laugh and your arrogance provided that respite.03-lmfao

your dime is worth less than my arrogance as tech production becomes cheaper to manufacture....good luck with staying flat in the black.

glad I could help with a laugh....
pretty crazy they just upped their dividend for the 5th year in a row, and still the stock is taking a nosedive on a bad earnings report, and downgrade. Might be a good time to buy after the weekend and stay afloat with the dividends.
(04-14-2016 08:04 AM)Centdukesfan Wrote: [ -> ]pretty crazy they just upped their dividend for the 5th year in a row, and still the stock is taking a nosedive on a bad earnings report, and downgrade. Might be a good time to buy after the weekend and stay afloat with the dividends.

not really....once she reaches equilibrium, the dividend becomes the offer to the coffer....the growth potential in tech is useless....

but I'm some stupid idiot....

tech development will only yield deflation any way you chop it up....it's relative to the USD....timing is all that matters if looking for tulips.....

it's why I only snorted with ol' eco101 prof....he admitted as much too...

if one doesn't understand the crux of 'time', then one doesn't have clue.....
(04-13-2016 11:04 AM)SuperFlyBCat Wrote: [ -> ]
(04-11-2016 07:23 AM)nomad2u2001 Wrote: [ -> ]
(04-11-2016 06:34 AM)CardFan1 Wrote: [ -> ]What happens when the Server crashes ?

Believe me, they have it taken care of. Generators for loss of electricity, redundancy, all that jazz. Servers are frequently being backed up.

Back up Data Centers have been common for a long time now.
Ideally you have you primary offsite, in case your HQ gets hit with
a fire, bomb, flooding etc. Also common for some companies
to lease colocation space.
So in essence you outsource disaster recovery.
I don't see google doing that of course.

During 9/11 at WTC I know Morgan Stanley and the big law firm there
were well prepared for disaster recovery.

We had an off-site data storage center in our primary response area. One company was the owner and they leased space to two other smaller companies.

That place would have been a death trap for firefighters, but lucky for us we wouldn't have had to go in there because it had a Halon flood fire system and roll down fire doors. Even if somebody were to get trapped they would have died of asphyxiation before we arrived on scene because the Halon displaces oxygen, so no life hazard....only body recovery.
just an update on this - i got in around 20 during the creation of this thread. STX upgraded again today, approaching 30.
(04-11-2016 07:24 AM)Dragonlair2.0 Wrote: [ -> ]
(04-11-2016 06:34 AM)CardFan1 Wrote: [ -> ]What happens when the Server crashes ?

I'm sure there are redundancies but if all the residencies failed like deep water we are in deep water without a boat

MOST companies would use multiple backups and remote locations. So if they take out the two backups in NY, there is another in Boise and Arizona.
Reference URL's