Hello There, Guest! (LoginRegister)

Post Reply 
How is Big Data actually stored
Author Message
QuestionSocratic Offline
Banned

Posts: 8,276
Joined: Jul 2013
I Root For: Buffalo
Location:
Post: #1
How is Big Data actually stored
We all know the buzz words, The Cloud and Big Data, but I was wondering how is the data physically stored? What electromechanical devices are used in the giant server farms? Is it traditional disk drives? Flash? Something else? All of the above?

What I'm really interested in knowing is what companies are manufacturing the data storage devices.
04-10-2016 11:17 AM
Find all posts by this user Quote this message in a reply
Advertisement


chargeradio Offline
Vamos Morados
*

Posts: 7,520
Joined: Mar 2007
Reputation: 128
I Root For: ALA, KY, USA
Location: Louisville, KY
Post: #2
How is Big Data actually stored
Here's an article on Google's server farm in Iowa:

http://www.datacenterknowledge.com/archi...rver-farm/

Manufacturers are the usual suspects in computing: Seagate, Western Digital, Intel, Cisco, etc.

Solid state drives have been the norm at the server/NAS level for a while.


Sent from my iPhone using Tapatalk
04-10-2016 03:32 PM
Visit this user's website Find all posts by this user Quote this message in a reply
stinkfist Offline
nuts zongo's in the house
*

Posts: 69,291
Joined: Nov 2011
Reputation: 7142
I Root For: Mustard Buzzards
Location: who knows?
Post: #3
RE: How is Big Data actually stored
I'm curious....why the concern? privacy or investment or both?
04-11-2016 05:43 AM
Find all posts by this user Quote this message in a reply
CardFan1 Offline
Red Thunderbird
*

Posts: 15,155
Joined: Oct 2011
Reputation: 647
I Root For: Louisville ACC
Location:
Post: #4
RE: How is Big Data actually stored
What happens when the Server crashes ?
04-11-2016 06:34 AM
Find all posts by this user Quote this message in a reply
nomad2u2001 Offline
Hall of Famer
*

Posts: 18,356
Joined: Nov 2006
Reputation: 450
I Root For: ECU
Location: NC
Post: #5
RE: How is Big Data actually stored
(04-11-2016 06:34 AM)CardFan1 Wrote:  What happens when the Server crashes ?

Believe me, they have it taken care of. Generators for loss of electricity, redundancy, all that jazz. Servers are frequently being backed up.
04-11-2016 07:23 AM
Find all posts by this user Quote this message in a reply
Advertisement


Dragonlair2.0 Offline
2nd String
*

Posts: 282
Joined: Mar 2016
Reputation: 11
I Root For: UAB
Location:
Post: #6
How is Big Data actually stored
(04-11-2016 06:34 AM)CardFan1 Wrote:  What happens when the Server crashes ?

I'm sure there are redundancies but if all the residencies failed like deep water we are in deep water without a boat
04-11-2016 07:24 AM
Find all posts by this user Quote this message in a reply
QuestionSocratic Offline
Banned

Posts: 8,276
Joined: Jul 2013
I Root For: Buffalo
Location:
Post: #7
RE: How is Big Data actually stored
(04-11-2016 05:43 AM)stinkfist Wrote:  I'm curious....why the concern? privacy or investment or both?

Barrons has an article recommending Seagate. The article suggests that larger drives than in your laptop will be needed and that flash is still too expensive. STX does have a 7% dividend which makes it attractive, a low PE and is well off its highs. So just trying to get a better handle on its prospects. I'm leaning towards placing a buy.

I bought EMC a few years ago because of their involvement with the Cloud and it hasn't done anything.
04-11-2016 08:07 AM
Find all posts by this user Quote this message in a reply
Bull_In_Exile Offline
Eternal Pessimist
*

Posts: 21,809
Joined: Jun 2009
Reputation: 461
I Root For: The Underdog
Location:
Post: #8
RE: How is Big Data actually stored
(04-10-2016 11:17 AM)QuestionSocratic Wrote:  We all know the buzz words, The Cloud and Big Data, but I was wondering how is the data physically stored? What electromechanical devices are used in the giant server farms? Is it traditional disk drives? Flash? Something else? All of the above?

What I'm really interested in knowing is what companies are manufacturing the data storage devices.

"Big data" is about how data is processed not necessarily on what media it's stored. I've set up systems on traditional mechanical platters and flash storage.

If you want to play with it to learn more you can go with Hadoop, that is free and a mid range linux server can give you a chance to feel it out.
04-11-2016 09:59 AM
Find all posts by this user Quote this message in a reply
stinkfist Offline
nuts zongo's in the house
*

Posts: 69,291
Joined: Nov 2011
Reputation: 7142
I Root For: Mustard Buzzards
Location: who knows?
Post: #9
RE: How is Big Data actually stored
(04-11-2016 08:07 AM)QuestionSocratic Wrote:  
(04-11-2016 05:43 AM)stinkfist Wrote:  I'm curious....why the concern? privacy or investment or both?

Barrons has an article recommending Seagate. The article suggests that larger drives than in your laptop will be needed and that flash is still too expensive. STX does have a 7% dividend which makes it attractive, a low PE and is well off its highs. So just trying to get a better handle on its prospects. I'm leaning towards placing a buy.

I bought EMC a few years ago because of their involvement with the Cloud and it hasn't done anything.

I figured that's what you were 'driving' at (pardon the pun)....I've been out of the market for some time...after the collapse at the 'turn of', coupled with where I saw things headed, I only look at tangibles and dividend returns at this point

IMO, the tech market is too risky as tech changes like this country's infrastructure erodes...tech mfg only gets cheaper as time moves forward with the slimmest of margins due to competition

topic talking points:

tech, like biotech or bitcoin or tulips, is only as good as the moment

PE is a fallacy once product has developed....law of diminishing

nasdaq ratio vs dow is historically 5:1.....look at the current ratio

that's as much as I'll divulge w/o going into deep specifics....
04-13-2016 07:22 AM
Find all posts by this user Quote this message in a reply
Advertisement


Paul M Offline
American-American
*

Posts: 21,196
Joined: May 2008
Reputation: 649
I Root For: OU
Location: Next to Boomer
Post: #10
RE: How is Big Data actually stored
(04-11-2016 07:23 AM)nomad2u2001 Wrote:  
(04-11-2016 06:34 AM)CardFan1 Wrote:  What happens when the Server crashes ?

Believe me, they have it taken care of. Generators for loss of electricity, redundancy, all that jazz. Servers are frequently being backed up.

An low atmosphere nuke?
04-13-2016 07:41 AM
Find all posts by this user Quote this message in a reply
QuestionSocratic Offline
Banned

Posts: 8,276
Joined: Jul 2013
I Root For: Buffalo
Location:
Post: #11
RE: How is Big Data actually stored
(04-13-2016 07:22 AM)stinkfist Wrote:  
(04-11-2016 08:07 AM)QuestionSocratic Wrote:  
(04-11-2016 05:43 AM)stinkfist Wrote:  I'm curious....why the concern? privacy or investment or both?

Barrons has an article recommending Seagate. The article suggests that larger drives than in your laptop will be needed and that flash is still too expensive. STX does have a 7% dividend which makes it attractive, a low PE and is well off its highs. So just trying to get a better handle on its prospects. I'm leaning towards placing a buy.

I bought EMC a few years ago because of their involvement with the Cloud and it hasn't done anything.

I figured that's what you were 'driving' at (pardon the pun)....I've been out of the market for some time...after the collapse at the 'turn of', coupled with where I saw things headed, I only look at tangibles and dividend returns at this point

IMO, the tech market is too risky as tech changes like this country's infrastructure erodes...tech mfg only gets cheaper as time moves forward with the slimmest of margins due to competition

topic talking points:

tech, like biotech or bitcoin or tulips, is only as good as the moment

PE is a fallacy once product has developed....law of diminishing

nasdaq ratio vs dow is historically 5:1.....look at the current ratio

that's as much as I'll divulge w/o going into deep specifics....

Thank you for demonstrating your accumulated investment wisdom. I needed a laugh and your arrogance provided that respite.03-lmfao
(This post was last modified: 04-13-2016 08:04 AM by QuestionSocratic.)
04-13-2016 08:02 AM
Find all posts by this user Quote this message in a reply
QuestionSocratic Offline
Banned

Posts: 8,276
Joined: Jul 2013
I Root For: Buffalo
Location:
Post: #12
RE: How is Big Data actually stored
(04-13-2016 07:41 AM)Paul M Wrote:  
(04-11-2016 07:23 AM)nomad2u2001 Wrote:  
(04-11-2016 06:34 AM)CardFan1 Wrote:  What happens when the Server crashes ?

Believe me, they have it taken care of. Generators for loss of electricity, redundancy, all that jazz. Servers are frequently being backed up.

An low atmosphere nuke?

An electromagnetic pulse (EMP) detonation would very likely wipe out virtually everything within its range. If it were to happen, I suspect that we would need to retaliate in kind which would likely lead to an all out nuclear war, so protecting data might be the least of our problems.

As an aside, during the 1980s, one of the divisions of the company I worked for, manufactured cockpit equipment for the military that was EMP protected. I suspect that today, the one thing we can assume is fully protected is our ability to engage in a nuclear conflict. Of course retaliating would be dependent upon who was in the White House at the time.
(This post was last modified: 04-13-2016 10:42 AM by QuestionSocratic.)
04-13-2016 10:41 AM
Find all posts by this user Quote this message in a reply
SuperFlyBCat Offline
Banned

Posts: 49,583
Joined: Mar 2005
I Root For: America and UC
Location: Cincinnati
Post: #13
RE: How is Big Data actually stored
(04-11-2016 07:23 AM)nomad2u2001 Wrote:  
(04-11-2016 06:34 AM)CardFan1 Wrote:  What happens when the Server crashes ?

Believe me, they have it taken care of. Generators for loss of electricity, redundancy, all that jazz. Servers are frequently being backed up.

Back up Data Centers have been common for a long time now.
Ideally you have you primary offsite, in case your HQ gets hit with
a fire, bomb, flooding etc. Also common for some companies
to lease colocation space. So in essence you outsource disaster recovery.
I don't see google doing that of course.

During 9/11 at WTC I know Morgan Stanley and the big law firm there
were well prepared for disaster recovery.
04-13-2016 11:04 AM
Find all posts by this user Quote this message in a reply
Advertisement


stinkfist Offline
nuts zongo's in the house
*

Posts: 69,291
Joined: Nov 2011
Reputation: 7142
I Root For: Mustard Buzzards
Location: who knows?
Post: #14
RE: How is Big Data actually stored
(04-13-2016 08:02 AM)QuestionSocratic Wrote:  
(04-13-2016 07:22 AM)stinkfist Wrote:  
(04-11-2016 08:07 AM)QuestionSocratic Wrote:  
(04-11-2016 05:43 AM)stinkfist Wrote:  I'm curious....why the concern? privacy or investment or both?

Barrons has an article recommending Seagate. The article suggests that larger drives than in your laptop will be needed and that flash is still too expensive. STX does have a 7% dividend which makes it attractive, a low PE and is well off its highs. So just trying to get a better handle on its prospects. I'm leaning towards placing a buy.

I bought EMC a few years ago because of their involvement with the Cloud and it hasn't done anything.

I figured that's what you were 'driving' at (pardon the pun)....I've been out of the market for some time...after the collapse at the 'turn of', coupled with where I saw things headed, I only look at tangibles and dividend returns at this point

IMO, the tech market is too risky as tech changes like this country's infrastructure erodes...tech mfg only gets cheaper as time moves forward with the slimmest of margins due to competition

topic talking points:

tech, like biotech or bitcoin or tulips, is only as good as the moment

PE is a fallacy once product has developed....law of diminishing

nasdaq ratio vs dow is historically 5:1.....look at the current ratio

that's as much as I'll divulge w/o going into deep specifics....

Thank you for demonstrating your accumulated investment wisdom. I needed a laugh and your arrogance provided that respite.03-lmfao

your dime is worth less than my arrogance as tech production becomes cheaper to manufacture....good luck with staying flat in the black.

glad I could help with a laugh....
04-13-2016 10:37 PM
Find all posts by this user Quote this message in a reply
Centdukesfan Offline
All American
*

Posts: 3,499
Joined: Apr 2013
Reputation: 82
I Root For: Dukes, bud
Location:
Post: #15
RE: How is Big Data actually stored
pretty crazy they just upped their dividend for the 5th year in a row, and still the stock is taking a nosedive on a bad earnings report, and downgrade. Might be a good time to buy after the weekend and stay afloat with the dividends.
04-14-2016 08:04 AM
Find all posts by this user Quote this message in a reply
stinkfist Offline
nuts zongo's in the house
*

Posts: 69,291
Joined: Nov 2011
Reputation: 7142
I Root For: Mustard Buzzards
Location: who knows?
Post: #16
RE: How is Big Data actually stored
(04-14-2016 08:04 AM)Centdukesfan Wrote:  pretty crazy they just upped their dividend for the 5th year in a row, and still the stock is taking a nosedive on a bad earnings report, and downgrade. Might be a good time to buy after the weekend and stay afloat with the dividends.

not really....once she reaches equilibrium, the dividend becomes the offer to the coffer....the growth potential in tech is useless....

but I'm some stupid idiot....

tech development will only yield deflation any way you chop it up....it's relative to the USD....timing is all that matters if looking for tulips.....

it's why I only snorted with ol' eco101 prof....he admitted as much too...

if one doesn't understand the crux of 'time', then one doesn't have clue.....
04-14-2016 11:12 AM
Find all posts by this user Quote this message in a reply
Kaplony Offline
Palmetto State Deplorable

Posts: 25,393
Joined: Apr 2013
I Root For: Newberry
Location: SC
Post: #17
RE: How is Big Data actually stored
(04-13-2016 11:04 AM)SuperFlyBCat Wrote:  
(04-11-2016 07:23 AM)nomad2u2001 Wrote:  
(04-11-2016 06:34 AM)CardFan1 Wrote:  What happens when the Server crashes ?

Believe me, they have it taken care of. Generators for loss of electricity, redundancy, all that jazz. Servers are frequently being backed up.

Back up Data Centers have been common for a long time now.
Ideally you have you primary offsite, in case your HQ gets hit with
a fire, bomb, flooding etc. Also common for some companies
to lease colocation space.
So in essence you outsource disaster recovery.
I don't see google doing that of course.

During 9/11 at WTC I know Morgan Stanley and the big law firm there
were well prepared for disaster recovery.

We had an off-site data storage center in our primary response area. One company was the owner and they leased space to two other smaller companies.

That place would have been a death trap for firefighters, but lucky for us we wouldn't have had to go in there because it had a Halon flood fire system and roll down fire doors. Even if somebody were to get trapped they would have died of asphyxiation before we arrived on scene because the Halon displaces oxygen, so no life hazard....only body recovery.
04-14-2016 03:41 PM
Find all posts by this user Quote this message in a reply
Advertisement


Centdukesfan Offline
All American
*

Posts: 3,499
Joined: Apr 2013
Reputation: 82
I Root For: Dukes, bud
Location:
Post: #18
RE: How is Big Data actually stored
just an update on this - i got in around 20 during the creation of this thread. STX upgraded again today, approaching 30.
07-12-2016 09:05 AM
Find all posts by this user Quote this message in a reply
Hambone10 Offline
Hooter
*

Posts: 40,342
Joined: Nov 2005
Reputation: 1293
I Root For: My Kids
Location: Right Down th Middle

New Orleans BowlDonatorsThe Parliament Awards
Post: #19
RE: How is Big Data actually stored
(04-11-2016 07:24 AM)Dragonlair2.0 Wrote:  
(04-11-2016 06:34 AM)CardFan1 Wrote:  What happens when the Server crashes ?

I'm sure there are redundancies but if all the residencies failed like deep water we are in deep water without a boat

MOST companies would use multiple backups and remote locations. So if they take out the two backups in NY, there is another in Boise and Arizona.
07-12-2016 10:30 AM
Find all posts by this user Quote this message in a reply
Post Reply 




User(s) browsing this thread: 1 Guest(s)


Copyright © 2002-2024 Collegiate Sports Nation Bulletin Board System (CSNbbs), All Rights Reserved.
CSNbbs is an independent fan site and is in no way affiliated to the NCAA or any of the schools and conferences it represents.
This site monetizes links. FTC Disclosure.
We allow third-party companies to serve ads and/or collect certain anonymous information when you visit our web site. These companies may use non-personally identifiable information (e.g., click stream information, browser type, time and date, subject of advertisements clicked or scrolled over) during your visits to this and other Web sites in order to provide advertisements about goods and services likely to be of greater interest to you. These companies typically use a cookie or third party web beacon to collect this information. To learn more about this behavioral advertising practice or to opt-out of this type of advertising, you can visit http://www.networkadvertising.org.
Powered By MyBB, © 2002-2024 MyBB Group.