In a Q&A, EMA analyst John Myers advises IT teams to look at big data analytics workloads when sorting through new and different types of databases and open source tools. Spark assertions are still young.
As data management and business intelligence alternative increases, formulating all necessary plans isn’t getting simpler for IT groups. Measuring the prompt and long haul effect of those choices is John Myers’ activity. As overseeing research chief for BI and data warehousing at Enterprise Management Associates Inc., Myers keeps close tabs on hybrid cloud technologies, Spark and the different types of databases now available.
In an interview with SearchDataManagement, he said a key pattern nowadays observes clients moving to an engineering that enables diverse stages to work to take care of the data mining issues for which they’re most appropriate.
Isn’t The Variety In Workloads And Workload Mechanisms Popping Up Today Astounding?
John Myers: What we are truly seeing is the emergence of a hybrid cloud data ecosystem. We don’t subscribe to the idea that a single data management platform can meet all the processing and data management needs you may have. Individuals are looking at Hadoop and NoSQL entries such as Mongo and Cassandra.
We Might Throw Data analytics Engines Like Apache Spark Or Different Types Of Databases In There, too.
Myers: Well, I would say Spark is much more of a data mining engine than a data management platform.
Esentially, when I think of a data management system, it has to meet the ACID [criteria], and part of that is durability. Spark is a nice data mining engine. But it still needs to have that durability component to go along with that. Spark has to live somewhere. It has to leave its material somewhere.
It’s growing and getting better at what it does, and I don’t know [if] you could ever ramp up MapReduce and Yarn to get to where Spark is going to be. It’s a great platform to start going toward, but it’s only two or three years old. In that sense, it has a lot of work to do to learn a lot of things other engines have done for quite some time.
It has a lot of opportunities, but it is also very young in its maturity. For certain use cases, Spark works really well. But for some others, when you get it up and going, Spark will actually run slower than some other processing engines. It is especially dependent on the types of questions you are asking it. That’s true for any platform it all depends on what you ask it.
Backdating to social databases and things of that nature, on the off chance that you need to ask [a social database administration system] to include, subtract, numerous or partition, it’ll do that throughout the day. That is what it’s been prepared to improve the situation 40 years.
On the other hand, if you ask a relational database to do a graph data analysis, something like what a graph database like Neo4j or an Objectivity [InfiniteGraph] can do, it’s difficult. You need to request that the social database do an extremely recursive join, which is something that it doesn’t care to do in light of the fact that, to be perfectly honest, it wasn’t intended.
Whereas, with the graph database, if you ask it to do a graph analysis, if you say, ‘Tell me who is the friend of a friend of a friend,’ it’ll say, ‘Here you go, here’s a list, have a nice day.’ But if you ask a graph database to add, subtract multiply and divide, it gets a little upset.
You find people wondering which of these platforms they should pick. But what I would emphasize is that there is more than enough room for multiple platforms.
How Do You See The Business Intelligence Side Reacting To The New State Of Big Data Analytics?
Myers: Business stakeholders are intrigued with what can happen with big data analytics. Our research over the course of the last five years shows that big data projects are quite often lined up with raising incomes, restricting expenses or enhancing edges.
We find up-sell opportunities [are] a significant chunk of projects. Another one is risk mitigation, either in the form of risk data analysis or fraud detection management. The business stakeholders are getting the value and are driving those projects.
The truth of the matter is, IT individuals can stack up Hadoop with data, however then they need to request that what they do with it next. At the same time, business people don’t necessarily say, ‘Give me the customer data that sits in Hadoop versus the customer data that sits in our enterprise data warehouse or in our operational system.’ Instead, they say, ‘Give me the customer data.’
Along these lines, it’s the job of the IT teams to take event-level or behavior data, such as clickstream data from an online or mobile application that is probably stored in a Hadoop platform, and take curated data from a data warehouse and correlate those two so you can really get value.
Is it fair to say that where big data and these different types of databases are moving us is to a place where we can put the clickstream data together with curated data so we can get such things as better margins, good cross-selling, better risk mitigation and so on?
Myers: Yup, exactly. But business people don’t say, ‘Let’s use big data analytics.’ Instead, they go, ‘Let’s expand the scope of the information we can look at for our customers.’
No comments:
Post a Comment