Interesting news from the Hadoop summit
Headlines:
- Microsoft gives SQL Server tech to Hadoop: http://www.infoworld.com/t/hadoop/microsoft-gives-sql-server-tech-hadoop-and-helps-itself-243764
- Microsoft releases HDInsight for Hadoop 2.4 And Gains 100x Performance Increase: http://blogs.technet.com/b/dataplatforminsider/archive/2014/06/04/microsoft-releases-hdinsight-for-hadoop-2.4-and-gains-100x-performance-increase.aspx
- PolyBase in APS - Yet another SQL over Hadoop solution: http://blogs.technet.com/b/dataplatforminsider/archive/2014/06/02/polybase-in-aps-yet-another-sql-over-hadoop-solution.aspx
Someone’s been busy with the big data OSS :)
HDFS Explorer - nice tool for MS Windows and Hadoop
Looks like someone at RedGate read my mind: Manipulating HDFS storage on an interface like Windows explorer. Check out the demo video below:
You can get the software here:
http://bigdata.red-gate.com/hdfs-explorer.html
eBook - HDInsight: Microsoft’s Cloud Hadoop
I’ve published a small ebook meant to help IT professionals, with background experience on Apache Hadoop, transition to its Microsoft cloud implementation. The assumption will be that the client will be running Windows along with PowerShell.
This is not a book to learn Hadoop, its purpose is to accelerate the adoption by Hadoop developers coming from in-house clusters or cloud providers such as Amazon Web Services.
You can check it out at Amazon Kindle Store.
Here’s a look at the table of contents:
1 CONTENTS
2 Introduction
3 Do you have what it takes?
3.1 Create a Microsoft Account
3.2 Register for Microsoft Azure
3.3 Download and Install the Azure SDK
3.4 Configure the Azure SDK to your Online Account
4 Setting Things Up for HDInsight
4.1 Creating a Storage Account
4.2 Create a Container using Microsoft Azure Powershell
4.3 Uploading Input Files to Azure Blob Storage
4.3.1 Using Powershell
4.3.2 Using Free GUI Tools
4.4 Provisioning an HDInsight Cluster with Quick Create
4.5 Provisioning an HDInsight Cluster with Powershell
5 Meeting Old Friends in New Places
5.1 Running Map Reduce Jobs Programatically
5.2 Retrieving Job Output
5.3 Using Hive with HDInsight
6 General HDInsight Powershell Guidance
6.1 Basic building blocks
6.2 Scripts used to perform the tasks on this book
6.2.1 Create Storage Container
6.2.2 Upload File
6.2.3 Download File
6.2.4 Delete File
6.2.5 Hadoop Submit Job
6.2.6 Hive Create Table
6.2.7 Hive Load Data
6.2.8 Hive Perform Query
Happy reading!
Hadoop default configuration directory
To anyone reading this:
I inform that the conf directory that comes with Hadoop is no longer the default configuration directory. Rather, Hadoop looks in “etc/hadoop" for configuration files.
Hadoop default configuration directory
To anyone reading this:
I inform that the conf directory that comes with Hadoop is no longer the default configuration directory. Rather, Hadoop looks in “etc/hadoop" for configuration files.