Next Meeting: Wed, Dec 16 2015
Bringing Polybase to SQL Server 2016
David DeWitt, Director Microsoft
Presented by Dr. David DeWitt & Dr. Rimma Nehme
Today, many organizations have data sets in both a relational DBMS and Hadoop. While systems like Hive, Impala (Cloudera), and Stinger (Hortonworks) can be used to query Hadoop-resident data, they are not capable of answering queries that combine data from the two universes of structured (relational) and semi-structured data stored in Hadoop. In this talk we will describe Polybase, a capability that we introduced as part of the SQL Server PDW V2 release and which is available now with the CTP3 release of SQL16.
With Polybase, users can create external tables for data sets stored in HDFS. Currently the software supports the Hadoop-standard text, RC, ORC, and Parquet file formats. Polybase supports both Linux and Windows Hadoop clusters and both the Hortonworks and Cloudera distributions.
Once an external table has been defined, users can execute standard SQL queries over external tables stored in HDFS without any knowledge of the Hadoop ecosystem (MapReduce programming is definitely not required). Furthermore, queries can span arbitrary combinations of relational tables stored in SQL Server and external tables stored in HDFS. All of this is totally transparent, allowing existing BI tools and applications to operate on HDFS-resident data without modification.
In addition to supporting a single SQL Server instance querying HDFS-resident data, with SQL16, users will be able to easily deploy clusters of SQL Server instances that will operate together as a parallel database system when executing queries over HDFS-resident data.
Prior to joining Microsoft as a Technical Fellow in March 2008, David DeWitt was a professor at the University of Wisconsin-Madison. He served as chair of the Computer Sciences Department at Wisconsin from July 1999 to July 2004. Professor DeWitt is a member of the National Academy of Engineering (1998), a fellow of the American Academy of Arts and Sciences (2007), and an ACM Fellow (1995). In 2008 he received the prestigious ACM Software Systems award for his pioneering work on parallel relational database systems. Professor DeWitt has authored over 120 technical publications.
5:30 PM - 5:45 PM: General Announcements
5:45 PM - 6:15 PM: Dinner & Networking
6:15 PM - 7:45 PM: Main Presentation
7:45 PM - 8:00 PM: Wrap-up
Event Time : Wed, Dec 16 2015 17:30 - 20:00 (UTC-06:00) Central Time (US & Canada)
Add the meeting to your calendar: iCal
5250 East Terrace Drive Madison, Wisconsin
http://Check website on meeting date
If you are having trouble joining the meeting, try adding ?sl=1 to the URL to use the Lync web client.
Need Lync? (64-bit) (32-bit)Other Downloads