In the previous episode we discussed the basics of using indexes, what they are, how to use them, along with some common problems and solutions. One of the problems you will certainly face as time passes is index fragmentation. While indexes will certainly help your database perform well, they do require care and feeding--meaning there is some administrative overhead.
In this episode, we continue our conversation with Randolph West and discuss what we can do to take care of indexes and keep them well maintained over time. There is an option to use default maintenance plans and to do fragmentation and updating statistics, but should you use them? What are the alternatives? We didn’t forget to consider strategies for deciding which indexes to keep and which can be dropped.
The shownotes for today’s episode is found atand have fun on the SQL trail.
Part of what we like to do on podcast is to present topics and discuss different ways you might use features. In this episode, we go back to basics and discuss indexes. Like most topics, we made sure to explain all the important aspects. Because this is a such broad topic, we decided to carry this over into our next episode as well. Using the phone book as an example, we chat with our guest Randolph West and explain heaps, non-clustered indexes, and clustered indexes. We also explain best practices to use them when creating new tables.
We didn’t forget to cover the problems you might run into. For example, you might not think about indexes until your data grows very large. Sure, you can attempt to resolve the problem by moving to SSD’s and increasing memory, but this will push the issue further in the future. In this episode, we will discuss considerations for indexes and why database architecture is so important.
We would like to hear your opinions. What are your strategies when using indexes? Use the hashtag #sqlpodcast and let us know!
The shownotes for today’s episode is found atand have fun on the SQL trail.
When was the last time you deployed code and then found an issue with the version of a stored procedure, a setting, or even a service pack? While we data folk don't generally have as much trouble with environment issues are our developer counterparts, it can still be a big deal. Spinning up a VM may not be such a big deal anymore; however, most of us still have to request one and wait. What if you could take care of the OS and the SQL Server and not worry about setting up another development environment? Our guest today is Andrew Pruski and he talks to us about how he is using containers to support his environments and the flexibility it provides to his and his co-workers.
While the Linux containers seem to get lots of love, one unique thing about Andrew's setup is he is running Windows containers with older versions of SQL Server. What is cool to me is there are tools out there that can help us folks running windows get up and running without having to wait on our infrastructure to upgrade to Windows server 2016. If you are using containers, I would love to hear about it. Use the hastag #sqlpodcast and let us know!
The shownotes for today’s episode is found at and have fun on the SQL trail.
Although the SSIS Catalog DB is created with management studio, it does not behave like other databases. Our conversation in this episode revolves around the catalog, SSIS packages, and some of the complexities of migrating packages. Steve and I are excited to chat with our guest Andy Leonard about his thoughts on the catalog and how this feature provides some really interesting benefits for ETL architecture.
The shownotes for today’s episode is found atand have fun on the SQL trail.
As database administrators, we will all upgrade our environments at some point; however, we don't normally have the opportunity to upgrade to the next version of SQL Server before it becomes available to everyone else. In this weeks episode of the podcast, Steve and I chat with Brian Carrig about the journey channeladvisor took to implement SQL Server 2016 in their environment, that it was like working with the SQLCAT team, and how they go about making use of some of the new features. Brian shares with us some of the struggles they were having along with how the 2016 version helped address these issues.
Brian invites everyone to upvote his connect item which you can find on the shownotes
The show notes are available at http://sqldatapartners.com/2017/01/11/conversionto2016/ and have fun on the SQL trail!
We invited Paul Turley on the show to chat with us about some of the new features in SQL Server reporting services, but were pleasantly surprised to have the conversation take a different direction. Paul talks about some of the new training available for those interested in visualizations and why this community can be hard to define--and connect with. There are so many visualization options and even within Microsoft we have many products that overlap in functionality. In addition to talking about the pick list items of new features, Paul gives some guidance and why you should choose certain products and what makes good use case scenarios for some of the new features.
With the new analytics features now available in SQL Server 2016 via SP1, I think there is going to be additional requirements for data professionals to provide better analytics features and this episode is a good starter for how to frame those conversations.
Show notes for today's episode can be found at http://sqldatapartners.com/2017/01/03/reporting-improvements/ and have fun on the SQL trail!
Availability groups provide some exciting features in mixing high availability and disaster recovery; however, from a performance consideration, there are a few drawbacks. With the advances in SQL Server 2016, our guest Jimmy May from SanDisk, set out to test the features and see if they could get some really high performance out of an availability group with two synchronous replicas. In this episode he talks with us about some of his findings and some of the pains associated with getting there.
Show notes are available at http://sqldatapartners.com/2016/12/31/availability-group-improvements/ and have fun on the SQL trail!
Storage testing and validation is something what we to add under roles and responsibilities as DBAs. Every database we ever manage is going to need one, but how often do we kick the tires? Many times we’re basically told to go verify that array or we’re doing this POC, we’re testing this new storage, but are we really only testing connectivity? In this episode of the podcast, we chat with Argenis Fernandez about how he goes about testing a SAN array and the important metrics you should consider for your storage. If you are still using SQLIO or even Diskspeed to test the IO for your SQL Server, don't miss today's episode.
The shownotes for today's episode is found at
As the year 2016 comes to a close, Steve and I share our thoughts on our accomplishments for the year and what lies in store for 2017.
At some point all data administrators will have to tune their environments and there are may ways you might go about that. In this episode, we talk with Pinal Dave about how he does performance tuning and the thought process behind the approach.
In the data space we're hearing a lot about dev ops, continuous integration and the programmers are getting a lot of love there with lots of tools to help them; however, if you're on the data side--not so much. If you're running Agile in your environment and then you're trying to do data warehousing or other data development we're not quite getting the same love. Sure, there are a couple of unit testing software offerings out there, but it's a little bit cumbersome. This episode our conversation focuses on testing automation in a business intelligence or data warehouse environment--even in an Agile system. Our guest is Lynn Winterboer and she has some interesting thoughts at the intersection of business users, data professionals and tools.
Show notes for today's episode can be found at http://sqldatapartners.com/2016/12/03/episode-72-testing-automation-for-business-intelligence/
It is easy to feel like the odd man (or gal) out in the SQL Community. We are constantly hearing about new features, products, and architectures and our companies may not always have the same enthusiasm when we describe what could be.
This is probably even more true in the Analytics space as much of the marketing has been pointed in that direction. Even PASS tried to create a conference just for Analytics. While there are some amazing new technologies out there--we might--GASP--not need them in every scenario.
Our guest today is Kevin Wilkie, a BI architect with Innovative Architects and he talks to us about some of the tools he uses and spoiler--they aren't all that fancy. He also talks with us about how he manages the tech and business users so each feels comfortable and each can get their work done.
The show notes for today's episode are at http://sqldatapartners.com/2016/11/23/BI-Tools/ and we'll see you on the SQL trail!
In the keynote of PASS summit 2016 Rohan Kumar, the program manager for SQL Server proudly displayed a database restore to a SQL Server instance installed on Linux. What makes this all even more interesting is the database was sourced from a Windows server. While it might not sound like much, the number of operating systems SQL Server runs on has now doubled. This is no small feat and our guest today Travis Wright is the program manager for the SQL Server on Linux migration. While I have to admit I was not super excited about the news when it came out last year, I am definitely more interested and think there is a huge opportunity for SQL Server administrators to get access to jobs they wouldn’t have before. I know you will enjoy this interview with Travis.
Get the Linux for the preview and other items on the show notes page http://sqldatapartners.com/2016/11/16/sql-server-on-linux/ and have fun on the SQL trail!
We have all been there–next, next, next–let’s just get this install done. While there are many ways to get SQL Server installed on a server, the real impact is in the way we administer the database and when we want to get good performance. Listener James Youkhanis asked us about our install checklist and Steve and I realized we hadn’t made one public before. In this episode of the SQL Data Partners podcast, we talk about some of the settings we are looking for when we set up a server. We don’t have time to reference every single item, but hit some highlights. Your list might differ slightly, but our list has been built from the experiences we have seen over time from various installations. We love to other opinions, so give us your thoughts!
The show notes for today's episode and the install checklist are available at http://sqldatapartners.com/2016/11/09/sql-server-install-checklist/. Have fun on the SQL trail compañeros!
For all of us working with data, we know that we work no only with SQL Server but the suite of tools around the SQL Server engine. In this episode, we share some thoughts around SSIS administration, which is the most popular ETL tool in the Microsoft stack. Just like the SQL Server engine, many times the defaults are taken and in this episode we give some thoughts around logging, package execution, and notification with our guest Ravi Kumar. With the every expanding functionality of SSIS, Steve and I found this discussion insightful as we think about supporting an SSIS environment and ways we can educate package developers.
The show notes for today's episode can be found at http://sqldatapartners.com/2016/10/15/ssis-administration/ Have fun on the SQL trail!
Compañeros! The good organizers SQLSaturday in Pittsburgh allowed me to take a slot on the schedule and opened up the podcast for a little Q&A session and I was super happy with the results. We had several SQL Server pros come and our conversation was around one central issue--testing in your development environment. We came at from a setup perspective, but also from a how to compare apples and oranges when your hardware is different. Because we had a developer ask the question, I opted to call this episode “Dear Developer”. Hear from Microsoft MVPs and SQL Server consultants such as Allen White, Kevin Feasel, Jonathan Stewart, Tim McAliley and others give their thoughts on this subject. At the very least you will have a few more ideas on where to start looking for potential options to your testing after listening to this episode.
The show notes for todays episode is found at http://sqldatapartners.com/2016/10/15/deardeveloper/
After talking with Patrick Thomas in episode 64, I was introduced to Microsoft's newest learning curriculum, the Microsoft academy, and their first offering in data science. In this episode, I talk with one of the lead course writers Graeme Malcolm about the new program. Microsoft consulted data scientists along with several companies to identify the core skills they need to be successful. A curriculum was developed to teach these functional and technical skills, combining highly rated online courses with hands-on labs, concluding in a final capstone project. This episode talks about the new program and what is next for Microsoft learning.
The show notes for today's episode is found at
This week on the SQL Trail, Steve and I chat with Jason Horner about building a good data architecture. When talking about a data warehouse architecture, or even just a data architecture, people often think about building the data warehouse and specifying the server hardware, building the ETL, things like that--they tend to lose sight of the larger picture of data architecture. Jason gives us his “four pillars of data warehouse architecture” and how each of them impacts what you are able to do from a reporting prospective.
We are super excited to have Jason on the show with us this week. You can catch the show notes at http://sqldatapartners.com/2016/10/03/data-architecture/ and we'll see you on the SQL trail.
Have you ever thought that Microsoft certifications were a waste of time? Depending on where you are on the experience scale, certifications still play a large role in hiring and career development. In Episode 64 of the SQL Data Partners Podcast I talk to Patrick Thomas the program manager for the MCT and MCP programs and the role they play at Microsoft and in what way they continue to provide value, including what’s in store for data science learners and what he thinks of the Microsoft purchase of LinkedIn.
The show notes are available at
Availability groups provide both high availability features and disaster recovery options, but they also have several areas you must be aware so you don't introduce more risk into your environment. The major advantage is availability groups allow for you to fail over more than one database at a time. In Episode 59 we talked about general data availability options and in this episode we focus on the new features of Availability Groups in 2016 and how data availability options have changed with our guest John Sterrett. John shares his experience getting a large database to a highly available situation along with some other ways to use availability groups.
Show notes for today's episode are available at
Have you heard the buzz around the Cortana Intelligence Suite? It seems like it is all the rage these days and Microsoft is coming out with lots of new features in this space. In Episode 62, Steve and I interview Melissa Coates, AKA “SQLChick”. We chat about the history of Cortana, about the tools it encompasses, and why you might implement parts of the suite in your organization.
Show notes for today's episode are found at http://sqldatapartners.com/cortana If you are using Cortana, we would love to hear about it on the show notes for today's episode.
Do you dread the idea of going to the project post-mortem? Is it because you have to spend tons of time prepping your defenses for the onslaught? This week we chat with Russ Thomas and get his take on what makes a good debrief and where he got some of his ideas. These concepts are intended to make the whole team better so if you like what you hear, pass this along to other in your group and perhaps your debriefs can help everyone.
The show notes for today's episodes are at
When Microsoft introduced the Azure Data Lake, they included a new language, U-SQL, for Big Data processing as part of the Cortana Intelligence Suite. U-SQL plays a role in the streaming analytics space–primarily in the Azure environment. We break down some of the basics of U-SQL, then we’ll discuss the use cases that might make it an effective addition to your database toolbox--especially if you know C#.
The show notes for today's episode can be found at http:\\sqldatapartners.com\usql Have fun on the SQL trail, compañeros!
Have you ever wondered what the best option is for making your data available in your environment? Listener Chris Hendon asked us to talk about differences between Availability groups, mirroring, log shipping, and replication. Today on the SQL Trail Steve and I chat with Andy Mallon and Mariano Kovo about these topics. We cover each topic in detail and explain the positives and negatives of each one. Join us, for another great episode.
The show notes for today's episode are available at
With all the changes in technology, how do you stay up to date with your technical learning? This is a question we have been asking our guests the last several episodes and in this episode we, the hosts, attempt to answer this question and Carlos and Steve give some thoughts on how we stay up to date. We discuss four ways to keep up. If all else fails, you can follow this old adage. "It's know WHAT you know, it's not WHO you know--it's WHAT you know about WHO you know."
The show notes for today's episode can be found at http://sqldatapartners.com/learning.