Alper Sarikaya is a Research and Development Engineer at Microsoft working on Power BI and its visualization features. His experience has focused on enabling people to create summary visualizations for the purposes of effectively communicating trends, patterns, and distributions in large amounts of data. Prior to joining Microsoft, Alper earned his PhD in Computer Sciences from the University of Wisconsin-Madison with a concentration in data visualization. His research is publicly available on his website: https://alper.datav.is/.
Episode Notes
Power BI is really a customer-driven product. If you have any ideas for bettering the product, we heartily encourage you to submit your ideas on http://ideas.powerbi.com/. We take a look at this list regularly and use it to prioritize our feature and backlog work. If you’re interested in using Power BI (which is free to start!), you can find a local user group by starting here: https://www.pbiusergroup.com/.
Alper is always interested in collecting use cases from businesses, organizations, research labs, and other missions! Please don’t hesitate to reach out–we is happy to talk with you and your teams about how visualization can democratize access to data that would otherwise be untenable.
Support the Show
This show is completely listener-supported. There are no ads on the show notes page or in the audio. If you would like to financially support the show, please check out my Patreon page, where just for a few bucks a month, you can get a sneak peek at guests, grab stickers, or even a podcast mug. Your support helps me cover audio editing services, transcription services, and more. You can also support the show by sharing it with others and reviewing it on iTunes or your favorite podcast provider.
Transcript
Welcome back to the PolicyViz Podcast. I’m your host Jon Schwabish, and on this week’s episode we are going to turn to issues around accessibility. We’ve already had a few discussions on the show about accessibility when it comes to data visualization, but on this week’s episode I’m really excited to have Alper Sarikaya on the show from the Microsoft Power BI team. I met Alper back in Vancouver last fall at the IEEE Conference and we got to talking about all the types of different accessibility considerations, Alper and his team have been working on when it comes to using the interactive dashboarding tool in Power BI. So I invited him on the show to talk more about his background, more about his work, and the various types of ways that they think and try to implement accessibility considerations in the Microsoft tool. So I hope you’ll enjoy that discussion.
Before we get to that, just a couple of quick announcements. First, if you haven’t heard, I’ve been hosting nearly daily short video chats with folks in the data visualization and presentation fields. I talk to them for about 10-15 minutes and then open it up for questions from you and other audience members. So it’s a pretty casual discussion, it’s an opportunity to talk and converse about issues that listeners of this podcast are probably all interested in. So if you are interested in talking with folks and understanding more about their work and just sort of connecting with other people [inaudible 00:01:38] field, come join us, I will link to the registration page on the show notes for this podcast. So the last announcement is to, if you can, please support the show, please let others know about it, please rate and review it on your favorite podcast provider, iTunes, Stitcher, Spotify, wherever you listen to your podcast. And if you would like to support the show financially, please head over to my Patreon page where you can get a little bit of swag and help defray some of the costs of transcription, web fees, recording services, all the stuff that I need to make this show each and every other week to bring to you. So I hope you’ll enjoy this week’s discussion with Alper, and I hope you’ll be able to use the outcome of our discussion in your own work when it comes to considering the accessibility needs of others. So here is our conversation.
Jon Schwabish: Hey Alper, how are you friend?
Alper Sarikaya: I’m doing fantastic. How are you doing?
JS: I’m doing well, I’m doing well, hanging in there. Thanks for coming on the show.
AS: Happy to be here.
JS: Yeah, we’ve chatted about this in the past but I wanted to kind of share the conversation with others, this issue of accessibility is really important. We chat I think at IEEE last fall, and I was impressed by the work you guys are doing there, so I wanted to chat and give you a chance to tell us about the work that you’re doing and how you approach it and all that. So maybe we could just start – you can tell people a little bit about yourself and your background and what it is you do on the Power BI team over there at Microsoft.
AS: Sure, yeah. My name is Alper Sarikaya. I work on the Power BI creators team. So we’re basically responsible for the creator and consumer experience for reports built in Power BI, and the cool thing is that my role is a research and development engineer, I’m more or less the development owner of visuals, so how visuals talk to data backends, how they could be customized by users, how that can be modified or themed by the consumer or by the report author; and I came to Microsoft just about three years ago after earning a PhD in Computer Sciences from the University of Wisconsin-Madison.
JS: And that’s why we’re already such good friends, because of that.
AS: Yes, pretty sure. So I love going to the Research Viz conferences, even though it’s academically focused, like that’s how I can kind of maintain my connection to the data visualization research community. And so my concentration is more or less like summary visualizations and methods to summarize data to emphasize the trends, the distributions, and anomalies, because I think visualization is a fantastic kind of data democratization tool, and if you can highlight the trends, the distributions of anomalies in the data, that can enable people to get more out of data; even people that do not have the sequel or data munging skills, they can look at a visualization [inaudible 00:04:58] what’s that, and they can start querying the data themselves visually.
JS: Right. Most people I would think have Microsoft already, you know, they’re already familiar with it, they’re already working with it, so they have this sort of natural pipeline to be doing the sort of stuff that you can do in Power BI.
AS: Yeah, for sure. And so like in Power BI, just like almost any other data munging tools such as Tableau or Qlik or anything like that, they have a bunch of connectors. So you can connect it to wherever your data is stored. So, for example, if you have your data in the Microsoft ecosystems, already, of course, we make it super easy, even if you have lists in SharePoint. So SharePoint and Access are examples of Microsoft tools that you don’t have to be an expert to use, and it’s pretty easy to just throw your data in there. So if you’re like a small business and you’re just trying to collect, oh I know these things about these customers, I can just throw my data and then Access or SharePoint list and Power BI can just happily connect to it. And the wonderful thing about Power BI is we have this power query tool that’s built in, so that’ll actually do data joins for you. So you can take some data from a SharePoint list over here and then some data from your transaction database over here, and even data from a CSV over here, and just kind of bring it all together, hook it all up, and then you can start to see relationships between different sources of data. But the idea is that you have, like they always say, a single source of the truth or a dashboard which I may or may not agree with, but bringing all these components together so that you can see the [inaudible 00:06:32] between them is really, really interesting, especially that it’s more or less a drag-and-drop tool, you don’t have to do any programming, and I think that’s absolutely wonderful.
JS: Right. So can we talk about the work that you and your team have been doing on the side of accessibility and how you’ve tried to make the tool accessible for people with vision impairments or cognitive difficulties – I’m just curious about what the tool can do and also how you think about these various types of accessibility issues, because there’s a lot, and I think a lot of us who are trying to think about accessibility, probably don’t even know all the issues that we should be considering.
AS: Right, yeah. And that’s kind of the wonderful thing about being in a large corporation is that we have teams of people that are trying to ensure that we all follow inclusive design, because if we are all trying to do it kind of ad hoc and just saying, oh what about this, what about that, that’s kind of reactive. But I think Microsoft is taking quite a proactive stance on this, and so they call this inclusive design, and I think it’s absolutely wonderful. It’s really the effort to break down the traditional barriers in technology products that prohibit easy access to use our tooling, and so this would include more or less supporting people of all types of vision, hearing, neurodiversity, learning, and mobility – abilities, whether they are temporary, permanent or fleeting. So the idea being that if you break your arm or are not able to use your arm, those are modalities, we can support alternative modalities that don’t require you to have the ability to use your arm. So we really want to support multiple ways of getting at the data in multiple ways of being able to author reports and things like that; and I think when we go into the development and design of our features with the mindset that everyone has abilities and everyone has limits to those abilities, no one is perfect at everything, that kind of pushes us to designing multiple ways to get at information that people need multiple ways to get at the same solution, guidance and multiple fashions; and by doing all these things, we more or less make a tool, and then by extension, the reports and the dashboards made by our tool, inclusive to all people. So that that’s more or less like that, the higher-level mindset. So since we own the tool that allows people to make dashboards and reports with visualizations on them, we can bake in a whole bunch of already standard accessibility features into the resulting reports.
JS: So yeah, I think probably most people think of, when they think about accessibility, they think about red-green color blindness, they think about maybe dual encoding. So if you have difficulties seeing different shades of colors, you have the number on top of the bar, the dot or what-have-you, so you can still see that, but you are living more in a world of interactivity where being able to click and scroll and zoom in is, you know, it’s sort of like crucial to the whole game. So how do you build those thought processes or those accessibility needs into the tool itself?
AS: So we have a couple of guiding principles that I think our team more or less abides by, and one of the main things is that everything that can be done with a pointer, either a finger or a mouse, should be able to be done with a keyboard, there should be no part of the product that you shouldn’t be able to tab to, to interact with, to multiselect, things like that. So some examples are when you’re consuming a report, you have a bunch of visuals on a page. So this could be like a dashboard or something like that, and you can imagine, this is a page describing the sales or something like that. You might have a bar chart in the top left corner, you might have a table in the bottom right corner, and in Power BI everything is interactive by default. So if you click on a bar that represents say the State of Oregon, then it would filter the other visuals to only display data that pertains to the State of Oregon. And so, with a mouse or a pointer, you can click on the data bar that represents Oregon, and it would filter all the other visuals. Well, we want to make sure that everybody can filter the data and have this interactivity. So we devised basically a standard that is approach for making our visuals keyboard accessible, and so we did that for all 31 of our core visuals, and we essentially came up with a standardized way to interact with these visuals. You can tab through all the visuals, and then you decide that you want to enter a visual, you want to explore a visual, you can do a special keyboard shortcut and Power BI, it’s control right arrow, and that will push the focus into the visual, and now you can start interacting with the visual elements inside that visualization. So you have no option of going through visual elements in the plot area or you have the ability to navigate on the items on a categorical axis, so this could be I want to tab through all the little data labels on the x-axis of column chart. So I tab over there, I hit enter, now each individual data label is selectable, I can tab through it, and find the State of Oregon – and, of course, all this stuff is being read out by the screen reader and explaining where you are in this hierarchy. Then I could hit enter on Oregon and immediately everything else on the report updates. It’s kind of a hierarchical navigation, enter to go in, escape to go out. So when I’m down at this axis label state, I can escape, I can then have a gate over the plot area, I can hit enter. Now I can select any of the bars and hit tab, and the same information that comes up in the tooltip when you hover over a data point is right up on the screen reader. So we have this information, we can just expose in multiple modalities. I think that’s – the way that we’ve done it and that we bake all this stuff into the definition of the visual or how the visual is rendered, now all of a sudden everybody gets this functionality, you don’t have to do anything special when you author reports to enable this functionality, it’s just there by default.
JS: Right. And so when people are making their dashboards or their reports in Power BI, are there other helper functions that help them think about accessibility – so I’m thinking about the basic one which is color vision issues – so aside from red and green, there’s color contrast, so it’s easy for me to go into Power BI and make something that I could pick colors that aren’t going to work for everybody, but are there guides built-in that help people make better decisions on that or is that really left to the user to consider these issues?
AS: Yeah, so issues like this, we tend to leave a little bit too wide open. So we added the ability to customize the theme, and I will say that all of our built-in themes are checked for these deficiencies or to be supportive of color vision deficiencies, just so you get these sort of stuff out of the box. We provide the ability to customize the theme, so you can actually start from one of these built-in themes as your starting point and then make customizations, oh I don’t like these fonts and things like that. So that’s kind of fun. There are a number of external tools that our users and creators of visualization have used to ensure that the colors that they’re choosing are sufficiently discernible in many different situations. I will say that one of the most helpful things is alt text, and I’m sure multiple people including Megan who was on your show recently had stressed – was that alt text can really be a very succinct way for you to explain what’s going on in this chart. I more or less describe the way of keyboard interacting with a chart, it can be kind of cumbersome to go through each individual data point to figure out is there an interesting trend here or not, whereas alt text could give you an indication, is there a trend or is there some sort of indication of what’s going on in this chart, so I can decide whether it’s worth my time to go and investigate point by point or category by category.
JS: So I wonder on that, on the alt text part, I wonder, in PowerPoint, for example, when I insert a photo now, in the new – in the modern, most updated version of PowerPoint, when I insert a photo into PowerPoint, it gives me an option to add an alt text and there is some algorithm, artificial intelligence running in the background that says, this is a picture of an old man riding a bike or whatever it is, and it’s trying to come up with what an alt text could be. Do you have that or is that something on the horizon where I’d create a scatterplot and it would prime me with something that says, there’s an upward slope to the relationship here or something like that.
AS: Yeah, and I swear I didn’t prime you on this question, like, we are building AI capabilities into the product, so we have like automatic insights for trying to find what causes my sales to go up in my company, and explain it by particular dimension values. The wonderful thing about doing that work in the previous six months to a year is that it enables things like automatically generating alt text, like describing the trends or the anomalies that are happening in this visual, so we have, what we call, restatements; so we have filter restatements; one of the most powerful things about Power BI is setting up these filter contexts. So that’s essentially I clicked on a datapoint in one chart and it filtered all my other visuals on the page, so now I care about sales in the State of Oregon, there it is. And so, on every visual right now, you have the ability to figure out what’s filtering this visual. It will say in plain English or plain text, this visual is only showing data from the State of Oregon. So we’re actually moving toward features that would help us restate what’s happening in an individual, and so this is something we’ve heard a lot from our customers, and that a consumer might not know how to read a scatterplot, and that’s totally okay, we don’t expect everyone to come in with like professional visualization fluency and be able to understand how to use everything. If you see text there that restates what’s going on in these charts, that is kind of a learning feedback loop, and we’re in a wonderful place where we’re creating the tools that both the authors use and the consumers use. So we can support authors by making better reports, but at the same time, we can support consumers that are looking at the reports that the authors created, and I kind of get this learning feedback loop just by looking at the visual, looking at this text, and [inaudible 00:17:58] oh, I can kind of see how that visual is elaborating on a point that’s being made in the text. And so I would envision, and I’m not promising, because I was told not to promise, that by taking this information, we can augment alt text in situations where the report author is elected not to put any custom alt text in. And also another benefit of this is that these reports are always updating – one of the main benefits of using a tool like Power BI is that it’s connected to always-on data sources. So when those data sources update, the visualization updates. It’s kind of untenable to ask the report author, hey, go update the alt text anytime the data updates, because maybe there’s a different trend or anomaly showing up.
JS: Right. But the fact that it exists in some ways is not just about the end user, it’s also about the creator and sort of priming them and reminding them, I think, of two things really, one is the accessibility issue, but also that maybe the title of your graph should be telling the story. I mean, it sounds like what you’re working on and what alt text, what good alt text does is really tell the story of the graph and the data, and yet a lot of people don’t do that in their chart titles and in the annotation. It sounds like this is kind of like a way to help people do that.
AS: Yes, I agree, and we are working on that front too. Although, I’m not sure how much I could say about that, what I will say is that, like, I’m a big subscriber of what Alberto Cairo, I believe, describes as being purposeful with your data visualizations. I’m a big sucker for use cases. So if anybody listening has used cases, I’m always game to hear them. But the idea being that I start with a page and I need to have a goal about what I’m doing with this page, what is this page going to tell whoever is looking at this report about – so if I start with a goal for this page, then that can be very purposeful that I’m putting this table in here in the top left corner because I want people to see details about the data. So like transactions or something like that. And I’m going to put the summary graph in the bottom right, that’s going to give me a high-level overview of the locations in which I’m having sales. And because we have interactivity for free, I am expecting that people will go and filter to individual regions so that data in the table can be more manageable. I don’t want to be seeing 10,000 rows of data there, I want people to be filtering the data by using – in Power BI, we call them, slicers that are basically just little dropdown menus that let you pick a few items. And now all of a sudden, the table becomes manageable, and I can start to see relationships. So being purposeful about the goals for the page or what tasks you want people to do with individual visuals, and yeah, like, I think the process of filling in alt text to codify or explicitly denote what you expect someone to do with this or the task that you want to do with it, even though it seems a little rote, but putting it down and seeing everything together can be extremely powerful, especially from a standpoint of self-critique, I believe.
JS: Right, yeah, that’s a good point. So Alper, on this idea of case studies, have you or others on your team, or I guess others at Microsoft really, have they done focus groups or one-on-one interviews or exercises of people who have these physical or cognitive limitations using some of the accessibility tools in Power BI?
AS: Yeah, on the Power BI team we actually have a research team and they’re not research in terms of academic research, but more in terms of user research, and so they’re doing one-on-one interviews and kind of walkthroughs and think-alouds with individuals that may have these cognitive or visual disabilities. And so, we’re kind of gathering feedback from those avenues, but also when we sell Power BI to large companies that have accessibility requirements, they’re a very great way of getting feedback, because we want to get feedback from a large diverse group of people, and Microsoft is really good at having customer support channels and things like that. And so, we can start connecting with people one-on-one and ensuring that we have the best of intentions when we create our features with accessibility support, but sometimes we just don’t quite nail it. And the wonderful thing about Power BI is we have an extremely fast release schedule, especially as compared to old tech companies. We can push updates out in the matter of weeks, and since Power BI has both a desktop application component which is mainly for creating reports and the Power BI service which is essentially our cloud-based offering, when we make an update that supports one person, and that’s generally our threshold, like should we prioritize this bug or not, it’s basically this one customer had this issue, we can support everybody within a matter of weeks, which is fantastic because, as you may know, it’s hard to get everything right in technology, and you always have bugs coming up. And the great thing about our team is that we prioritize accessibility bugs. So when they come in and we start getting indications that, oh we might have screwed something up, we can start these one-on-one conversations and start to attack the issue quite rapidly.
JS: That’s interesting. If someone with some sort of [inaudible 00:23:57] physical deficiency sends you guys an email and says, I can’t use, or, I’m having difficulty using this particular aspect. Is the response then to write them back and say, can we have a conversation about exactly what the issue is and help us to understand – so is there that back and forth?
AS: Yeah, and that’s very, like a really neat part about my job I think is that we started the, more or less, I hate the term vertical, but it’s essentially accessibility vertical. We have a PM that’s various focused on accessibility, we have engineers that are very focused on accessibility, so it’s everybody’s job on the team to ensure that the features that they write are accessible. But at the same time, when you’re trying to understand accessibility requirements, it’s fantastic to have PMs and developers that are tuned into these new use cases coming in so they can determine, okay, this is a particular or specific scenario that this user was running into, how can we generalize this so that everybody can benefit from it. And so, that’s how we kind of define our feature worker, I suppose, backlog work that’s created – what do we do to solve this problem. And just like programming or anything, there’s many different solutions to solve the problem, and we tend to take the solution that generalizes the best, whether it’s across multiple visuals or for multiple modalities [inaudible 00:25:33] things like that. Like, we don’t try too hard code for, okay, somebody using the line chart was having trouble selecting individual points, let’s fix it just with the line chart. So when we got the concern there, it was difficult to interact with a pie chart. We thought about, okay, how do we generalize the system to all of our charts, and that’s how we came up with our hierarchical keyboard navigation system that’s generalized and the same for all visuals so that if somebody knows how to keyboard interact with one visual, they know how to do it for all the visuals.
JS: For all of them, right. Let me ask one last question. As you think about your creator base, the folks who are creating visualizations, are there things that you would encourage them to think about with respect to accessibility as they’re creating their reports and their dashboards?
AS: Yeah, I would propose being more purposeful in designing reports and dashboards. And I think, following the task based design that I brought up before, it’s a really good way of pushing that forward. And as part of that, I think that making charts that are purposeful in what they’re trying to communicate would lead to good report design, but also in reports that are accessible to end-users. So this would be things such as when you – if you’re thinking about how somebody interacts with a report, you’re thinking maybe they should interact with this chart first to fill through the data and then go to this table to see the details. Well, that just highlighted, hmm, in Power BI you can change the tab order of visuals. So if I want the first visual that’s for someone to interact with to be the summary visualization that summarizes all the data on this page, I’ll make that the first visual on the tab order, I can make the table the second thing in the tab order, and then maybe a button that lets me go see more details the third item in the tab order. Right now, the tab order is based on the visual that you created first which is okay, but the person that’s creating the report most likely has the best idea of how someone should navigate through the data. And so, I think the two biggest things are the alt text and the tab order, just for someone to understand what’s in this report and what can I do with each of these items, I think those are the two biggest things. And then one thing, I suppose, I haven’t talked about is our support for high contrast mode, so this is a reduced color mode where we more or less take all the components in a report and collapse it down to four colors, and there’s a gigantic challenge for us internally to make sure that everything with all these backgrounds and foregrounds and highlighted data colors and things like that remain legible when there’s only four colors. But we’ve done all that work for you, which is the fantastic part, so when you’re picking colors, you don’t have to worry about, how does this look in high contrast mode because we more or less overwrite all your custom styles and make sure that it looks great in high contrast mode, that’s kind of one less thing that a report author has to worry about.
JS: Yeah, right. Well, this is really interesting, and thanks for coming on the show and sharing this. And I would guess, from a lot of things that you said that you are actively looking for feedback and comments, especially from those who have maybe some of these accessibility issues?
AS: Yes, absolutely. People can contact me directly. I’m on the internet at alper.datav.is, that’s my personal website. You can see some contact information there and some of the work I’ve done. But for the team, we really look at ideas.powerbi.com a lot and we use that to prioritize our work. If you have any feature suggestions, we comb through that weekly, and we look at the new issues that are coming up – we don’t just look at the top hitters that have been there for years, but also the new things that are coming in, like additional feature requests, and we really do use that to prioritize our work. So if you want to get in touch with the team, that’s a great place to start.
JS: That’s great. I’ll put those links on the show notes so people can get in touch and hopefully help you all improve the tool for everybody.
AS: Sounds great.
JS: Yeah, great, thanks so much for coming onshore, I appreciate it.
AS: Happy to be here. See you later.
And thanks everyone for tuning in for this week’s episode, I hope you enjoyed it. I hope I will see you at the next Data@Urban Digital Discussion series, and I hope you will consider rating or reviewing the show on your favorite podcast provider or going over to my Patreon page and helping financially support the show so that I can bring all of these guests to you each and every other week. So until next time, this has been the PolicyViz Podcast. Thanks so much for listening.