As the pandemic sends more people online looking for entertainment, we look at how Facebook and other companies gather information about their users and turn it into profits.
Reveal’s Nathan Halverson starts with the story of Ninja Saga, a game kids play on Facebook. Like many online games, this one requires players to pay a fee to advance to a higher level, a fee that kids usually ask their parents to put on their credit card. We learn how what parents think is a one-time charge of $20 is actually costing them hundreds, and in some cases thousands, of dollars.
Next, Halverson looks at how online gaming companies and Facebook are using big data to profit from people vulnerable to gambling addiction. He tells us about one woman in Texas who downloaded an app that was advertised as free, only to end up spending hundreds of thousands of dollars.
Finally, Reveal’s Ike Sriskandarajah looks at the biggest smart device most of us own – the television – and how one TV maker was using it to secretly gather marketing data on its customers and sell it to advertisers.
This episode originally was broadcast Aug. 3, 2019.
DIG DEEPER
- Read: So your child racked up unwanted credit card charges playing video games. Now what?
- Read: Judge unseals trove of internal Facebook documents following our legal action
- Read: Facebook knowingly duped game-playing kids and their parents out of money
- Read: When did Zuckerberg learn about Facebook’s targeting of children? Senators want to know
- Read: FTC should investigate Facebook’s child gaming practices, advocates say
- Read: Facebook’s fraud policies raised red flags. It still hasn’t changed them
Credits
Reported by: Nathan Halverson, Ike Sriskandarajah and Anayansi Diaz-Cortes
Produced by: Nathan Halverson, Ike Sriskandarajah and Anayansi Diaz-Cortes
Lead producers: Ike Sriskandarajah and Anayansi Diaz-Cortes
Edited by: Taki Telonidis
Production manager: Mwende Hinojosa
Production assistance: Amy Mostafa
Sound design and music by: Jim Briggs and Fernando Arruda
Special thanks: Reveal’s Victoria Baranetsky, Amanda Pike, David Ritsher and Nikki Frick, and to Zach Stauffer, Tom Kaufman and Deirdre Bardolf
Executive producer: Kevin Sullivan
Host: Al Letson
Support for Reveal is provided by the Reva and David Logan Foundation, the John D. and Catherine T. MacArthur Foundation, the Jonathan Logan Family Foundation, the Ford Foundation, the Heising-Simons Foundation, Democracy Fund, and the Ethics and Excellence in Journalism Foundation.
Transcript
Reveal transcripts are produced by a third-party transcription service and may contain errors. Please be aware that the official record for Reveal’s radio stories is the audio.
Speaker 1: |
Today’s episode is brought to you by the FRONTLINE Dispatch. As people around the world face new realities amid the deadly COVID-19 pandemic, FRONTLINE, the acclaimed PBS documentary outlet, has launched a new podcast series that presents personal and profound stories from the front lines of this historic outbreak. |
Speaker 1: |
Covering Coronavirus offers a unique lens into how the Coronavirus is threatening communities at this moment, and reveals the complicated real human stories that are emerging from every corner of this pandemic. Search for the FRONTLINE Dispatch, wherever you get your podcasts. |
Speaker 1: |
Reveal is supported by Everlane. Would you buy a T-shirt for $50 if you knew it only costs $7 to make? With Everlane, you never overpay for quality clothes. Everlane only makes premium essentials using the finest materials without traditional markups. They tell you their real costs. And because they sell directly to you, their prices are 30 to 50% lower than traditional retailers. And right now, you can check out our personalized collection at everlane.com/reveal. Plus, you’ll get free shipping on your first order. That’s everlane.com/reveal. Everlane.com/reveal. |
Al Letson: |
From the Center for Investigative Reporting and PRX, this is Reveal. I’m Al Letson. With so many of us sheltering in place to stay safe from the Coronavirus, we saw a stat that maybe shouldn’t have come as a surprise. There’s been a huge spike in online gaming, and it made us think back to an episode we brought you last summer about games people play on Facebook and their smartphones. It’s from Reveal’s, Nate Halverson. And Nate, where are you these days? |
Nate Halverson: |
Well, Al, I’m reporting from my cabin up in the mountains. It’s pretty majestic up here. The birds are singing and it’s finally getting warm, and the snow is melted, and I’ve got internet. So until we can come back into the newsroom, I’ve been working from up here. |
Al Letson: |
And Nate, how big of a jump has there been in online gaming? |
Nate Halverson: |
Oh, it’s been huge. People are downloading games at record levels, never seen before. And of course, there’s been an uptick in things like video conferencing and education programs and food delivery at home. But the biggest jump, the most downloaded apps right now, are mobile games, and it’s especially true for children. Many of these games are marketed at kids. |
Al Letson: |
And that was what your original investigation was about? |
Nate Halverson: |
Yeah, that’s right. I got into this story a few years back. And in kind of a random way, I was at a bar in San Francisco where I live and I went to see a buddy’s band playing. And during set break, he comes off stage and he says, “Hey, Nate, you got to talk to this guy, JR. He’s got a heck of a good story for you.” |
Al Letson: |
And what did he tell you? |
Nate Halverson: |
Well, this guy, he’s a lawyer and he had a lawsuit against Facebook. And what he was looking at was how Facebook treated children. And he told me that if I wanted to understand, I guess, the business ethics at Facebook, how it treats its users, I needed to understand what was happening in his case. And that’s how I met a woman named Glynnis Bohannon. |
Nate Halverson: |
Hello, Glynnis. |
Glynnis Bohanno…: |
Hi. |
Nate Halverson: |
Nate Halverson. |
Glynnis Bohanno…: |
Nice to meet you. |
Nate Halverson: |
Nice to meet you too. |
Glynnis Bohanno…: |
Come on in. |
Nate Halverson: |
So let me take you back to a fall day in Phoenix, Arizona, back in 2011. It’s like hot outside, and this is like even an unusually hot day for Phoenix. |
Glynnis Bohanno…: |
Not quite cool enough for kids to be back out playing outside. |
Nate Halverson: |
So Glynnis Bohannon’s son, Ian, he’s 12 at the time. He’s doing what all kids will do on a hot day, he’s playing video games. |
Glynnis Bohanno…: |
At his age, I would often use his gaming time as a little bit of trade-off for doing homework. If you get your work done, your schoolwork done, your chores done, your homework done, then you can have gaming time. |
Nate Halverson: |
He goes in, he gets on the computer, he loads up Facebook, and he starts playing a game called Ninja Saga. |
Al Letson: |
I don’t play games on Facebook. So does Facebook own these games? Like how does that work? |
Nate Halverson: |
No. What Facebook did was it opened up its platform for outside companies to develop these games that are then loaded on Facebook, so kids like Ian can play them. |
Al Letson: |
But they’re free right? |
Nate Halverson: |
Yeah, on the face of it, they’re free. But if you want to do something extra, like get a magical sword for your Ninja or just like make it more powerful, to do that, he has to spend money. And Facebook, it gets a 30% cut of that. |
Glynnis Bohanno…: |
So he had approached me with his chore money to get access to be able to play this game, Ninja Saga. |
Nate Halverson: |
So Ian went and grabbed a $20 bill that he earned doing his chores and hands it to his mom. |
Glynnis Bohanno…: |
I said, “Okay, I’ll go ahead and I’ll put my credit card in and give me your $20.” And I loaded my credit card in the system and he proceeded to start playing the game. |
Nate Halverson: |
So Glynnis takes off. She goes and hangs out with some friends and doesn’t think another thing about it until she gets back to the house. |
Glynnis Bohanno…: |
And my husband said that Wells Fargo called and I thought, “Oh, I hope somebody didn’t go on a shopping spree with my card.” |
Nate Halverson: |
So she goes and she logs onto her Wells Fargo credit card account and she sees a string of charges. |
Glynnis Bohanno…: |
$20, $50, $50, $20. 21 transactions on the backside of this paper. |
Nate Halverson: |
Totalling almost 1,000 bucks. |
Glynnis Bohanno…: |
So when I pulled up that account on the computer and I see Facebook, Facebook, Facebook, Face… I’m like, “What is going on? What is all of this?” |
Nate Halverson: |
She thought that her son had asked to spend $20 and then just compulsively kept spending. |
Glynnis Bohanno…: |
Oh, yeah. I’m like, “Ian Michael, what have you been doing with my credit card?” I’m like, “look at the statement, I have $1,000 in charges from Facebook. What have you been doing with my card?” He’s like, “I don’t have your card, mom. I don’t know what you’re talking about.” |
Nate Halverson: |
And so she says, “Well, load up the game on Facebook and show me what you did.” And so he loads it up and he starts playing and he’s playing the game. |
Glynnis Bohanno…: |
And it’s ringing and bells and whistles and gling, gling, gling, gling, gling, kind of noises. And then the stack of coins got small, like two coins, and it would blink at him. It kept blinking, blinking, blinking at him, and then he hit it and it went prrring and shot up. And now there was this big tall stack of gold coins and nothing else popped up. And then he started to play again. |
Nate Halverson: |
And she doesn’t see him spend any money. |
Glynnis Bohanno…: |
And then he said, “That’s all I’ve been doing.” |
Nate Halverson: |
So she goes and she logs back into the credit card account. |
Glynnis Bohanno…: |
And sure enough, brand new charge of 19.95. |
Nate Halverson: |
Facebook has stored her credit card and she’s not used to this because every time Ian wanted to spend money on his X-Box, she would have to go over and re-enter her credit card. But on Facebook… |
Glynnis Bohanno…: |
Nothing popped up and said, “Do you want to proceed with this transaction of 19.95?” Nothing came up at all. |
Nate Halverson: |
Ian could rack up hundreds of dollars without ever realizing it. |
Glynnis Bohanno…: |
Oh, I was so mad. I was like, “This is so wrong.” |
Al Letson: |
Was she able to stop payment with the bank? Like what happened with her? |
Nate Halverson: |
So first she tried to reach out to Facebook. Emails, emails, emails. She tried to find a phone number to call them. She left voice messages for them. Never heard back, never got a response. So finally, she reaches out to her credit card and she says, “Look, my son accidentally spent this money. We didn’t realize that it wasn’t clear.” And her credit card company said, “Well, we can refund the money for you, but you have to file a criminal complaint, essentially a criminal felony complaint, against your son for spending nearly a 1,000 dollars without your permission.” So she didn’t want to do that. And she realized that she probably wasn’t the only one facing this. |
Glynnis Bohanno…: |
My feelings were that this could have impacted a lot of people on a lot of families. |
Nate Halverson: |
So back in 2011, she reaches out to a lawyer. |
Glynnis Bohanno…: |
J.R. Parker. |
Nate Halverson: |
J.R. Parker, the same guy that I sat down next to, in that bar in San Francisco. |
Glynnis Bohanno…: |
And that was it. |
Nate Halverson: |
They begin finding other people that it’s happened to, and it was happening to a lot of folks, and they turned it into a class action lawsuit. |
Al Letson: |
And so what happens during that lawsuit? |
Nate Halverson: |
Well, J.R and his colleagues want to know a bunch of stuff. They want to know how much children were spending on these games. How much money they and their parents were trying to claw back from Facebook. And they wanted to know when Facebook realized that this was a problem and what they did to try to stop it. |
Nate Halverson: |
Glynnis’s lawyers and Facebook’s, go back and forth and eventually decide to settle. Two important things happen. The first is that Facebook agrees to create an easier way for kids and parents to ask for refunds, but they don’t actually force developers to stop doing what they’ve been doing. The second thing is that all the information gathered in this case is sealed. It gets buried in a courthouse in San Jose, and that’s where it would have stayed. |
Al Letson: |
But it didn’t. |
Vicky Baranetsk…: |
Nate walks by my office and says, “If you have some time later today, I’d really love to talk to you.” |
Nate Halverson: |
I turned to Reveal’s lawyer, an absolute hero, Vicky Baranetsky. |
Vicky Baranetsk…: |
And so, he gave me the docket, I went and did a deep dive into it and started looking into ways that we could file a motion to unseal. |
Nate Halverson: |
So basically that means she asked the court to make that evidence public. |
Vicky Baranetsk…: |
And so after we filed the brief, Facebook files their brief, we filed a response, Facebook files a response, the court does a review and, oh, I think it was two or three months later, the court came back and issued an order. |
Nate Halverson: |
And what happened? |
Vicky Baranetsk…: |
The court said- |
Nate Halverson: |
We won. |
Al Letson: |
Wow. |
Nate Halverson: |
Almost completely across the board. |
Vicky Baranetsk…: |
You know, I always temper everything, but it was a bit of a celebration. So we got information. |
Nate Halverson: |
We got memos, strategies, employee emails, more than 150 pages of stuff. |
Al Letson: |
And so what’d you find out? |
Nate Halverson: |
Going through these documents for the first time, at least for me as a nerdy journalist, was like reading a thriller. There was one email exchange between two employees and they’re referring to a child as a whale. A whale of course is a term that the casino industry uses to describe a big spender, somebody that flies in on a private jet but this was a 15-year-old girl. |
Nate Halverson: |
Now, one of these Facebook employees says, “Would you refund this whale ticket?” Referring to this child who’d just spent $6,500 in a couple of weeks. And when this child realized what she had done, she asked for a refund. But the Facebook employee and her supervisor actually joked about how the girl looks more like 13 in her picture, and then the supervisor just comes out and says it, “I wouldn’t refund.” It’s 6,500 bucks. |
Al Letson: |
For a kid who probably does not have that money, which means her parents have to come up with that money. |
Nate Halverson: |
Which she’s grounded for like until she’s on Social Security. |
Al Letson: |
Yeah. |
Nate Halverson: |
And the material that we got on sealed, it begins to give us clues as to how a child might spend thousands of dollars and you know it wasn’t just documents that we got. |
J.R. Parker: |
Marked as exhibit 35- |
Nate Halverson: |
We actually also got audio from the interviews that Glynnis’s attorney J.R. did with Facebook employees. |
J.R. Parker: |
Are you familiar with this document? |
Bill Richardson: |
Yes. |
J.R. Parker: |
What is it? |
Nate Halverson: |
Bill Richardson is in charge of all payments at Facebook. |
Bill Richardson: |
It is a discussion thread post which summarized a data analysis sheet- |
Nate Halverson: |
Here is where we learn that Facebook did a study and identified this problem all the way back in 2011. That’s when they first noticed they’re getting lots of refund requests from credit card companies trying to claw back money from Facebook. They’re called chargebacks. And if you have a chargeback rate of 2%, the Federal Trade Commission will actually say that’s a red flag for fraud. But when it came to games that children played on Facebook, the total amount being charged back was 9% and Facebook knew about this well before the lawsuit. |
J.R. Parker: |
And that push back response says it is not our current policy to issue refunds in cases when charges were made by someone in your household or someone who is known to you. Is that right? |
Bill Richardson: |
Yes, that’s what it says. |
J.R. Parker: |
Okay. |
Nate Halverson: |
And so Facebook had come up with a solution to this problem. Kids would just have to re-enter the first six digits of their parents credit card number before they could spend more money. |
J.R. Parker: |
But Facebook has never, other than this specific testing, has never actually imposed that rule on minor transactions, first six digits of a credit card be inputted per transaction. Is that correct? |
Bill Richardson: |
Not to my recollection, no. |
J.R. Parker: |
Okay. |
Nate Halverson: |
But they never implemented it. |
Al Letson: |
So Facebook knew this was a problem and decided not to do anything about it? |
Nate Halverson: |
Yeah, they knew that children were unwittingly spending their parents’ money. In fact, they started calling it friendly fraud, which is a term that comes from the credit card industry. But Facebook sort of redefined it to mean when a child would spend their parents’ money without their parents knowing. |
Al Letson: |
So they gave it a name but decided not to fix it? Why? |
Nate Halverson: |
Well, Al, we got ahold of an email that might actually answer that question. A Facebook employee studied this problem and wrote to his bosses that this extra step of adding in credit card numbers would cut into the company’s revenue. Back then, Facebook was making about $500 million on social games like Ninja Saga. Facebook never adopted the rule. That’s why Glynnis filed this lawsuit. |
Speaker 8: |
Can you please state your full name for the record? |
Ian Michael Boh…: |
Ian Michael Bohannon. |
Nate Halverson: |
And it’s the reason that she and her son had to fly all the way to San Francisco to sit down in front of Facebook’s attorneys to answer their questions. Now, we didn’t get to talk with Ian for this story, but we were able to get ahold of the court recordings of him being deposed. This is back in 2014 after Ian had just finished the eighth grade. |
Speaker 8: |
Isn’t it true that you knew exactly what you were doing when you made the purchases and then when your mom found out you were scared and so you brought her to a different page on Ninja Saga and did something different that got you coins? |
Ian Michael Boh…: |
No. |
Speaker 8: |
And when Facebook puts on its evidence, you’re not going to change your story then are you? |
Ian Michael Boh…: |
No. |
Speaker 8: |
You understand that perjury under the US system is punishable by law, up to five years in jail. |
Ian Michael Boh…: |
Yes. |
Speaker 8: |
And you’re not going to change your testimony. |
Ian Michael Boh…: |
No. |
Al Letson: |
Man, that is harsh. I would not like it if these lawyers were grilling my kid that way. |
Nate Halverson: |
Yeah. Glynnis felt the same way. |
Glynnis Bohanno…: |
My stomach hurt and I was just full of nerves because I had to sit there and be quiet. And so it was upsetting me that I couldn’t protect him in the way that I wanted to. |
Nate Halverson: |
Now, in the end, because of the lawsuit, Glynnis and the other people did get their money back, but that was about it. |
Glynnis Bohanno…: |
That’s really what I wanted. I didn’t go at this like, I’m going to make a bunch of money off Facebook. I didn’t make any money. I did it for the principle of the thing because in my heart and in my gut and in my mind they were doing the wrong thing. |
Al Letson: |
Thinking about all of this, the lawsuit didn’t actually address the root problem. It’s still possible for kids to spend their parents’ money without realizing it, correct? |
Nate Halverson: |
That’s right. |
Al Letson: |
So what has been the impact of your reporting? Is Anybody doing anything to actually stop that? |
Nate Halverson: |
So as part of the settlement, Facebook beefed up its refund policy for children, but I was reading through their website recently and I found that they still let game developers get away with a chargeback rate that is more than double what the government says should be a red flag for deceptive behavior. |
Al Letson: |
Since Nate started reporting on this, a dozen child safety and online privacy groups filed a complaint with the Federal Trade Commission calling on them to investigate Facebook. In their letter they said Facebook has a callous disregard for young people, and a culture that prioritize profits over people. |
Al Letson: |
When we come back, Nate has a story about even bigger spenders, bigger whales, and how online gaming companies hook them. But now an update on last week’s show. Reveal’s, Will Evans, reported on the dangers that workers face in Amazon warehouses. So we told you about an Indiana man who was killed on the job. A state OSHA investigator wrote up four serious citations against Amazon, but his bosses dropped those citations after Amazon appealed. |
Al Letson: |
After our story came out, the federal branch of OSHA looked into the case and has now found that Indiana officials were not justified in getting rid of three of the four citations. That Amazon did not prove its case. That the death was caused by what it claimed was employee misconduct Amazon had found should not have been let off the hook. Indiana officials now have a chance to respond. |
Al Letson: |
You’re listening to Reveal. |
Al Letson: |
From the Center for Investigative Reporting and PRX, this is Reveal. I’m Al Letson. Facebook exploited children to make big money, but it didn’t stop there. Reveal’s, Nate Halverson, is back with another story about Facebook. |
Al Letson: |
And Nate, this again is something you just kind of stumbled onto, right?. |
Nate Halverson: |
Yeah, man. It was me and a buddy in the dead of winter and we went into Yosemite up to this ski hut in the mountains. You know, you’ve got to truck way back there to find this thing and the sun had set and it was getting cold. And we got to the front door of this little hut and opens up, an orange light kind of glows out and inside is this feast that they’ve laid out on the table. So we drop our packs, grab beers, sit down and join people. And I happened to sit next to a dude who worked for a tech company in San Francisco and he begins to tell me the story, this dark story about social casinos and how they were taking advantage of their users all with the help of Facebook. |
Al Letson: |
Wait. What exactly is a social casino? |
Nate Halverson: |
These games you play that bundle together slot machines, roulette, pokers, you play them on Facebook or you can download an app on your phone. |
Al Letson: |
So people are getting into trouble with these? |
Nate Halverson: |
Yeah, I mean, on the surface it sounds super innocent, right? I mean, for a slot machine, you open it up, you hit tap to spin it, right? But underneath is this technology, this deeply sophisticated technology designed to hook people to spend as much money as possible. And as I started reporting this story, I met somebody who fell deep into that trap. |
Nate Halverson: |
Suzie Kelly is a grandma from suburban Dallas. On the outside she has a wonderful life. Five years ago, she and her husband, Chuck, had almost paid off their house in a quiet treeline neighborhood, a pool in the backyard, surrounded by a little safety fence to keep their granddaughter from falling in. They’re cautious like that. They plan to buy a retirement home down on the Texas coastline, or at least that was the plan. Then one day Suzie sat down to watch Judge Judy. |
Suzie Kelly: |
There was a commercial for Big Fish Casino, I thought it was a casino, casino, at first, and then I realized it was a game. They said, “Play for fun, play for free!” |
Jose Brotons: |
Big Fish Casino, play for free, play for fun. |
Suzie Kelly: |
I thought, “What?” So I realized it was an app, download it now, and I was bored or restless or something, but I figured, “What the heck? Just download it and see.” |
Nate Halverson: |
Suzie got free chips when she downloaded the game, but when those free chips ran out, she would need to buy more if she wanted to keep playing. |
Suzie Kelly: |
I had those chips for maybe a day, not even. So I figured, “Well, I’ll purchase a little small package.” |
Nate Halverson: |
So she bought a bunch of chips for 19.99, then those ran out too. |
Suzie Kelly: |
Then it was the 49 and then 99.99. I would say my spending increased to hundreds of dollars and thousands of dollars within the first month. |
Nate Halverson: |
Suzie spent about $8,000 that first full month, 8,000. |
Nate Halverson: |
How much could you win playing Big Fish Casino? |
Suzie Kelly: |
Real money? Zero. Nothing at all. I couldn’t win any money from Big Fish Casino. That’s it. |
Nate Halverson: |
Why? |
Suzie Kelly: |
Because they don’t pay real money. They only take money to give you virtual chips to continue to play on their app. |
Nate Halverson: |
So you can’t ever win your money back? |
Suzie Kelly: |
You cannot win any money back. No sir. |
Nate Halverson: |
And this is the crazy thing about social casinos. It’s not like traditional gambling. In fact, social casino executives don’t call it gambling, they say it’s just entertainment. Suzie can never win her money back. She’s playing in part for the social aspect of the game, meeting other players, developing online friendships. |
Suzie Kelly: |
Your new friends are here and they’re all over the world and they really like you and we’re having fun and as crazy as this sounds, even when I say it out loud, that became my new life, my new world. This was my family and friends. |
Nate Halverson: |
Suzie was now playing daily to keep her new friends close, sometimes playing around the clock. Falling asleep with her phone in her hand, tapping her phone to spin, spin, spin, waiting for that beautiful noise, that sound of winning chips. But Suzie knew something was wrong. |
Suzie Kelly: |
I lost myself in this game. That’s the truth. I literally got lost and lost me at the same time in that game, in that app. |
Nate Halverson: |
Less than a year after she downloaded the Big Fish Casino app, Suzie had lost control. She’d spent more than $40,000, 40,000 playing a free game on her iPhone. She’d taken out a home equity loan to pay down credit card debt from the game. Her husband, Chuck, didn’t know. She was terrified he’d find out. Suzie realized the truth of what was happening. |
Suzie Kelly: |
I have an addiction, it’s online gaming. I didn’t realize that you could have that, but that’s the truth. I needed out. |
Nate Halverson: |
So one day she opened the app and wrote to their customer service a simple message with a simple subject line. It read, “Cancel account.” |
Suzie Kelly: |
“Cancel account.” I wrote, “So, even though I love the app, I just can’t do this anymore. I’ve maxed out my Amex twice and don’t want to go for three.” I said, “Please let me know when the account will be closed. Thanks.” |
Nate Halverson: |
Did they close the account? |
Suzie Kelly: |
No, sir. |
Nate Halverson: |
It’s at this point that Suzie’s story moves from being about addiction to being about manipulation. A few days after Suzie sends that message, her phone rings, it’s a man calling himself Byron Scott and he says he works for Big Fish Casino. |
Nate Halverson: |
What did he want to talk about on the phone? |
Suzie Kelly: |
He said he was my VIP representative with Big Fish Casino. |
Nate Halverson: |
A VIP host is what Las Vegas Casinos provide for their biggest spenders. The people who fly in on private jets. Now Suzie, a grandma from suburban Dallas, has a VIP host for the game she’s playing on her phone. And Byron, he pushes her to keep playing. He gives her free chips and he doesn’t close her account. |
Nate Halverson: |
Where would this relationship with Byron Scott go? What did it become? |
Suzie Kelly: |
This was a daily thing, back and forth. It was like a friendship. He would send me VIP gifts every Christmas. We’d get packages, to keep me playing. This is going to sound crazy, but it was like a friend. |
Nate Halverson: |
But Byron Scott is not Suzie’s friend. I find out it’s not even his real name. What Suzie doesn’t know is that the game is monitoring and tracking her as she plays. Byron is part of a sophisticated system that collects data on her and targets her to spend more and more. He’s trying to maximize what the social casinos call her LTV or Life Time Value. In simple terms, they’re trying to get as much money as possible from Suzie. |
Jose Brotons: |
Hi guys. Thank you so much for having me. Who’s got some sort of social casino application right now? |
Nate Halverson: |
This is Jose Brotons speaking at a tech conference in 2013. He calls himself the grandfather of social casinos. Jose worked for Aristocrat Leisure, the company that now owns Big Fish Casino and he explained why social casinos need VIP programs. |
Jose Brotons: |
You’ve got to think that about 3% of your users are going to be generating 80 to 90% of the value for the company. |
Nate Halverson: |
He calls these people whales and he designed the VIP system to closely monitor them. |
Jose Brotons: |
What we attempt to do with our VIP and loyalty programs is to ensure that we have a very close relationship with our VIPs. That we’re tracking what is their experience like? What are they up to? Are they playing, are they paying? And so far it’s been extremely helpful. |
Nate Halverson: |
These slot machine games are using big data and behavioral analysis software to hunt down target and trap those big spenders, those whales. This is almost science fiction. |
Jose Brotons: |
We’ve seen people that had lapsed and sort of we’ve been able to bring them around and start to get them to pay again. |
Nate Halverson: |
For Jose, this was all business and big profits, but for some of his employees it was disturbing. They’re using technology to fleece gambling addicts. None of the former employees I spoke with want to be named. They fear the company might come after them in court, but they told me Suzie’s story was all too common. One player couldn’t buy her prescription medicine because she’d gone broke playing the game. Another woman, her home was in foreclosure. They told me these players were addicted and the companies were doing nothing to help them. One former employee said, “At some point you realize this has gone way past entertainment.” |
Nate Halverson: |
But one story really stuck with me, from a woman who was a VIP host like Byron. She was so disturbed by what they were doing that nearly every day she would find a quiet place somewhere in their office and cry, cry because of what they were doing to people like Suzie. |
Suzie Kelly: |
There were days where I would spend five, $600 or sometimes even more in one day. |
Nate Halverson: |
And it wasn’t just the social casinos that were making big money, Facebook was cashing in too. Suzie was buying her virtual chips through Facebook, which was getting a 30% cut. She originally used Apple’s app store, which also took a cut, but Byron told her that Facebook had better deals on chips and made it easier to spend money. |
Suzie Kelly: |
There’s nothing to stop and say, “Are you sure you want to buy this?” It was click and done. Extremely easy. |
Nate Halverson: |
So easy, she says it fueled her addiction. I ask Suzie if I can see how much money she spent. She logs into her Facebook account and scrolls down. |
Suzie Kelly: |
Here they are, see all. |
Nate Halverson: |
249.99, 249. I mean… This is one, two, three, four, five, six, seven, eight, nine, 10, 11, 12, 13, 14 lines, all of them say $249.99- |
Suzie Kelly: |
Yes, sir. |
Nate Halverson: |
And you’re just scrolling through it. |
Nate Halverson: |
Facebook was making a killing on these games and they even talked about it at tech conferences. |
Julien Codornio…: |
It’s the number one category on Facebook. |
Nate Halverson: |
This is Julien Codorniou, the director of Facebook’s global network of game developers, in 2014. |
Julien Codornio…: |
It’s a category that never stops growing. Every year we see new companies coming up with amazing games, launching on Facebook, launching on mobile, making significant money. |
Nate Halverson: |
The social casino industry has gone from essentially no revenues ten years ago to now being a $5 billion a year industry. That’s almost as big as the whole Las Vegas Strip. And social casinos are growing so fast, soon, they’re expected to overtake it. And Facebook is driving that growth with its massive advertising reach. Facebook can target and show social casino ads to the people it calculates are the most likely to spend huge amounts of money, the whales. |
Julien Codornio…: |
It’s very good for gaming companies because they can decide to target on Facebook or on mobile specific users or just the whales. |
Nate Halverson: |
And how does it do that? Facebook analyzes its huge database of personal information on it’s almost two and a half billion users. After it identifies who will be the biggest spenders, it charges a premium to social casinos to advertise to those whales. This practice of profiting from social casinos made at least one executive at Facebook uneasy. |
Nate Halverson: |
I uncovered a confidential email from Sam Lessin, the former vice president of product management. He told Facebook founder, Mark Zuckerberg, “I am not proud of the fact we are currently extolling game companies that make online slot machines as positive examples of those willing to pay our fees, I’m fine with it, just not proud of it.” The email was from 2012, when the social casinos were just starting to take off. A year later, Facebook awarded Jose Brotons Social Casino as one of its games of the year. |
Suzie Kelly: |
I had no idea this was going on. |
Nate Halverson: |
I’ve taken what I’ve learned back to Suzie and we’re sitting in her living room. I’m showing her internal company documents which were leaked to me. We can see how Jose Brotons created the VIP program to track players by their Facebook ID, monitor their spending and entice them with gifts. |
Suzie Kelly: |
I was nothing but a pawn, just money. |
Nate Halverson: |
Does it feel like they’re targeting your addiction? |
Suzie Kelly: |
Absolutely. For me that’s like let’s find the weakest person and destroy their life. You know what I mean? Let’s find the person that is going to just go bonkers over this and let’s take them for everything they’ve got. |
Nate Halverson: |
And they took nearly everything Suzie had. And not just her money, but moments she’ll never get back. She remembers sitting at her dying mother’s bedside. |
Suzie Kelly: |
My Mom’s in the hospital on her death bed and I’m playing this stupid game, logging on to get my bonus. I mean, what the heck was I thinking? |
Nate Halverson: |
After Suzie’s mom died, she received a sizable inheritance. She spent it on Facebook, on Big Fish Casino chips. And again, she tried to quit. |
Suzie Kelly: |
May 2nd, 2016, well, this is right after my mom passed. “Hey, Byron, can you please go ahead and delete my account.” |
Nate Halverson: |
Did he go on to delete your account? |
Suzie Kelly: |
No, sir. Not at all. |
Nate Halverson: |
Did he give you more free chips? |
Suzie Kelly: |
Oh, yeah. And I started to pay and pay and pay and pay insane amounts of money. |
Nate Halverson: |
All told, Suzie would spend more than $400,000. And then there was, Chuck, her husband, she couldn’t keep her spending hidden forever. She had to tell him. |
Suzie Kelly: |
I sat him down and I said, “I really want to talk to you.” And he said, “What’s going on?” And, “I’ve spent a lot of money on that app, Big Fish Casino.” And he said, “Why? I realized that.” I said, “No, I’ve spent a lot of money.” And took a breath, I remember this, I said, “I’m sorry, Chuck, I think we might lose… ” I’m like, “I don’t want to lose everything.” |
Nate Halverson: |
Did you tell him how much you’d lost? |
Suzie Kelly: |
I kind of stopped counting after 300,000. It’s a scary thought when you see those purchases and you’re like, “Oh my God,” it’s just day, after day, after day. You know what I mean? |
Nate Halverson: |
And for Chuck, it was beyond scary. He got up and left. |
Suzie Kelly: |
I just sat down on the floor and started crying and Jackson and George came over to me. Those are our dogs. I was petting them and I said, “I don’t think daddy’s coming back.” |
Nate Halverson: |
And what did Suzie do that night? |
Suzie Kelly: |
Yeah, I was already back to playing. Yep, Suzie blows $1,000 playing the game that night. Yep. It’s like when things got bad, that’s where I went. |
Nate Halverson: |
This didn’t have to happen. And in fact, at a real casino- |
Keith White: |
If this was a customer in the legalized regulated space, we would say absolutely, you should exclude her from play. |
Nate Halverson: |
This is Keith White, executive director of the National Council on Problem Gambling in Washington, a nonprofit that provides help for people suffering from gambling addiction. He says, “Social Casino Games have an addiction rate five times higher than regular casinos.” |
Keith White: |
In the US alone, you’re talking well over 100 million people who report playing somewhat regularly on Social Casino apps. That’s a pretty high number. It’s an incredibly high number. No one’s tracking this because it’s not being regulated. |
Nate Halverson: |
Social Casinos have been able to avoid regulation because, again, they claim it’s not real gambling, it’s just entertainment. That’s the argument they’ve made so far successfully to state regulators who oversee casinos. And that lack of oversight leaves people like Suzie vulnerable. |
Keith White: |
This is in some ways, pure addiction. So you wouldn’t tell someone who has a massive cocaine problem, “Why don’t you just stop?” Or you might tell them that, but we know it’s not going to be very effective. In the same way, someone with a severe gambling problem, they can’t just stop and especially if you then continue to provide them with chips, with the object of their addiction, with access to this app. |
Nate Halverson: |
But Suzie did try to stop. |
Suzie Kelly: |
Hi, Byron. Can you please block [crosstalk 00:34:47]- |
Nate Halverson: |
Close to a dozen times, Suzie asked the Big Fish Casino to close her account to stop letting her spend more. |
Suzie Kelly: |
“Hey, Byron, can you please go ahead and delete my account?” “Are you sure you want me to delete it Suzie?” “Can you please block/delete my account?” “Please think it over, but Suzie, let me know tomorrow if you’d like me to block it. I’d love to offer you a super special deal which will currently reward you…” “Block me, ban me, delete me, please, please, please.” And then in caps I put, “DELETE MY ACCOUNT.” |
Nate Halverson: |
“Please, please, please, DELETE MY ACCOUNT.” And that’s a very clear call for help. That’s a very specific request. |
Nate Halverson: |
I show Keith, Byron’s response. |
Keith White: |
“And again, are you sure you want to delete it? Are you sure you want me to delete it, Suzie?” This is just… It’s absolutely predatory, and it should be unacceptable. |
Nate Halverson: |
I requested an interview with Aristocrat Leisure, the parent company of Big Fish Casino. They declined but sent me a statement that reads, in part their gaming companies are dedicated to delivering great entertainment experiences. “We strive to ensure that our social games comply with all applicable standards, rules and requirements.” |
Nate Halverson: |
I reach out to someone else. Remember that top Facebook executive, Sam Lessin? Who told Mark Zuckerberg he wasn’t proud they were promoting slot machine companies? I sit down with him and tell him what happened to Suzie. |
Nate Halverson: |
She ended up spending over $400,000 playing a slot machine game, you know? |
Sam Lessin: |
Yeah. I mean, it sounds disgusting, right? For sure. We’re going to have to live in a world where both very, very good people and very, very bad people have better tools. |
Nate Halverson: |
These days Sam Lessin is a technology investor, an influential voice in Silicon Valley. He won’t discuss his time at Facebook, but speaking generally, he says, “Companies are gathering information on specific people and delivering tailored ads to them.” |
Nate Halverson: |
Is this now happening everywhere? |
Sam Lessin: |
Pretty much, yeah. I mean, I think, do we want hyper-targeted ads from beer companies to alcoholics? Do we want hyper-targeted ads from casinos to gambling addicts? And the tough thing about that is obviously the human answers. No, of course we don’t want those things, right? Like no thinking person is like, that’s great, but then the question is, well, okay, let’s be really clear, what rule do you want to write, right? And how are you going to enforce that rule? |
Nate Halverson: |
I wanted to talk to Facebook directly about its role in social casinos, but they turned us down for an interview. Instead a spokesperson sent us a written statement that says, “We already provide people with controls around the ads they see. And in the coming year, we’re looking to make them even stronger as well as exploring additional safeguards.” And they added, “We understand that certain games or products can impact some people differently than others.” |
Nate Halverson: |
We’re back at Suzie’s house on a hot night outside Dallas. |
Suzie Kelly: |
Go lay down. |
Nate Halverson: |
Suzie has joined a 12 step program for addicts and has finally stopped spending money on Big Fish. And Suzie’s husband, Chuck, who stormed out when he learned how much she spent, he wasn’t gone for long. |
Suzie Kelly: |
Did you ever contemplate leaving me? |
Chuck: |
It was what was going through my mind when I left, but that was never going to happen. We’ve been together for 32 years. I’m not going to throw away 32 years of happiness because she messed up. And my mindset was, “Okay, what do we need to do to fix this?” Realized that if I took out another loan from my 401k that I could probably just struggle to get by. We’re still catching up at this point. Can I go eat my dinner now? |
Suzie Kelly: |
Sure [inaudible 00:38:36]. I love you. |
Chuck: |
I love you too. I’m here for you and I’ll do whatever it takes to make things right here and help you with anything you need. |
Suzie Kelly: |
Go eat dinner. |
Nate Halverson: |
Suzie Kelly joined a class action lawsuit against Big Fish and is asking for her money back. The lawsuit alleges these social casinos are illegal gambling, which the company denies. Since the pandemic hit, people stuck in their homes are increasingly turning to digital games to pass the time. According to Nielsen data, people spent more than $10 billion in March, an all time record. |
Nate Halverson: |
In a moment we’ll walk further into the new frontier where companies watch our every move, then turn our personal data into profits. |
Al Letson: |
That’s not good. You need permission for that. That’s creepy. |
Nate Halverson: |
You’re listening to Reveal. |
Al Letson: |
From the Center For Investigative Reporting and PRX, this is Reveal. I’m Al Letson, and I’m back again with our reporter Nate Halverson. |
Nate Halverson: |
Hey, Al. |
Al Letson: |
Hi, man. So in this hour we’ve heard you get tips from stories at a dive bar in San Francisco, which you didn’t invite me to, a ski hut in the middle of nowhere, which you definitely didn’t invite me to, and if I understand this last story correctly, it starts in your own living room, which you haven’t invited me to. |
Nate Halverson: |
Nope, that is right. I came home one day after work, plopped down in front of the television, turned on my TV and this little window pops up. |
Al Letson: |
And what’s it say? |
Nate Halverson: |
It says, I’m entitled to money from a class action lawsuit against my TV maker Vizio. Now Vizio denies wrongdoing, but the lawsuit alleged Vizio violated privacy and consumer laws by collecting viewing data for sale to advertisers. |
Al Letson: |
Like Vizio was watching what you watched? |
Nate Halverson: |
Yeah, it was like they were watching me watch the TV, you know, tracking what I watch and then selling that to advertisers. They actually kind of reminded me of how Suzie from our last story was being tracked as she played the game. |
Al Letson: |
Is that legal? |
Nate Halverson: |
I honestly didn’t know but I wanted to know. |
Al Letson: |
But you had your hands full with the Facebook stories and so we asked Reveal’s, Ike Sriskandarajah, to take it from here. |
Ike Sriskandara…: |
If you want to learn about new TVs, this is a pretty good place to start. Do you work in this department? |
Speaker 17: |
Yes. |
Ike Sriskandara…: |
In the TV department? |
Speaker 17: |
Yup. |
Ike Sriskandara…: |
Last summer I went to the Best Buy in downtown Brooklyn. Do you think you could walk me through some of the TV models. |
Speaker 17: |
Which TV would you like to see? The new stuff? |
Ike Sriskandara…: |
Most TVs now have a built in computer that lets you stream from any service. |
Speaker 17: |
There’s a Netflix button, you press it, take you right to Netflix. Press it again, you can leave Netflix and it’ll take you right to Amazon Prime. You could place orders and stuff on here too. |
Ike Sriskandara…: |
So you can shop on your TV? |
Speaker 17: |
Mm-hmm (affirmative). |
Ike Sriskandara…: |
This year, the television industry is predicting they will sell about 260 million TVs and the vast majority of those will be internet connected. |
Speaker 17: |
And we sold almost all of them, we’re Best Buy, it’s what we do. |
Ike Sriskandara…: |
Vizio based in Southern California is one of the two biggest makers of smart TVs, they’re also one of the cheapest. So how do you sell high def big screen TVs that can connect to the internet for just a couple of hundred bucks? Well, it seems like you’re actually helping offset the cost while you watch through advertising. |
Ike Sriskandara…: |
See, their smart TVs were tracking what you watch and selling that data to advertisers without asking. |
Al Letson: |
That’s not good. You need permission for that. That’s creepy. |
Ike Sriskandara…: |
Creepy and completely under the radar until, that is, someone figured out what was going on. |
Ross Dickey: |
Okay. My name is Ross Dickey and I was a security researcher at Avast. |
Ike Sriskandara…: |
Avast is a company that makes antivirus software. And back in 2015, Ross and a few colleagues were working at their office in Austin. They wanted to know, did these new smart TVs protect your privacy? So they borrowed the company credit card and bought one of every major brand. And of all of them, Vizio, was the easiest to hack. Once they got inside the TV’s operating system, they noticed it was up to something. |
Ross Dickey: |
There’s a server that would automatically start sending information to, and we’d see that it’s sending this information once a second. |
Ike Sriskandara…: |
Every second the TV was uploading a fingerprint made out of the pixels on your screen. |
Ross Dickey: |
And it should be able to compare that fingerprint to a database and figure out what show it is that you’re watching and when. |
Ike Sriskandara…: |
So let’s say you’re watching your favorite cable news show. |
Speaker 19: |
President is delivering on his promise to buy American and hire… |
Ike Sriskandara…: |
It takes a snapshot. And if you flip over to Netflix, it takes a snapshot. Even if you watch something kind of steamy from your own DVD collection that you’d really rather keep private- |
Speaker 20: |
What do you do? |
Speaker 21: |
I produce records. |
Speaker 20: |
That’s good. |
Ike Sriskandara…: |
You guessed it. There was a second by second record of everything you watched that then got uploaded, matched to a database of TVs and movies, and sold to advertisers. Ross says, “Most viewers had no idea.” |
Ross Dickey: |
As a consumer you want to trust the companies that are creating the products that you use to not violate your privacy or trust them to be secure. But really what the reality is, is that you can’t trust them. |
Speaker 22: |
Smart and spying going hand in hand when it comes to Vizio’s TVs. |
Speaker 23: |
So viewers can be tracked across their phones, across their computer, across everything. |
Speaker 22: |
And you know what’s really interesting is there’s really no law that says any TV manufacturer cannot do this so- |
Speaker 23: |
You’re being watched America. |
Ike Sriskandara…: |
That’s when the Federal Trade Commission tuned in. |
Kevin Moriarty: |
The FTC started investigating Vizio in the fall of 2015. |
Ike Sriskandara…: |
This is Kevin Moriarty, a lawyer at the FTC. And for him flags went up because on the one hand Visy was saying nothing about tracking to consumers, but on the other hand, they were bragging about it to investors saying that they can offer the most accurate, real-time information about what people are watching. |
Kevin Moriarty: |
Essentially that, “Hey, look, we have this massive trove of television viewing data that tells us all of these minute details about the television viewing habits of Vizio consumers.” |
Ike Sriskandara…: |
While the government was getting their case going, there was another case against Vizio, this one was a class action lawsuit. One of their arguments was that Vizio violated something called the Video Privacy Protection Act. A law written back in the ’80s when people rented movies on VHS. |
Ike Sriskandara…: |
At the time Ronald Reagan had nominated conservative Judge Robert Bork to the Supreme Court. Bork testified that the constitution didn’t guarantee a general right to privacy. |
Speaker 25: |
But be that as it may, let me illustrate my objection to what this generalized right of privacy suppose- |
Ike Sriskandara…: |
So an enterprising reporter at a DC paper went to Judge Bork’s video store, asked for a list of the nominees rental history and put it in the paper. Nothing too salacious, one slightly troubling movie, the Michael Douglas thriller, Star Chamber, about a clandestine group of judges who take the law into their own hands. Anyway, it wasn’t the thing that ultimately killed Bork’s nomination, but it did motivate lawmakers to quickly pass this act that made video rentals private. |
Speaker 25: |
To reserve personal privacy with respect to the rental purchase or delivery of videotapes or similar audio visual materials. And the use of library- |
Ike Sriskandara…: |
That 30 year old law gave class action lawyers the grounds to sue Vizio for illegally sharing the current version of viewers video rental history. And in 2018, it led to a $17 million settlement and that message that popped up on Nate’s TV screen. |
Ike Sriskandara…: |
Meanwhile, the FTC, the government agency that regulates our privacy online, is relying on an even older law created during the FDR administration to curb deceptive and unfair business practices. |
Kevin Moriarty: |
So this is a law that was passed in 1938, and Congress certainly wasn’t thinking about computers or the internet or smart televisions when it passed it. And so one of the challenges that the FTC has is to apply this law in an area that is really unanticipated by the original statute. |
Ike Sriskandara…: |
Eventually, Vizio settled with the government for $2.2 million. The company also agreed to delete as much data as they could from people who didn’t give permission and going forward to have really clear language, giving consumers the option to share their viewing data or not. |
Ike Sriskandara…: |
Meanwhile, the person who came up with Vizio’s tracking software is philosophical about getting sued by the FTC and class action lawyers. His name is Zeev Neumeier, and he’s the head of Vizio smart TV data tracking division. He compares the lawsuits to the story of Abraham in the Bible. |
Zeev Neumeier: |
Abraham was a good guy. Why does God put Abraham through so much grief? He gives Abraham the most amount of grief and says, “Look, he still believes.” |
Ike Sriskandara…: |
God is so pleased with Abraham’s devotion that he blesses his family and promises they will multiply and take over the cities of their enemies. Biblically speaking, I think Zeev is saying that Vizio was tested and in the end rewarded because Vizio got to help write the new rules for the whole smart TV industry. |
Zeev Neumeier: |
And we’re able to sit down and craft with them. And that’s why I don’t mind that so much because the end result is that we now have a privacy regime for television that I can be proud of. Right? And we had craft it. |
Ike Sriskandara…: |
He says Vizio now holds the gold standard for disclosure, something the rest of the internet should look at as a model. But the company, kind of like the devices they sell is a black box about how it all works. We asked to see some of the details that were in Vizio’s class action lawsuit, but a lot of it was under seal and Zeev didn’t want to talk about it. |
Zeev Neumeier: |
I cannot get into the details of the settlement notice for a whole variety of reasons. |
Ike Sriskandara…: |
In the meantime, Zeev and Vizio are still bullish on the company’s big data future. They recently partnered with Disney, NBC, and other companies to make a massive new push to use all that data to put tailored ads on your set and even your other smart devices. |
Ike Sriskandara…: |
But is there anything to stop these targeted ads from selling addictive products to the most addicted people like we heard in the last story? |
Zeev Neumeier: |
That’s a complicated question. The technology does not fix basic human nature. The market, however, does. Faster than the regulators in many ways. |
Ike Sriskandara…: |
The regulators? They don’t seem to have the same faith in the market that Zeev does and they’re trying to step up their game. Last year, the FTC chairman asked Congress to update their antiquated laws and give them money to hire more help. He counted 40 staffers at the FTC, working on protecting all Americans privacy online. The UK, for example, with a much smaller population, has about 500. |
Al Letson: |
That story from Reveal’s, Ike Sriskandarajah, who also was the lead producer for this week’s show along with Anayansi Diaz-Cortes. Taki Telonidis edited the show. Thanks to Victoria Baranetsky for her legal help. Thanks also to our director of TV and documentary, Amanda Pike, and to David Ritsher, Nikki Frick, Zach Stalford, Tom Kaufman, Angie Padesky, and Deirdre Bernoff. Our production manager is Mwende Hinojosa. Original score and sound design by the dynamic duo, J. Breezy, Mr. Jim Briggs and Fernando, my man yo, Arruda. They had help this week from Amy Mostafa and Claire [inaudible] Mullen. Our CEO is Christa Scharfenberg. Matt Thompson is our editor-in-chief. Our executive producer is Kevin Sullivan. Our theme music is by Camerado, Lightning. |
Al Letson: |
Support for Reveal is provided by the Reva and David Logan Foundation, the John D. and Catherine T. MacArthur Foundation, the Jonathan Logan Family Foundation, the Ford Foundation, the Heising-Simons Foundation, the Democracy Fund, and the Ethics and Excellence in Journalism Foundation. |
Al Letson: |
Reveal is a co-production of the Center for Investigative Reporting and PRX. I’m Al Letson. And remember, there is always more to the story. |
Speaker 27: |
From PRX. |