Volledige transcriptie van A First Look at Wiley: AFDO's New AI - Ep38 Jason Brill

missing something in the follow-up because you end up starting so many great conversations and you promise each other we'll get back to that later in the week. 00:02:21.520 --> 00:02:22.879 Though it never happens. 00:02:23.039 --> 00:02:34.000 And I never want to be in the scenario where I forgot to then follow up and I see them next year at the conference, and it dawns on me, oh man, we never kind of closed the loop on that other thing. 00:02:34.080 --> 00:02:37.599 And it happened a couple of times, which is why I have that fear of it. 00:02:38.080 --> 00:02:39.120 Yeah, I hear you. 00:02:39.360 --> 00:02:40.879 So it happened to me too. 00:02:41.280 --> 00:02:42.719 It was uh I you know it's funny. 00:02:42.800 --> 00:02:48.479 We were talking about before we were rolling that um it was the best conference ever. 00:02:48.639 --> 00:02:54.400 And actually, that those were the words I used to describe it in some readouts afterwards. 00:02:54.639 --> 00:03:00.879 And but you pointed out that you all have that conundrum and or say that quite frequently, and I have too. 00:03:01.039 --> 00:03:05.840 I said it last year about the conference, and so I guess it means they just keep getting better and better. 00:03:06.479 --> 00:03:07.280 Right, exactly. 00:03:07.360 --> 00:03:21.280 Yeah, I mean, and we just keep finding every year we find little ways or big ways or medium ways to just kind of continue to make the experience better for everyone else, for us to get better at doing it. 00:03:21.360 --> 00:03:26.400 Uh, and so it's really fine to look at those ways to see how we can do this better. 00:03:26.719 --> 00:03:30.879 And you guys do get also, I told Steve this when he was on recently. 00:03:31.120 --> 00:03:34.240 I also really appreciate that you get really nice hotels. 00:03:34.400 --> 00:03:42.080 You know, cost is obviously always a consideration, but there's one thing you can count on every year is afto is gonna be at a pretty decent hotel. 00:03:42.159 --> 00:03:44.080 And uh I appreciate that. 00:03:44.639 --> 00:03:45.520 Yeah, yeah, yeah. 00:03:45.680 --> 00:03:47.840 We don't get to spend much time in the rooms, right? 00:03:47.919 --> 00:03:49.840 Because there's just so much great stuff going on. 00:03:50.000 --> 00:03:54.080 But uh it's nice to know that when you get back up there, it's a it's a nice, comfortable room. 00:03:54.159 --> 00:03:56.800 And in the meeting spaces, they're always really great. 00:03:56.960 --> 00:04:01.280 This year, you know, I'm sure you'll agree, they felt really spacious. 00:04:01.439 --> 00:04:07.360 It felt like you could move around, um, but you still didn't miss a lot of that sort of interpersonal. 00:04:07.919 --> 00:04:15.360 No, that convention center was huge, but it it was uh easy to interact with, and you're right, it didn't separate people. 00:04:15.439 --> 00:04:17.279 It was really, really, really well done. 00:04:17.439 --> 00:04:19.040 Columbus was a great host city. 00:04:19.199 -->

00:04:21.040 Uh Columbus is one of those sleeper cities. 00:04:21.120 --> 00:04:26.639 Every time I go there, I'm like, Oh, yeah, I always forget about Columbus, but it's it's a it's a great Midwest city there. 00:04:26.879 --> 00:04:34.240 So you all like the AI workshop was great, but you all aren't just uh doing the enablement of workshops and conversation. 00:04:34.319 --> 00:04:45.040 You actually have been on the battlefield doing and have released the Wiley, which is named after the actually known as father of the FDA, and it got announced. 00:04:45.120 --> 00:04:50.240 So Steve didn't want to step on your announcements at AFDO, so he teased it. 00:04:50.560 --> 00:04:54.720 Um but I was there for the announcement while the announcement was in progress. 00:04:54.800 --> 00:04:56.399 I downloaded it and played with it. 00:04:56.720 --> 00:04:58.639 Um it's really, really cool. 00:04:58.879 --> 00:05:10.240 So thought it'd be great to have you back to tell the audience about Wiley because one of the things about AI is that it's really important for people to engage with it and use it. 00:05:10.399 --> 00:05:12.160 It doesn't cost anything. 00:05:12.399 --> 00:05:16.240 And because that's what keeps training it and making it sharper and better, right? 00:05:16.319 --> 00:05:23.360 So I thought maybe we could talk about it and hopefully get some people to give it a try if they haven't already and uh and see what it can do for them. 00:05:23.759 --> 00:05:25.040 Yeah, I would love that. 00:05:25.199 --> 00:05:28.399 Uh you know, just some some quick background. 00:05:28.560 --> 00:05:49.439 Um, a year and a half or two years ago, the uh uh at a recent board meeting, our board decided to make one of our priorities to uh embrace AI and find ways to make it easier for regulatory programs to use it, to improve the work that they do and improve public health. 00:05:49.519 --> 00:05:53.199 And and this covers many different ways to use AI. 00:05:53.360 --> 00:06:01.839 And this is just one that we're doing, one of you know, one of several that we're looking into, but this is one that we wanted to implement on our website. 00:06:02.079 --> 00:06:09.759 You know, website search, searching within a website, not Google search, sometimes could be kind of hit or miss. 00:06:10.000 --> 00:06:22.560 Um and we wanted, there's so many really great resources on afto.org that we wanted to make sure that people were finding the things that they needed to as quickly and easy as possible. 00:06:22.720 --> 00:06:38.240 If you're a regulator or an inspector in the field, you're working on an iPad, you're working on your phone, and you don't really have time to fumble around, and it's not super easy on some of those small screens to fumble around looking for some of the guidances and resources that we have on our site. 00:06:38.319 --> 00:06:42.240 And so this was kind of our way to make that a little bit easier. 00:06:42.560 --> 00:06:43.680 It's really smart. 00:06:43.920 --> 00:06:50.240 So as it is released now, and I'm sure you have a roadmap probably for where you see it going as well. 00:06:50.560 --> 00:07:01.199 How would you describe what you would tell the average person, let's say in regulatory, um, that hey, don't think Google, think wily. 00:07:01.439 --> 00:07:05.439 Kind of what's the the prime use case at initial launch? 00:07:06.079 --> 00:07:14.639 Yeah, so the prime use case right now is that it is trained on all of our YouTube content. 00:07:14.720 --> 00:07:23.360 So any webinars that we've done, any conference sessions, for example, that we've posted on YouTube when we get permission to do that, it's trained on all of that. 00:07:23.600 --> 00:07:31.279 So if there's been you know new inspector, you know, inspector training, it's got that information. 00:07:31.519 --> 00:07:35.759 So if you ask a question related to that, it's gonna give you the answer based on that. 00:07:35.920 --> 00:07:50.319 It's also uh trained on our A to Z resources page, which has hundreds, maybe thousands of resources, hand washing guidance, uh uh aseptic canning packaging guidance, um, all of that stuff. 00:07:50.399 --> 00:07:52.319 It's trained on our training. 00:07:52.399 --> 00:08:02.480 Uh so if you're looking for upcoming training, depending on whatever topic you're looking for, uh, you could ask it for train upcoming training in that field. 00:08:02.720 --> 00:08:08.319 And if we don't have anything, it might suggest on-demand training that we have, so webinars that we have. 00:08:08.560 --> 00:08:11.199 It's also trained on several of our directories. 00:08:11.279 --> 00:08:16.240 So one of the really cool things that we have on the AFTO site is our Connect with Experts tab. 00:08:16.319 --> 00:08:28.000 And so that's got a directory of state and local officials, it's got a retail program manager directory, it's got a subject matter expert directory, and a processing authority directory. 00:08:28.160 --> 00:08:30.319 Uh Wiley is trained on all of those. 00:08:30.480 --> 00:08:42.720 So as I'll show you, uh we'll do a quick demo, but you can say, hey, I need an aseptic canning uh subject matter expert or processing authority, and it will spit their contact information at you. 00:08:42.879 --> 00:08:55.279 And then you can, with like with any other LLM, you can say, okay, help me craft an email to one of these folks uh asking for you know SOPs on on that topic. 00:08:55.679 --> 00:09:00.879 That is that's actually really practical for even someone in the field, right? 00:09:01.120 --> 00:09:05.440 Like for certain instances, they can go right to their smartphone, ask Wiley. 00:09:05.919 --> 00:09:07.200 Yes, right, exactly. 00:09:07.519 --> 00:09:08.960 Where do you see it going over time? 00:09:09.679 --> 00:09:21.679 Is there is there and if you can't if it's not publicly announceable, I get it, but are there some other things you guys have in the in the hopper that you think kind of extends

naturally in the future from it? 00:09:22.240 --> 00:09:26.879 You know, I think uh I think it'll just get smarter. 00:09:27.039 --> 00:09:29.840 We've got other areas of the website that we can train it on. 00:09:30.000 --> 00:09:35.840 Uh we have a whole publications section of the website that we would you know ideally train it on. 00:09:36.000 --> 00:09:44.639 As we start rolling out more training opportunities, those will be included so it can help people uh find the training that they're looking for. 00:09:44.879 --> 00:09:52.879 You know, next year with the launch so close to conference, uh we didn't have the chance to really deeply integrate Wiley in the conference. 00:09:52.960 --> 00:10:02.720 And so I would hope that you know next year, and I think we should plan on next year making that integration a little bit closer so you can ask Wiley direct questions about the conference and get help. 00:10:02.960 --> 00:10:03.679 That's a great idea. 00:10:04.159 --> 00:10:15.759 Maybe I'm you know, I'm a retail program manager, I'm a retail food safety inspector, and uh help me pick out the best sessions uh at AEC to take. 00:10:15.840 --> 00:10:21.440 And and so I think I think that's not you know too out there or extreme for it to do. 00:10:21.679 --> 00:10:27.039 Beyond that, I don't know, we'll have to see like how much smarter or how much wiser Wiley gets. 00:10:27.519 --> 00:10:32.639 Well, I think you came prepared and really appreciate it to actually give us a a peek at it. 00:10:32.799 --> 00:10:47.840 Um so um yeah, let's let's show everybody uh how however you want to play with it here because uh and I really encourage everybody who's watching or listening, we will put a link to it in the description, download it, play with it, use it. 00:10:48.559 --> 00:10:49.360 It's a great resource. 00:10:49.440 --> 00:11:00.320 They're not asking for you to pay money to use it, and just keep in mind that it's the uh usage and the more interactions it gets, the smarter it gets. 00:11:00.399 --> 00:11:02.639 So you actually are helping train it to a degree. 00:11:03.440 --> 00:11:11.440 Yeah, you know, one of the important things with Wiley uh was that you don't have to be a member to use it. 00:11:11.600 --> 00:11:16.799 You know, you could join afto, and we love it when people do because it makes it so that we can do more things. 00:11:17.039 --> 00:11:21.519 But if you're not a member or you are a member, you get the same Wiley experience. 00:11:21.840 --> 00:11:24.720 And you know, we think that that's uh really important. 00:11:25.200 --> 00:11:30.080 So uh so here we are, we're just on the Afto homepage right now. 00:11:30.159 --> 00:11:32.240 There's a few different ways that you can get to Wiley. 00:11:32.320 --> 00:11:37.120 One of them is you can see him down here in the corner, uh, is a little ask Wiley the owl. 00:11:37.279 --> 00:11:44.240 Uh we went with an owl because you know, owls are wise and knowledgeable and help you find the

things that you're looking for. 00:11:44.399 --> 00:11:46.879 Uh so it just seems like a pretty great fit. 00:11:47.120 --> 00:11:52.159 So if I click Wiley down here, I get to his landing page. 00:11:52.480 --> 00:11:57.120 Um so here is the uh chat window you can start with. 00:11:57.279 --> 00:12:02.080 Uh we've also got some sections down here uh to browse by topics. 00:12:02.159 --> 00:12:08.080 So if you click any of these, it will just pop that question into Wiley and you could start your conversation. 00:12:08.480 --> 00:12:16.879 And then if we scroll a little bit further down, we have some more information about Wiley and some tips for uh the best results. 00:12:17.120 --> 00:12:18.960 He's in a couple other places. 00:12:19.200 --> 00:12:23.039 So if you go to our search page, he's there now. 00:12:23.200 --> 00:12:27.840 Uh he is also on our contact us page. 00:12:30.159 --> 00:12:38.480 And if you go to our A to Z resources page that I was talking about earlier, there is a search resources function that's always kind of been there. 00:12:38.639 --> 00:12:49.919 Now, if you search for hand washing guidance, everyone's gonna see how terrible I am at spelling things probably, and you hit search, uh, that opens a Wiley chat as well. 00:12:50.080 --> 00:12:53.440 Uh so there's a couple different ways to get to him. 00:12:53.600 --> 00:13:00.000 Another easy one is just afto.org slash askwily, and that gets you right to his landing page. 00:13:00.240 --> 00:13:05.679 Uh so I typed in hand washing guidance, and here's everything he gave me. 00:13:05.840 --> 00:13:08.559 So you could kind of go through all of these. 00:13:08.879 --> 00:13:12.879 Uh it'll, like I said, it'll link to some of our webinars. 00:13:13.120 --> 00:13:21.679 Uh it'll be trained on the FDA food code that we have available either through webinars or uh linked on our site. 00:13:21.919 --> 00:13:24.080 You know, he's he's a closed loop. 00:13:24.159 --> 00:13:26.080 So at uh Wiley is a closed loop. 00:13:26.159 --> 00:13:28.000 He's only trained on our content. 00:13:28.240 --> 00:13:35.600 So if we have a PDF that we're linking out to from a state agency or from the FDA, he's gonna send you to that link. 00:13:35.759 --> 00:13:41.120 He cannot be trained on that link since it's not an afto.org link. 00:13:41.200 --> 00:13:47.600 Uh, but if there's any other information that we have on that page, he'll be trained on that and then kick you to the actual guidance. 00:13:48.000 --> 00:13:48.480 Very cool. 00:13:48.639 --> 00:13:50.080 That's actually really important, right? 00:13:50.320 --> 00:13:58.320 Because um you're not just laying something on top of like Chat GPT or or one of the other frameworks. 00:13:58.480 --> 00:14:08.399 This is purpose-built, and it only knows what you've allowed it to know, which is verifiable data from within the AFTO ecosystem. 00:14:08.720 --> 00:14:09.840 Right, exactly. 00:14:10.000 --> 00:14:15.360 And like any other chatbot, though,

you know, you know, you need to check, you know, follow up on stuff. 00:14:15.519 --> 00:14:19.120 It's not like you know, the you know, the rule of law or the word of God or anything. 00:14:19.200 --> 00:14:27.840 So you still have to check some things, but based on AFTO, on AFTO info and afto resources, this is you know, this is the best information that you've got. 00:14:28.080 --> 00:14:32.000 So you can also go up here to start a new conversation. 00:14:32.480 --> 00:14:41.600 Uh so I thought we could start with um let's start with uh aseptic canning. 00:14:41.759 --> 00:14:50.639 So let's ask it if I need an aseptic canning subject matter. 00:14:55.919 --> 00:15:01.039 And so that little flashing uh bar is tells us that Wiley is thinking. 00:15:04.000 --> 00:15:12.159 And so here are some food some food processing authorities uh for aseptic processing, packaging, and canned foods. 00:15:12.320 --> 00:15:19.519 Uh it's got email addresses, phone numbers, and then it'll take you directly to their link in our directory. 00:15:19.679 --> 00:15:29.279 Uh it can also narrow down to uh low acid canned foods, acidified canned foods, beverage aseptic processing, and more. 00:15:29.600 --> 00:15:32.960 US that is really cool. 00:15:33.679 --> 00:15:40.320 In this recommended resources section, which is at the bottom of every answer, you can find out where it's pulling this information from. 00:15:40.559 --> 00:16:02.480 So we could, you know, let's let's ask about US versus Canada based versus That is really powerful to be able to get a list, because yeah, if you were trying to Google for those, it would take you forever. 00:16:03.200 --> 00:16:08.559 Yeah, so now it's broken out into US versus um versus Canada. 00:16:08.960 --> 00:16:30.000 So you can ask it, okay, so maybe I want to reach out to Wilfredo, so help me craft an email to Wilfredo about and this is where we're gonna uh bump into my lack of knowledge on a lot of food safety items, so bear with me. 00:16:30.159 --> 00:16:42.320 Um but help me craft an email to Wilfredo about crafting SOPs for let's say aseptic packaging. 00:16:47.919 --> 00:16:50.080 And while he is thinking for us. 00:16:51.200 --> 00:17:07.359 So just like any kind of other LLM that you will use, like it could craft an email for you, you could fill in the blanks, um, and then you could just you know hit the copy down here, and then you've got an email that you can paste in your email and make your own tweaks and personalize it in the ways that you want to. 00:17:07.440 --> 00:17:09.359 But like that's a pretty cool aspect. 00:17:09.440 --> 00:17:15.039 It's it can answer these questions for you, but then also help you with the outreach, which I think is really cool. 00:17:15.279 --> 00:17:18.480 And honestly, something that people expect from an LLM. 00:17:19.119 --> 00:17:24.720 Yeah, I think so many people now, well, in fact, with like Google products and Microsoft too, it's embedded, right? 00:17:24.799 --> 00:17:28.319 It'll like give you the underline to tell you that you could have said that better. 00:17:28.480 --> 00:17:35.519 I think people are really becoming very reliant on well, help me convey the message. 00:17:36.160 --> 00:17:36.720 Right. 00:17:37.039 --> 00:17:37.680 Right, right. 00:17:37.839 --> 00:17:41.359 So we can okay, so here's another cool one. 00:17:41.440 --> 00:17:45.839 Uh how about uh this is one of the features that I really think is cool. 00:17:46.000 --> 00:17:53.440 So I need hand washing guidance in Spanish. 00:17:57.039 --> 00:18:03.359 So one of the cool features that we have in A-Z resources is we have a big language translation section. 00:18:03.519 --> 00:18:10.880 I think there's more than 50 plus languages, uh, different food safety documents, posters, signs, stuff like that, all in these different languages. 00:18:11.039 --> 00:18:12.400 Oh, that's really cool. 00:18:12.720 --> 00:18:19.599 Yeah, so here we have uh all of these now posters, signs, fact sheets, and guidance. 00:18:19.759 --> 00:18:34.960 So we can go ahead and click on that, and that'll take us to a Spanish language document about hand washing that you can then you know share with uh share with restaurants, share with retail locations, stuff like that, just to help them. 00:18:35.599 --> 00:18:42.160 I'm a retail inspector, I'm out in the field and I am like these people need some some information. 00:18:42.319 --> 00:18:51.680 I could literally go to it there and then email them, it looks like that attachment with the hand washing criteria in a language that that they will understand it in. 00:18:52.079 --> 00:18:53.200 Yeah, right, exactly. 00:18:53.359 --> 00:18:56.240 You could download it, send it to them, you could send them the link. 00:18:56.400 --> 00:19:13.759 Um, and uh, I'm not going to try to type in Spanish, but you can also talk to Wiley in dozens of languages, and it will understand them, reply in that language if you need it to, and help you find everything, you know, help you find stuff that you're looking for. 00:19:14.000 --> 00:19:20.799 So I know we're off the road here, and neither of us, it sounds like are uh confident speaking Spanish, but what happens if you like say Oa to it? 00:19:21.279 --> 00:19:22.880 Will it speak back in Spanish? 00:19:26.799 --> 00:19:27.200 I know. 00:19:30.160 --> 00:19:31.200 Wow, it does. 00:19:31.519 --> 00:19:32.400 That's really cool. 00:19:32.799 --> 00:19:37.119 Because what I like about that is it's not pressed one for English, two for Spanish. 00:19:37.279 --> 00:19:45.599 You just sit down and start talking to it in whatever language you speak, as long as it's one of the several dozen it sounds like that that it can interact in. 00:19:46.000 --> 00:19:46.559 Right, right. 00:19:46.880 --> 00:19:47.279 Very cool. 00:19:47.599 --> 00:19:49.599 Uh it's it's yeah, it's really neat. 00:19:49.759 --> 00:19:55.759 So one other one that I like that's kind of cool, uh, that c can highlight

some of Apto's training resources. 00:19:56.160 --> 00:20:11.920 Okay, say I'm a I'm a new inspector, I'm a new food safety inspector, and I, you know, I've gotten great training, you know, sort of onboarding training from uh my program manager, people in my agency, but I need to I want to find out what else is out there. 00:20:12.079 --> 00:20:17.680 So let's say I'm I'm a new inspector. 00:20:19.599 --> 00:20:24.799 What resources should I start with? 00:20:27.680 --> 00:20:28.319 That's a good one. 00:20:28.720 --> 00:20:32.000 Right, like I think that that's a I think that's gonna be, you know, a common thing. 00:20:32.160 --> 00:20:36.960 People wanna make sure that they get great at their job and they're going to be looking for some resources. 00:20:37.200 --> 00:20:38.000 It is the number one thing. 00:20:38.240 --> 00:20:39.359 Let's see what Wiley tells us. 00:20:39.680 --> 00:20:44.720 It is one of the number one things that we get in emails to the show. 00:20:45.359 --> 00:20:50.400 People saying, I don't feel like I was trained well, uh or I'm relatively new to this. 00:20:50.720 --> 00:20:53.680 We get that question a lot from the audience. 00:20:54.400 --> 00:21:01.279 So now they actually can they can do something about it and and actually get some some resources as Wiley thinks about it here. 00:21:01.920 --> 00:21:04.240 I think Wiley's thinking a little too long though. 00:21:04.640 --> 00:21:06.079 Usually it doesn't take this long to think. 00:21:06.240 --> 00:21:08.559 I might have stumped him by switching from Spanish to English. 00:21:08.640 --> 00:21:11.119 So I wonder if he's like, wait a minute, what's pick? 00:21:11.279 --> 00:21:12.400 Did you pick Elaine? 00:21:12.640 --> 00:21:17.839 Um if you're not um if it's not publicly disclosable, I understand. 00:21:17.920 --> 00:21:21.519 But what what model or models did you use underneath it? 00:21:21.680 --> 00:21:24.799 Uh obviously they're all hived off, only trained on your stuff. 00:21:24.960 --> 00:21:29.519 But um, was there a particular model that you're able to disclose you're using? 00:21:30.160 --> 00:21:32.720 So I don't, I actually don't know what the model is. 00:21:32.880 --> 00:21:43.599 I can tell you the company that we worked with uh is called Betty AI, uh, and they work with a lot of nonprofits and associations for these closed loop LLMs. 00:21:43.920 --> 00:21:45.440 Working with them was great. 00:21:45.680 --> 00:21:54.000 They sort of took in uh everything that that we explained that we needed and how we wanted it to work, and and they were they were really terrific to work with. 00:21:54.160 --> 00:21:58.720 We did this, we started these conversations earlier this year. 00:21:58.799 --> 00:22:03.279 Uh so to kind of get to the product that we're at now is really cool. 00:22:03.359 --> 00:22:06.799 It's a testament to the work that that they did that they were able to help us with. 00:22:06.880 --> 00:22:10.160 But I yeah I don't know what model it's

uh it's running on. 00:22:10.400 --> 00:22:11.039 Fair fair enough. 00:22:11.119 --> 00:22:13.119 And they change so frequently too. 00:22:14.240 --> 00:22:18.400 So let's let's start a new conversation and ask the same question. 00:22:18.799 --> 00:22:21.359 Because I really think it's a cool answer. 00:22:22.160 --> 00:22:32.799 And they for just for the audience to clarify I I I find myself always falling into this where I'll use acronyms like LLM or large language model is is what LLM is. 00:22:32.880 --> 00:22:43.359 So just uh don't leave anybody out there hanging by using an acronym which we're good at in the government regulatory side but let's see I'm a new food safety inspector. 00:22:43.680 --> 00:23:23.920 Oh yeah you're re you uh I see there we go they came back with a lot yeah so it takes you to our uh inspector boot camp which is super popular we have thousands of people take that every year uh it takes you to our basic inspections investigation course uh so it comes back with a lot you could ask it to then create a checklist for you uh I'm a new food safety inspector create a checklist for me on things that I need to make sure that I'm learning uh you know it's it's really cool it kind of you know it's it's it's a chatbot that really helps you kind of get to what you're looking for. 00:23:24.160 --> 00:23:29.599 And there's been so many conversations about this with many people on this episode here. 00:23:29.920 --> 00:23:41.279 That's more just right there with the in the amount of time it took it to do that which was not much that's more than a lot of folks we talk about the new inspector scenario and we hear about it. 00:23:41.839 --> 00:23:53.279 That's more detail and links to stuff than a lot of them get when they get onboarded initially so that's actually really meaningful and in some cases more than they have gotten even from where they were hired. 00:23:54.000 --> 00:24:15.359 Yeah yeah so it's it's it's really powerful and it's fun to I'm excited to see how uh people are going to use it you know we can see uh on our end sort of the things that people are searching for we can find out if they're not getting the info that they need you know one thing that I want to point out that's really important as people start start using it is to use these feedback buttons at the bottom. 00:24:15.519 --> 00:24:24.720 If it gives you an answer that you like give it a thumbs up if it gives you an answer that isn't exactly what you were looking for please give it negative feedback. 00:24:25.119 --> 00:24:35.279 You can type in what you were looking for and that's you know hard in the pun, but it's going to help Wiley get wiser uh and that's uh it's only going to make it more powerful. 00:24:35.359 --> 00:24:38.400 So we really want people to provide that kind of feedback. 00:24:38.720 --> 00:24:44.720 Yeah because again this is not feedback that's only like you have to wait for a human to get it. 00:24:44.799 --> 00:25:00.160 I think so

often people are in the old almost Yelp world of the internet where they're like well if I send this through is anybody ever going to read it but that's not even the primary purpose here right Wiley reads it and it helps help him get better next time. 00:25:00.319 --> 00:25:56.640 So the the feedback literally every piece of feedback gets accounted for yeah definitely uh let's see what's another I can we can do one more uh one more sort of demo that I think is pretty neat so let's say uh write a hand washing SOP for a retail no that is that is that's powerful and a lot more reliable than going to chat GPT for it I can promise you that even though we haven't seen the answer yet so it gives you I mean it's it's really robust it gives you a lot of information and again like we like we mentioned it's got all these recommended resources down at the bottom so you can compare those things against the answer and make sure that you got accurate information. 00:25:59.839 --> 00:27:58.160 But yeah it gives you a starting point it's it's pretty cool yeah so I um is the citations for this uh is that all pulled from afto's repository or like because this is a lot of this a lot here and it looks really really accurate and like English food safety hand washing materials did that is that afto generated material or is that uh links out to multiple places at times so it links out to multiple places so this is part of our A to Z resources that a bunch of uh members of our team have worked on to find these documents to verify them you mostly they're coming from other agencies so other state agencies local agencies who have put these together and you know then they're linked on their website so this is our English food safety document section which is what it took us to so we can go to where is hand washing well we can go let's go to like food handler and then we can see so Boulder County Public Health Southern Nevada Health District Massachusetts partner for food safety education so these are all vetted by our staffers and then shared and then it takes you to Franklin County yeah I bet you hers is because uh she's uh she keeps up with her stuff uh there in uh Franklin County I'll have to remove that other link that is uh no there's a lot of them there so David I think you had a question too like because once you pull that up and if you're in let's say Sioux City, Iowa right yeah like if if you're in a particular area and you want that particular set of rules or food safety stuff for that establishment in that area will Wiley give us that information dependent upon the geographic location you give it? 00:27:58.799 --> 00:28:05.359 Yeah so let's Okay so what are the hand washing? 00:28:05.599 --> 00:28:06.559 Should we do hand washing again? 00:28:06.799 --> 00:29:05.039 Yeah we keep yeah that's like hand washing in Charlotte North Carolina Okay so it gives you uh program details for North Carolina North Carolina food code manual there it is yeah and they've got hand washing guidance that wow it is so so this is so this is for Minnesota so it gives you some general guidance no that's really cool though because it's got the director's contact right and the having the food code manual there all the hand washing stuff is definitely in there well that last line for the most direct local interpretation contact the Mecklenburg County public health that's that's pretty cool. 00:29:05.359 --> 00:29:26.079 That is that it says you guys like so you know sometimes people will throw out things and call them AI these days and then in reality you're like it's really early this is really complete this is this is like it's it's doing uh a lot well that a lot of AIs for various purposes that have been released have not passed that test. 00:29:27.279 --> 00:29:36.000 Yeah and you know we wanted to make sure that that this acted like people are used to AI acting now. 00:29:36.079 --> 00:29:54.240 So when they use ChatGPT when they use claude when they use copilot you we did not want something that was just kind of like a decision tree sort of chat out that you no shade but that you run into like on your cell phone provider right like where it's just like that very predictable sort of responses. 00:29:54.640 --> 00:30:00.640 We wanted something that was natural language that that was something similar to what people are used to using. 00:30:01.039 --> 00:30:22.799 Yeah no it's really cool and I actually just think the function of being able to say here's who you should call for direct local interpretation there's a lot of times where people would have the need to you know go want to need to speak to somebody potentially another jurisdiction um this makes it so simple. 00:30:22.960 --> 00:30:30.079 Like it literally doesn't like give you a directory of numbers it tells you here's who you call if you've got a question about the code. 00:30:30.640 --> 00:30:40.079 And like what's really cool too is like when in the earlier example when we're looking at the processing authorities uh it tells you what some of their specialties are. 00:30:40.240 --> 00:30:50.400 So even if we're looking for aseptic canning or aseptic packaging uh it could tell you some of their other specialties as well and so I think that's really pretty powerful. 00:30:50.480 --> 00:30:56.240 And obviously if you're looking for that in it with Wiley it it will deliver those answers. 00:30:56.640 --> 00:31:48.240 This has got to be hard for you guys to budget for right because of like you know tokens and the AI processing time as this gets popular that's um it's a pretty significant endeavor that afto's committed to yeah definitely yeah it is uh you know big time commitment obviously over the last three or four months uh and going forward right to make sure that we're we're keeping an eye on on how people are using it uh if they're finding the things that they need you know one of the other really nice things is as we can go back and look at some of the insights uh

uh some of the analytics that we have access to we can find out hey a lot of people are asking this one question and not getting a great answer from us that means that that content is probably missing on our website and then we can go back look at ways to create that content and get it into Wiley. 00:31:48.319 --> 00:31:49.680 So that's pretty powerful too. 00:31:49.920 --> 00:32:24.160 Yeah this this is very very well done literally this is something that there's something here for everybody whether you're an inspector in any state USA or in leadership there's stuff here for you and it it is it's a lot faster and I think most people have figured out by now don't trust chat GPT or the other ones full stop because they don't I I said this at the AI workshop during the panel a question somebody asked they're trained on Reddit I rest my case like right and so you're just not going to get curated information. 00:32:24.319 --> 00:32:40.799 David you say you had something else yeah I had just another general question how how do you see the public using this or is this more for professionals inside the EH realm so I think I think this is probably more for professionals. 00:32:40.960 --> 00:32:47.279 I think that this is going to be used a lot by regulators I'm hoping it gets used a lot by industry. 00:32:48.079 --> 00:33:00.319 I think industry can use it to find their state and local officials I think that they can use it to find some of the processing authorities and some of our training we have a lot of training that's open to industry. 00:33:00.480 --> 00:33:03.200 So I really hope that they can find a way to use it. 00:33:03.440 --> 00:33:38.960 You know I think if the general public finds their way to it might ask for uh inspection reports on restaurants in their location uh that's something that I think that we can eventually train it to do obviously like the inspection reports don't live on AFTO um but like okay let's let's try it um uh show me restaurant inspection reports or let's not pick on Charlotte where else should we go? 00:33:39.359 --> 00:34:19.360 Well we were just in Columbus yeah great minds think alike and look at that it's uh health space address so we can scroll down Oh you've got 'em all there yeah uh and we can go to the Department of Health nope let's see they move their pay I think they move their URL and so it just probably hasn't updated itself yet. 00:34:19.679 --> 00:34:22.239 Yeah so we need to we need to fix that. 00:34:23.039 --> 00:34:39.039 I'll just pick another story but but by the way folks this is how you know this is really well built and ready for prime time we did not discuss any scenarios in advance before we started talking on camera today. 00:34:39.280 --> 00:35:56.719 We just rolled with it and notice that he's put in every prompt we're like hey what about this that's how you know so yeah so we have the food establishment scores here for Alaska and so you can go to the inspection reports and then you're at

this point right you're on you know you're on Alaska's um oh no sorry Alabama not Alaska um but now you're you know you're in their world so yeah whatever they choose to post don't blame Wiley it's it can only reveal what they post right yeah no this is this is a fun but this is really phenomenal honestly it's it was more robust in v1 than I would have probably even guessed um how long did y'all work on this yeah I mean we we probably started having conversations with the Betty AI team in just conversations in like February I think um so we spent most of the second half of March and April doing just a lot of testing uh we would have a lot of members of our team uh sort of test this out and I think that's where we really got to some of these cool features and making sure that all of that directory information was available. 00:35:56.960 --> 00:36:00.559 So like three three and a half four months. 00:36:00.880 --> 00:36:01.840 That's really fast. 00:36:02.000 --> 00:36:04.639 Of course that's that's a hallmark of AI. 00:36:04.960 --> 00:36:24.880 And imagine where it'll be in a year as you get additional feedback you look at the analytics and you see oh wow people are really hitting this hard like and it'll make AFTO's resource library and website better as at the same time right because it also helps you all continue to round out the wealth of information you have in your knowledge bases. 00:36:25.199 --> 00:36:25.519 Right. 00:36:25.679 --> 00:36:30.639 Like we'll be able to find out what we're missing and fill in those gaps. 00:36:30.719 --> 00:36:34.480 So it's going to help us create a more robust experience too. 00:36:34.800 --> 00:37:02.480 Really really appreciate you giving us this demo so um I quick question for you as the director of comms you probably would know uh you guys had at the um the unveiling at the general session he had his own little jingle and animation like um who wrote that AI AI right that's good answer it actually really fit and it worked for the for what you were unveiling there. 00:37:03.119 --> 00:37:22.800 And if and I don't want to get ahead of of of private conversations and plans but I know that Steve and you all at AFTO have a lot of other conversations going on some other AI initiatives that probably at some point will all enhance one another and I do think yeah we talked about this at the AI workshop in Columbus. 00:37:22.960 --> 00:37:49.360 I do think over the next couple of years that gap between all that regulatory inspection data and the big brands who would like to have it timely and be able to then use it in their QA think that gap's going to get closed and AI's the difference maker there right because you could never normalize that many different flavors of the food code down to a brand standard AI turned that on its head. 00:37:49.760 --> 00:37:50.079 Right. 00:37:50.239 --> 00:37:52.960 Yeah like I I just think like this is great. 00:37:53.199 --> 00:38:05.760 Love Wiley but some of the things that I

think are coming down uh the pike are very cool and could have really significant positive outcomes for public health. 00:38:06.079 --> 00:38:21.519 I I agree and I I wouldn't claim to know all of them but I know on a couple of them I'm I'm aware of some of those details and I just I do I think it's going to shake up everything but in a really really good way that actually just again it's in the interest of public health. 00:38:21.679 --> 00:38:27.360 So it's going to be exciting and it's just exciting to see the organization afto actually take the lead on it. 00:38:27.440 --> 00:39:56.000 It's a lot easier to do some of these moonshots especially around data if you've got a you know a unifying force sort of helping stick to the path because everybody if it's industry they have their own interests uh regulatory has their interests somebody's got to kind of be the weight in the middle and it seems that after's really stepping into that role and the innovation's gonna roll yeah I I mean and you saw it at at the conference you know going back to that like we had the AI workshop but there were four or five maybe even six other sessions that I was in to get in people's way and take photos and make them mad at me uh that talked about AI uh really openly too uh about people's concerns about its capability you know we really there was a lot of really great innovation talk at the conference there was and I that actually I did really that jumped out to me because I was like there's been a lot of hesitancy in the la over the last two three years as AI was coming on board people are like well we we can't afford to lose any more staff and and I think people are starting to realize AI for regulatory especially is not going to replace the inspectors you've got but it will like every department has you know FTEs on paper or maybe in next year's budget but it's not actually a live human doing work for you. 00:39:56.159 --> 00:40:09.039 AI will be good at helping you bridge those gaps but I I think people have finally gotten their mind around that because you're right AI was actually a ubiquitous topic all throughout the halls of the conference in Columbus. 00:40:09.119 --> 00:40:15.119 Yeah so well I know we've kept you longer then but congratulations like this is really fine work. 00:40:16.000 --> 00:40:23.840 Being involved in a couple of AI projects this is really you guys really did a great job and and your partners on that really did. 00:40:24.079 --> 00:40:34.239 So uh the best way for people to find it and we'll put a link to it in the description is it uh just for ease is it afto.org slash ask wily or or how would you recommend it? 00:40:34.559 --> 00:40:42.320 I would I yeah afto.org slash askwily w I l e y uh and that'll take you right to them. 00:40:42.639 --> 00:40:50.719 And whatever platform you're watching this on YouTube, Spotify, Apple, etc, if you look down in the description of the episode, we will have a link to it. 00:40:50.960 --> 00:40:53.760 I really I encourage everybody if you're watching it click it. 00:40:53.920 --> 00:40:55.760 Ask it a question just like he did. 00:40:55.920 --> 00:41:00.400 So I I think you actually illustrated the perfect thing is you don't have to be afraid of it. 00:41:00.559 --> 00:41:01.360 Just ask it. 00:41:01.679 --> 00:41:10.400 The worst thing that could happen is it says I don't know or you know or it you need to clarify be bold with it right and and it helps it grow. 00:41:10.719 --> 00:41:19.119 Yeah absolutely like there's also there's nothing wrong with saying hey here's my job title here's what I do here's my biggest concern right now how can you help me? 00:41:19.440 --> 00:41:23.039 It's okay to not even know it's okay to just ask it. 00:41:23.280 --> 00:41:30.480 Yes and uh but don't ask it for a dinner recommendation or to give you a recipe for something that's not Wiley's job. 00:41:30.719 --> 00:41:40.639 No I did actually it handles it gracefully I did ask it for a recipe when I was sitting there the night you unveiled it because I was just curious how will it tell me bug off. 00:41:40.880 --> 00:41:41.920 It was it did good. 00:41:42.000 --> 00:41:43.360 It did really really well with it. 00:41:43.519 --> 00:41:58.320 So hey if you don't mind please keep us posted as on how it's going and and because we'd love to you know have you back or if you make any additional leaps with it please let us know and we'd love to like help pump that information out there. 00:41:58.559 --> 00:42:06.320 But I I wish more people had done things like this sooner but congrats to AFTO for actually acting on it and having it in the world. 00:42:06.719 --> 00:42:10.719 Yeah thank you thank you it's it's it was a blast to work on for all of us. 00:42:10.880 --> 00:42:13.280 So we're we're just excited that it's out there now. 00:42:13.760 --> 00:42:27.039 We are too we're that everybody go click that link play with it download it'll really make your life better and thank you uh Carrie Jennifer Steve yourself and I know I'm missing a lot of other people that worked hard behind the scenes but thank you all for the work. 00:42:27.119 --> 00:42:36.880 It's not easy putting on a conference like that and it's well done every year but thank you very much for a great conference and for a great experience for the attendees. 00:42:37.920 --> 00:42:41.840 Yeah sure thing all right we will definitely have you back talk to you all soon. 00:42:42.079 --> 00:42:49.360 All right that's Wiley afto.org slash ask wily W I L E Y please go play with it. 00:42:49.519 --> 00:42:55.840 As you saw in that great demo Jason just said there's a lot of cool resources especially if you're a regulator or in industry. 00:42:56.079 --> 00:43:01.679 For all of us here at the Beyond Data Management Podcast powered by HSGov Tech I'm Cameron Garrison. 00:43:01.840 --> 00:43:04.400 We will see you back here next week same time same channel. 00:43:04.480 --> 00:43:06.000 Have a great one everybody