|
Stepping onto the bandwagon before it fully departs, AI technology behind Google’s Bard chatbot is being embedded into Search, as announced at Google’s I/O conference, whose theme was all about how everything is being re-engineered to embrace generative AI. El Reg has neatly summarized the keynote here if you’re interested to learn more (“We sat through the Chocolate Factory’s PR blitz so you don’t have to”). Google announced copilot-like functionality for its cloud productivity suite while Microsoft unveiled the M365 Copilot preview that’s been running for a few months, is being extended further. Not all is rosy in the garden of AI, however. Distinguished scientist Geoffrey Hinton, a Turing Award winner and widely-described as “Godfather of AI”, has walked out of his Googly role amid concerns that AI will become sentient and enslave or kill us all. Interestingly, Hinton did not sign the Elon Musk-backed petition to halt AI development, effectively saying that if those currently working on it were to stop, others would pick up the baton. Microsoft’s chief scientist agrees.
The expanded M365 Copilot preview is a “paid-for” thing, and Microsoft’s Q3 earnings call did mention that Copilot will be additionally priced over and above whatever Office licenses a customer already has (though some AI related features will show up in E3/E5 licensed environments, such as the new Semantic Index which can be harnessed by Copilot but will be useful for giving more accurate search results even if Copilot is not in use).
Back in the present, there are some relatively new practical capabilities in both Bing AI and in the Edge browser’s discover feature, as discused in last week’s ToW. The Compose feature in the Sidebar lets you play with generating different types of written content, the kind of thing which will be integral to Copilot in all kinds of Office applications before long. The Insights tab on the same Sidebar gives you more info on the page you’re currently looking at, from a summary of the key points of the page, to some background on where that site is accessed from, how likely it is to be reliable and more.
The core Bing AI search in a browser – in case you’re itchy about using Edge or its Bing Sidebar – has some new Another one of OpenAI’s groovy tools – Dall-E – generates images based on a text description, and Bing AI chat can feed directly into that. The image generation capability is now multi-lingual (with over 100 languages supported). It will also soon be possible to upload images to Chat, so you could ask it questions about what’s in the image. All free for now, but someday soon, we will need to pay the ferryman or the robot overlords will wreak their revenge. |
Category: AI
680 – Edgy emails
The Edge browser has seen a lot of change in its life. Originally conceived as a successor to Internet Explorer, with its own modern web rendering engine and lots of additional features which are designed to complement the usage experience, like taking handwritten notes on top of a webpage or building a Reading List of pages or publications to come back to.
Later, the decision was taken to replace the browser with one based on a new core using Chromium, largely for reasons of compatibility and performance, but to carry on building new capability that would differentiate the new Edge browser from others that also use the Chromium rendering engine, including Google Chrome itself.
Recent builds of Edge have a Sidebar which includes a load of apps and integrations – the goal being that it can help multitask on the web by sharing complementary information or functionality alongside the page the user is looking at; think a shopping widget that would compare prices of the product on the page you’re viewing, showing where else you could buy that same thing.
A recent update to the Sidebar has been the inclusion of the new Bing search, which adds some very cool relevance capabilities that would allow you to fire the current page content straight at the Bing’s AI engine to summarize, rewrite or explain the contents – selected text, or the entire page you’re visiting.
Here’s an example of a reasonably detailed blog article (from early 2021) summarized into a few key paragraphs:
One of the more useful integrations in the Sidebar is the Outlook app (individual icons on the Sidebar can be enabled and disabled through the settings option; you can also dock other sites which will appear in the sidebar, though not necessarily with the context of the page you’re currently looking at). A recent – and somewhat controversial – change means that when you click a link from an email in desktop Outlook on a PC, it will open in Edge and the Outlook sidebar will be shown alongside, displaying the email that you clicked it from.
Once you’ve got the hang of this feature, it’s actually pretty cool – especially if the email is offering some context about what you’re supposed to be doing on that page, or if it’s a densely-packed missive full of clickbait and other nonsense:
Why is it controversial? Well, the point is that the extra functionality is happening due to the Sidebar in Edge, so clicking a link in Outlook if you’re using a different default browser wouldn’t have the same effect. Outlook, therefore, has decided to send links to Edge even if that’s not your usual browser, to the chagrin of some netizens. Be careful with doing things that annoy some people.
If you’d prefer that Outlook and Windows respected your choice to send all your links to a specific, non-Edge, browser, then it’s fairly easy (if not exactly easily discoverable) to set that. Go to File | Options | Advanced within Outlook, and look for the Link Handling option, and change it to Default Browser. 
This will mean opening the hyperlink in Chrome / Brave / Firefox / whatever, without the Sidebar doing its thing.
More change is on its way to Edge and Bing AI.
If you like Edge but would rather dispense with the Sidebar altogether, go to the “…” menu on the top right, select Settings | Sidebar and disable the Always show sidebar toggle.
You can use the same 
settings UI to play with other behaviours in the various apps that are pinned to the sidebar, too.
To add or hide apps on the sidebar, just show it, right-click on something and choose Customize sidebar, or use the “Add or remove apps…” feature from the Settings | Sidebar screen.
If you’d rather not to have the somewhat prominent Bing icon on the very top right of your Edge screen, look under the Discover section of this Settings UI, and if you flick the switch, the big blue b goes away.
674 – Here’s the (co)pilot
UK telly viewers in the early noughties may recall the surreal comedy show, Trigger Happy TV, with recurring characters like the aggressive squirrels or the guy with the massive phone (and that Nokia ring tone).
It was also known for some great soundtracks, like the fantastically titled Grandaddy song “He’s Simple, He’s Dumb, He’s the Pilot” (also used elsewhere). Tech news over recent weeks tells us that the pilot – or Copilot – is anything but dumb, even if it can be simple.
For Microsoft watchers, “Copilot” is a growing set of capabilities which are being built to add OpenAI functionality to other applications. With all the hoo-hah about ChatGPT and the generative AI that is now integrated into Bing (and available for everyone who wants it, not just early adopters), it’s easy to get different strands mixed up.
GPT-3 and now GPT-4 are the core language models which could underpin any number of applications’ use of what looks like artificial intelligence. ChatGPT is one web app built to hone some of the parameters of GPT-3 and put a chatbot front end to it. The new Bing and all the other stuff announced over the last few weeks is not using ChatGPT, but they do share some of the same technology underneath. Capisce?
There have been AI features aimed at making developers’ lives easier, such as Github Copilot (available since 2021), which uses another OpenAI tool called Codex, itself built to harness GPT-3. For developers on Power Platform, there have been AI functions for years too, though some capability has been recently added.
Everyday users of Dynamics 365 and Office applications will soon get Copilot capabilities to help automate boring tasks, like “work”. Do bear in mind that announcing something and making something available – in limited preview form or generally – are different activities. Copilot for Office apps like Outlook might be a few weeks or months away for most of us, but who can’t wait for AI to automatically read and reply to all their emails?
The future with our robot overlords never looked so appealing.
For a growing summary of Copilot announcements, see the hugely popular LinkedIn post from Jack Rowbotham.
669 – Hazelnut in every bite
What has a hazlenut in every bite? That’s right, a Topic from the British sweetie shop of yesteryear, and nothing at all to do with what’s near Tufty’s nest. Sadly discontinued last year, due to falling demand, there’s no accounting for taste.
Topics are still available today to users of Microsoft 365, as a way of curating certain scraps of knowledge that they can share with other users within the same organization. The very first version of Microsoft SharePoint (codenamed “Tahoe”) had a capability that aimed to do much the same thing – “Best Bets” were a way for an administrator to guide the search experience so that if someone ran a query for a term, rather than returning hundreds of old PowerPoint files that contain that word, it would take the searcher to a more official site.
Viva Topics – because everything is getting Vivafied just as in the days of Tahoe, every other product had Live and/or .NET in its name – is part of a growing family of “employee experience” offerings; it’s an addon to even the top flight Office Microsoft 365 subscription, but adds AI-powered discovery as well as the means to manually curate things.
After deploying Topics and assigning licenses to the appropriate users, topic pages can be automatically created based on the documents that exist already – the Search and underlying Graph services can identify subjects that look like are active, with people contributing to them through documents, conversations and so on. Codenames or location names, for example, could be quickly identified and suggested.
A Knowledge Manager could also be assigned to create or approve new pages; individual users could be empowered to do it themselves, though that might end up in something of a mess. Best practice would be to have some kind of form or email-based request, where a user would ask for a topic page to be created and they would then own the content within.
Discovery is pretty easy – depending on how it’s set up, if the title of a topic is mentioned on a SharePoint site, it can be automatically highlighted on a pop-up card with which will give a summary of the topic, and a link to more the main page which contains furtherinformation.
Topic pages themselves can be full of useful info; a search for documents or other pages that the SharePoint environment behind the scenes considers to be related, as well as specifically curated sources of information, contact cards for the people who are managing the project or involved with the customer, links to docs or other websites etc.
Within Office apps like Word or Outlook, if the user highlights a word or phrase and chooses to Search for it, a sidebar in Office will run a search online and across internal sites for that word – this is avialable to everyone, with or without Topics deployed.
If Topics has been configured and the searched for term is a topic (or is one of the topic’s synonyms, or is otherwise related), then the user will see it fairly prominently in the search results.
566 – Who’s Better, Who’s Best?
|
502 – Presenting PowerPoint Subtitles
|
When they do it properly, you’ll often see presenters kick off by fishing
PowerPoint will typically be set up to use Presenter View by default, and the screen that’s being shared will be showing the speaker notes / next slides etc, while the full-screen content is being displayed on the 2nd monitor that isn’t being shared.
Choose the language you’d like to display, the location of the subtitles and when you start presenting, the machine will listen to every word you say and will either display what it thinks you’ve said in your own language, or it can use an online service to translate to subtitles in over 60 languages. It’s fantastic. See more here. Go and try it now.
Windows has a closed captioning setting page that applies to other apps that support it, too, if you’d like to show subtitles on video that has the content already defined. Closed Captioning is legislated by several countries, for traditionally-broadcast media as well as online video. You may also want to add captions to videos that you plan to embed – more, here. |
Tip o’ the Week 465 – Cortana, remind me To-Do sync
|
In fact, the Store listing name for To-Do is now appended with some additional context of what it can now do, at least if your language is English and you’re in US, UK, India or Australia.
Cortana’s past tells a good story, and her future is changing somewhat – after deciding to stop positioning her as a potential competitor to Amazon Alexa or Google assistants, a forthcoming release of Windows 10 will break the bond between Windows Search & Cortana, and the voice prompts from Cortana during Windows Setup will be silenced when installing a non-Home version of Windows too. |
Tip o’ the Week 460 – AI, AI, Oh…
|
Of course, many of us know AI as a term used to refer to a host of related technologies, such as speech and natural language recognition, visual identification and machine learning. For a great example on practical and potentially revolutionary uses of AI, see Dr Chris Bishop’s talk at Future Decoded 2018 – watch day 1 highlights starting from 1:39, or jump to 1:50 for the example of the company using machine learning to make some world-changing medical advances.
One simple example is image searching – if you upload photos to consumer OneDrive (directly from your phone perhaps), the OneDrive service will now scan images for text that can be recognized… so if you took a photo of a receipt for expenses, OneDrive might be able to find it if you can remember what kind of food it was.
More AI goodness is to come to Office 365 and OneDrive users in the near future – automatically transcribing content from videos stored online (using the same technology from the Azure Video Indexer and Microsoft Stream), to real-time PowerPoint captions. Watch this space… and mind the robots. |
