The Distant Librarian

How to increase memory available to VOSviewer on Windows

I've been poking at VOSviewer while helping a student figure out whether it'll be helpful for a bibliographic analysis project, and I was stymied by running out of memory when attempting to work with a large dataset. The manual (PDF) unhelpfully addresses this issue with a whole section:

But there is no VOSviewer.jar file to be found anywhere in the Windows installation package, so that command doesn't work, at least on my system. I was able to find VOSviewer.jar on macOS by right-clicking the program file and choosing to Show Package Contents, but even after doing the same on Windows by unzipping the executable file, there's no VOSviewer.jar file.

I thought I'd throw the problem at ChatGPT, and after a couple of suggestions that didn't work, it suggested creating a batch file that would add the memory addition flag to the launching of the program and it worked!

Here's what that looks like:

 

If it's worth sharing, it's worth saving - Wayback to Facebook

I don't know why this particular solution didn't initially resonate with me, other than my doggedly wanting to link to THE ORIGINAL source, but with the recent demise of my locally-hosted instance of ShareNews, I've been searching for other ways to circumvent Facebook's ban on sharing news sites.

I discovered a couple of solid commercial options in ShareKit and Rebrandly that I'll keep in my back pocket, but I prefer not to pay if I don't have to. (side note: news links shared through Bit.ly and any customized rebrands of it are also blocked by FB) Next up was a locally-hosted version of YOURLs, but just as I was about to deploy that I realized the solution had been there all along, even as already noted by me:

Send the link to the Internet Archive using the Wayback Machine browser extension, then paste the resulting URL into Facebook. This method has the advantage of ensuring your newsworthy article is saved for others to view in perpetuity, should it disappear from the original location for any reason.

The extension is available for FF, Safari, Chrome and Edge, and also as an app for iOS and Android, so this should cover pretty much any platform on which you prefer to work.

Here's a quick screencast showing it in action. It's actually faster than my previous solution. The only potential drawback is that FB bans all links from the Internet Archive, but I'm sure lots of folks have been using this option since the ban began, and they haven't yet, so fingers crossed!

Oh, and other options include posting a news link to a social media site such as Mastodon or Twitter, then posting the link to that post into FB, but then you lose the open graph data that makes the post so much more fulsome. Metadata FTW!

Launching ChatGPT Voice Chat on an iPhone 12 with back-tap

In today's issue of Ethan Mollick's One Useful Thing, I learned that the iPhone 15 has a unique button I hadn't paid any attention to - the action button. He mentioned how the action button can be used to launch a voice chat with ChatGPT, and I found instructions at TechCrunch. But I only have an iPhone 12!

I knew the iPhone has a feature called Shortcuts, but I'd never really found a use for them. I also recalled that there are a couple of accessibility features on the iPhone that allow actions to be performed by, for instance, double-tapping the back of the phone. I asked Perplexity how to recreate the action button thing on my older phone, and got the following excellent instructions:

Based on the search results provided, here's what you can do with the Back Tap feature on your iPhone 12 to launch a voice chat with ChatGPT:

## Using Back Tap to Launch a ChatGPT Voice Shortcut

The search results indicate that the Accessibility > Touch > Back Tap feature on iPhone allows you to assign various actions to a double or triple tap on the back of your device. [3]

You can use this to launch a custom Shortcut that starts a voice conversation with ChatGPT, without having to unlock your iPhone or use Siri. Here's how:

1. Create a new Shortcut in the Shortcuts app called "ChatGPT Voice" that includes the "Start Voice Conversation" action from the ChatGPT section. [1][2][3]

2. Go to Settings > Accessibility > Touch > Back Tap. [3]

3. Select either "Double Tap" or "Triple Tap" and choose the "ChatGPT Voice" shortcut you just created. [3]

Now, whenever you double or triple tap the back of your iPhone 12, it will automatically launch the ChatGPT voice conversation mode, allowing you to speak your questions and get responses from ChatGPT without having to unlock your device or use Siri. [1][3]

This provides a quick and hands-free way to access ChatGPT's voice capabilities directly from your iPhone 12, using the built-in Back Tap accessibility feature. [3] The search results provide detailed steps on how to set this up.

Citations:
[1] https://www.youtube.com/watch?v=h3fOIE_CJXI
[2] https://www.reddit.com/r/shortcuts/comments/181uy7r/chatgpt_voice_shortcut/
[3] https://www.digitaltrends.com/mobile/how-to-replace-siri-with-chatgpt-iphone/
[4] https://www.reddit.com/r/iphone/comments/1702w4p/how_to_replace_siri_with_chatgpt_as_your_voice/

Works like a charm! (though as I read that response, I do have to admit it's not actually a hands-free way to access ChatGPT's voice capabilities, but I'm just fine with that.)

llamafile is the new best way to run a LLM on your own computer

I lifted the title directly from Simon Willison's post: llamafile is the new best way to run a LLM on your own computer, even though I don't have the expertise to know if it's the BEST way. I can tell you it's a damn easy way, even on Windows! Simon's explanation works on a mac, but you can also run this on Windows with the following miniscule changes.

1. Download the 4.26GB llamafile-server-0.1-llava-v1.5-7b-q4 file from Justine’s repository on Hugging Face.
2. Open Command Prompt and navigate to the location of your downloaded file.
3. Simply type the filename and wait for your default browser to display http://127.0.0.1:8080/

Simon reports that on his M2 Mac he's seeing 55 tokens per second. On my brand-spanking new Dell office machine running Windows 10, I get 5.5 tokens per second :-( I was getting ready to grump all over Windows, here, but on my 2-year-old M1 MacBook Air it barely runs at all, clocking in with 0.35 tokens per second. And now my MacBook Air has crashed - maybe don't try running it on yours, or do, and tell me why mine sucked so hard! :-)

Link wherever you want (YMMV)

Quite some time ago, I used a browser extension called TLDRify that allowed me to highlight some text on a web page, and it would create a link I could share that would jump a person directly to the text I had highlighted. It was a way to both create an anchor link when one didn't exist, but with the added benefit of highlighting the block of text you wanted someone to see. At some point I stopped using it because several browsers threw up scary warnings to the clickee that they were being redirected to a different site, which is true, in that TLDRify actually shows your desired content on a different URL (tldrify.com).

The other day, my friend Peter posted about something called URL Scroll-To-Text Fragment, and it looked promising enough to explore. In my explorations, I think I've learned that TLDRify seems to be working well enough again that I'll likely start with that, but you may be interested in figuring out if either of these solutions might be useful to you. It seems that different browsers may play more nicely with one or the other, with Chrome possibly being the best bet, but I have gotten both link types to work across Windows and macOS, on Firefox, Chrome, Opera, Safari and Edge.

The "fix" to TLDRify is that now all the browsers that are warning about the link are doing so by displaying the following at the top of the page, but otherwise the link works as desired.

So here are some links to try - how do they work for you?

• This one, created with TLDRify, should jump you to the final line of text on a page detailing MPOW's Travel Loaner Device Program.
• This one is way uglier as hyperlinks look, but you can't tell since it's still embedded as a link. It was created with the Scroll To Text bookmarklet described at the Supple.com website.
• The Link to Text Fragment add-on for Firefox creates an identical type of link, but does so with a right mouse click after highlighting the text. This solution seemed the most finicky in that it didn't always actually create the link I wanted.

Have you trained an AI?

Thanks to Mita Williams for pointing to this Washington Post article that makes it trivial to search and see whether any sites you're affiliated with have been used to train "Google’s C4 data set, a massive snapshot of the contents of 15 million websites that have been used to instruct some high-profile English-language AIs, called large language models, including Google’s T5 and Facebook’s LLaMA." The entire article is interesting, but it's more fun to plug in the URLs of any websites you want to check against. This blog, and MPOW, are both represented:

Is anyone aware of a similarly-simple way of searching the entire Common Crawl dataset, or is that just too massive to do?

If you're curious to know whether any of your images or artwork have been used to train one of the image AI's, you can do that, too!

 

 

Clipchamp - a VERY cool screencasting option!

The other day, Lifehacker posted that Windows Has a New Tool for Simultaneously Recording Your Screen and Webcam. That tool is Clipchamp, and I am impressed! Oh, and it's free.

MPOW has blocked the Microsoft Store, so I wasn't able to install the desktop version, but I was able to run the web version. I have to imagine the desktop version would provide a more seamless experience, with better performance, but even running it in a web browser was perfectly fine. Maybe a little jerky when doing the editing. The web version requires either Chrome or Edge, but running it in Chrome, I was able to record what was happening in my Firefox browser. I'm not going to bother posting the test video I made, but it did everything I expected. When editing, I was able to clip out sections, I was able to move and resize my video camera feed, and I added some stock music and graphics. When saving, I had the option to export at different resolutions, and then have the option to upload directly to YouTube or 7 other destinations. Exports are .mp4 files.

There is a limit of 30 minutes per recording, and I don't see that the Premium version changes that. For 99% of what you're likely to want to record as a screencast, I think this tool would do the trick. Definitely worth checking out!

AI, Images, and Academic Titles

Yesterday, shortly after helping a student start a literature search, I found myself poking around at DALL-E, one of the crop of machine-learning tools that can generate images based on a text prompt. I had an article title saved on my clipboard, and wondered what would be generated from the title. I was not impressed.

The prompt: Robust Speech Recognition via Large-Scale Weak Supervision

The 4 results:

Here's a second example.

The prompt: The curvilinear effect of professional faultlines on team innovation: The pivotal role of professional identity threat.

The 4 results:

At least that one's got some curves...

Pretty underwhelming, but then I wondered what the others would make of it, so I headed over to Midjourney, and after figuring out how to interact with it in Discord, generated the following MUCH more interesting images from the same prompts. Can you guess which is which this time, w/o seeing the prompt? :-)

 

And finally, what about Stable Diffusion?

Could all turn in to a fun party game. I certainly know which ones are most visually-appealing to me... Thoughts?

Why you should pay attention to your Creative Commons licenses

I have never given a second thought to ensuring I've chosen the correct/most recent version of a creative commons license. That's changed, because I just finished reading Cory Doctorow's post, A Bug in Early Creative Commons Licenses Has Enabled a New Breed of Superpredator. In it, he outlines the emergence of the Copyleft troll, someone who posts images with an outdated CC license, and then sues people for using those images as they were intended to be used, but who may (or may not!) have neglected to completely comply by the letter of the license.

I don't know whether any of this would even apply to the textual works I would more likely post with a CC license, and maybe that doesn't matter because I'm not going to be going after anyone for using my works that may have an old license, but here at MPOW we're really starting to move to Open Educational Resources, and I could easily see the authors of such resources including images that are CC licensed earlier than 4.0 (or whatever the current version is by the time you read this). Going back to Cory's post, it seems that license version 2.0 is the really problematic one, but perhaps 1.0 and 2.5 are bad for the same or similar reasons? Please let me know if you know!

Does anyone know of a tool that allows me to search a specific site for content that has any creative commons license? So I'm looking for something like https://wordpress.org/openverse/ that includes something like Google's "site:" option. Bonus points if it could allow a search to be limited to content that applies a specific CC license! @researchbuzz? @cogdog?

Resources:

• Creative Commons FAQs
• Creative Commons version 4.0
• Creative Commons history of license versions

I love these quotes from Cory:

If you put a CC license on your work, its explicit message is, “I want you to re-use this.” Not “I am a pedantic asshole with a fetish for well-formed attribution strings.” The point of CC is not to teach the world to write attribution strings: it is to facilitate sharing and re-use. If you are a good-faith user of CC licenses, then your response to an incorrect attribution string should be a request to correct it, not a threat to sue for $150,000 in statutory damages.

If you send threats instead of requests for correction, you are a terrible person and you should feel really bad about yourself.

Stay safe, all, and do let me know if you have answers to any of my questions above!

 

Shasta vs. Descript

It's a premature title, as I don't actually have access to Project Shasta yet, but this announcement makes it sound very similar to Descript: Adobe’s Project Shasta is an AI-powered, web-based audio editor. I have requested access, though, and will report back when I know more! :-)

Linked data types in Excel

Apparently parts of this have been around for a couple of years, but it just came on my radar last week with this blog post.

Did you know that Excel can do lookups from providers like Wolfram, Bing, and Power BI on a bunch of different data types? Only available with a Live365 (and/or institutional?) account though, but that covers MPOW. Here's the overview page at Microsoft.

A partial list (you provide the first part, Excel will return data on the second):

• Food: calories, carbohydrates, fats, vitamins, nutrients, etc.
• Exercise: exercise types and calories burned.
• Locations: zip codes, economic data, airports, schools, forests, etc.
• Universities: graduation rates, tuition, student body, etc.
• Chemistry: elements, compounds, and minerals.
• Space: planets, moons, satellites, supernovas, space missions, etc.
• Movies: actors, characters, directors, release dates, poster art, etc.
• And More: music, plants, animal breeds, famous people, languages, etc.

I was going to do a little screencast, but there are good ones already out there.

You can even define your own data types.

I'm not entirely sure what I'll do with this, but at least now that I know about it, I'll keep my thinking cap on!

Historical COVID-19 R-Values for Alberta

Filed under stuff no citizen should have to do, today I went through pages archived by the Wayback Machine in order to provide a patron with historical R-Value data for COVID-19 for the Province of Alberta. This information is updated weekly (since mid-December, 2020) at https://www.alberta.ca/covid-19-alberta-data.aspx, but for some reason the Government has chosen not to make previously-reported numbers available. Anywhere.

Here are the Historical COVID-19 R-Values for Alberta in a Google Spreadsheet. I'll continue to manually update.

 

That cool picture from the cover of The Data Journalism Handbook

The Data Journalism Handbook has been updated from its original 2012 edition, and is available to purchase or for free download from the publisher. When I first tweeted about this a month ago, @Gersart wondered who was responsible for the artwork on the cover. Frustratingly, there was no information about it in the publication, and my email to the publisher went unanswered.

So I clipped the image and threw it into TinEye and was able to identify it as a photograph from a 2012 exhibition by Sarah Sze entitled Fixed Points Finding a Home.

See also, and this YouTube video.

Bounegru, L. and J. Gray (eds.), The Data Journalism Handbook: Towards a Critical Data Practice.
Amsterdam: Amsterdam University Press, 2021

How to stop a Zoombombing

Thank goodness I haven't personally experienced this while teaching / presenting via Zoom, but I have been a participant in a workshop that was Zoom bombed, and that was traumatic enough. I can't even imagine how nasty that would be for the presenter.

Lifehacker reports that Zoom is rolling out some new features aimed to make it easier to stop a bombing-in-progress, but also appears to be monitoring for, and will warn you via email "if your meeting invite appears in any public social media posts or other websites where these things are usually posted."

I haven't received anything from my POW (we have a licence for Zoom), or from Zoom directly, nor did I see any abuse options as described by Lifehacker until I manually checked for updates in my Zoom client and updated to version 5.4.3 (Mac).

Go update your clients, folks!!!

Preparing a dataset to use in Hydrator

Update - April 18, 2023: From the developer: Twitter's changes to their API which greatly reduce the amount of read-only access means that the Hydrator is no longer a useful application. The application keys, which functioned for the last 7 years, have been rescinded by Twitter.

Every few months I get an email from someone looking for some help with the Hydrator tool I wrote about back in 2017. Hydrator is a simple tool to rehydrate twitter ids into full tweets. From the Hydrator GitHub page, "Twitter's Terms of Service do not allow the full JSON for datasets of tweets to be distributed to third parties. However they do allow datasets of tweet IDs to be shared. Hydrator helps you turn these tweet IDs back into JSON and also CSV from the comfort of your desktop."

The advantage for me, and apparently many others, is that it's an actual program instead of a command-line tool, so it's pretty damn easy to use for those of us who only occasionally need to rehydrate a list of tweeter ids.

The biggest issue people have is that Hydrator only wants a file with a single list of twitter ids, and nothing else. Not even a header on that list. For a reasonably-sized list it's usually no problem to use Excel or similar to clean up the offending dataset, but the other day someone asked if I could help with prepping the file at A Twitter Dataset of 150+ million tweets related to COVID-19 for open research. For some reason the researchers added two columns to the dataset, so in addition to the column of twitter ids, there are also columns for date and time.

Note this is all happening on my MacBook. YMMV on other platforms.

I did some Googling and decided that csvkit should do the trick and it did, with a couple of caveats. First, it's an incredibly simple command-line tool, with a stellar step-by-step tutorial. Trust me, you can use it! So I installed it and ran the first command to turn the COVID-19 dataset from a TSV (tab-separated values) file into a CSV (comma-separated values) file:

in2csv full_dataset-clean.tsv > full_dataset-clean.csv

And it didn't work :-( csvkit is supposed to be able to recognize and parse tsv, but for whatever reason it didn't in this case. No biggie, back to Google, and after a little trial and error, I settled upon this single command line to convert the file from TSV to CSV:

cat full_dataset-clean.tsv | tr "\\t" "," > full_dataset-clean.csv 

And just below that is a suggestion that I might not've even needed csvkit for the next step, but I didn't see that until just now :-)

So that command did indeed translate my TSV file into a CSV file, and I went back to the csvkit tutorial to get a file with only the first column, using the command:

csvcut -c 1 full_dataset-clean.csv > full_dataset-clean-tweet_ids.csv

One last problem is that there's still a header on that column (tweet_id), which I verified with the command:

csvcut -n full_dataset-clean-tweet_ids.csv

Google suggests the SED (stream editor) command will do the trick:

sed -i -e '1d' full_dataset-clean-tweet_ids.csv

And I can verify the first line is now gone with:

head full_dataset-clean-tweet_ids.csv

Probably way more convoluted than it needed to be, but it got the job done, and now I can point Hydrator at my full_dataset-clean-tweet_ids.csv file and Bob's your uncle!

Note to self, xsv is another CSV tool that might be worth exploring.