spanish – Alex Reuneker https://www.reuneker.nl Alex Reuneker's Blog Tue, 07 Jan 2025 09:00:16 +0000 nl-NL hourly 1 https://wordpress.org/?v=7.0.2 §204. Wordlist generator updated to replace diacritics https://www.reuneker.nl/taal/wordlist-generator-updated-to-replace-diacritics/ https://www.reuneker.nl/taal/wordlist-generator-updated-to-replace-diacritics/#respond Tue, 07 Jan 2025 09:00:16 +0000 https://reuneker.nl/wordlist-generator-updated-to-replace-diacritics/?p=266 One of the nicest things about the online corpus tools I develop and maintain is that I get questions and suggestions from (a whole range of) researchers around the globe. This time, someone asked me to include the option to remove spanish interpunction at the start of a word/sentence, like ¿ and ¡ and an option to include or exclude diacritics like ø, ö and characters such as ß — the German ‘sharp’ or ‘double S’. The script already filtered out these characters, but in a rather crude way: a word like schön simply became schon, and äh even became a single letter, h, which is strange (and incorrect) to see in the results.

enter image description here

Inverted question mark and exclamation mark

With this update, characters can be either kept (schön stays schön), or replaced (schön becomes schon). The update is live, so if you’re interested, head over to https://www.reuneker.nl/files/wordlist.

]]> https://www.reuneker.nl/taal/wordlist-generator-updated-to-replace-diacritics/feed/ 0