Context: I come from a linguistics background and have several years of experience in my specialty within the field. I passed the first round of interviews for an EdTech learning company for a high-ish level role. They gave me an "assignment" to see how I would handle what I assume are issues they are facing regarding scoring, mapping of scores, comparisons, etc.

The assignment has multiple parts and I have been explicitly asked for all of my thinking regarding my choices--whys, why nots, deep explanations, etc. Essentially, they want me to show all of my steps.

I'm not even halfway done, and this "assignment" has taken several hours and is multiple pages.

Having not experienced this before, I'm concerned that this ask from the company is more so them fishing for information they can feed into an AI. Are assignments of this scale common within the EdTech and Language Tech arena?

​

Consider this Arabic word:

كتب

It can mean he wrote or books.

Same letters. Different meanings.

Now imagine building an AI model that must read millions of Arabic sentences where short vowels are often missing. How does it know which meaning the writer intended?

This is not just a translation problem. It is a language-understanding problem.

And Arabic gives us some fascinating examples of it.

1. The problem hiding inside three letters

Look at this word:

علم

Without short-vowel marks, it can represent different words:

- عِلْم — knowledge

- عَلَم — flag

- عَلِمَ — he knew

Arabic readers often use context to identify the intended meaning. But if the context is unclear, even a human reader may need more information.

An AI model must learn to make the same distinctions from the text it receives.

What happens when the text does not provide enough clues?

1. One word, several meanings

Consider:

عين

Depending on the context, this word can mean an eye, a water spring, or a spy.

For example:

ألم في العين

Pain in the eye.

عين ماء

A water spring.

The surrounding words help determine the meaning.

This is called lexical ambiguity: one written word can have multiple meanings.

A model that memorizes translations without properly using context can choose the wrong one.

1. Small changes, big differences

Arabic words are built using patterns, roots, and attached elements. This system is called الصرف, or morphology.

Compare:

- كتب — he wrote

- يكتب — he writes

- كتبت — she wrote, or I wrote, depending on context

- كتبوا — they wrote

Small changes can tell us who performed an action and when it happened.

Arabic also combines several meaningful elements into a single written word.

For example:

وبكتابهم

This includes elements that can mean and, with or by, book, and their.

An AI system must identify these parts and understand their relationships. Simply translating each piece separately may not preserve the intended meaning.

1. The Arabic people speak is not always the Arabic AI expects

Consider this Egyptian Arabic question:

عايز إيه؟

It means roughly What do you want?

Now consider:

هعمل update للملف

This means roughly I will update the file.

The second example mixes Egyptian Arabic with English.

These are ordinary communication patterns, but they may be harder for a model that has learned mostly from formal Arabic text.

Arabic dialects differ in vocabulary, grammar, pronunciation, and spelling. A model that performs well on formal documents may not perform equally well in everyday conversations.

1. Even the way AI reads text matters

Language models process text using units called tokens. A token can be a whole word or part of a word.

Arabic prefixes, suffixes, and word patterns create many possible word forms. Depending on how a model splits these forms into tokens, some relationships may be easier or harder to learn.

Training data matters too.

A model trained on diverse, high-quality Arabic text may handle more situations than one exposed to a narrow range of formal writing.

But there is no single explanation for every mistake. Model architecture, training methods, context, and the particular task all affect performance.

So, can modern AI actually understand Arabic?

Modern AI can translate Arabic, summarize Arabic documents, answer questions, and generate fluent Arabic text.

But fluency does not guarantee that the model has interpreted every sentence correctly.

A model might confidently translate an ambiguous word using the wrong meaning. It might misunderstand a dialect expression. Or it might miss a grammatical clue that changes who did what.

These failures are not proof that AI cannot understand Arabic. They show why language understanding requires more than recognizing words and generating plausible sentences.

The same challenges exist in other languages, but Arabic's writing conventions, word formation, and dialect diversity create their own set of difficulties.

For anyone working in NLP, this raises a more useful question than whether a model can simply speak Arabic:

Can it identify ambiguity, use context correctly, and recognize when the available information is insufficient?

I would like to hear from Arabic speakers, NLP researchers, and AI engineers.

What is a real Arabic sentence that you have seen an AI model misunderstand? Share the sentence, its possible meanings, and the context needed to interpret it correctly.

Real examples could reveal much more about Arabic NLP than another generic translation test.