🐛 [BUG] - quality___language___fasttext_filter function is not utilizing the 'subset' column's text values for filtering

[41ow1ives]

Environment Settings

default setting

Expected Behavior

The quality___language___fasttext_filter function is not utilizing the 'subset' column's text values for filtering. Although a subset parameter exists in the function, it is not used throughout the logic of the function. However, the function still operates because the language_predict_fasttext function used within automatically targets the 'text' column for filtering. In dataverse testing, the 'text' column is used as the column containing the text. Additionally, there are concerns about potential name conflicts with user input data since the function internally generates columns named labels and scores.

Translate this into easy-to-understand, yet precise English.

Actual Behavior

written above

Reproduction

Simply run with the quality___language___fasttext_filter function without 'text' column.