Post by brandonhotkey » 26 Jan 2014, 07:46
Hello. I am working on PHP project, there I use regular expresion search to find (bad)words which should be masked with stars. The characters which are match should be masked. Now I look dor regex for this particular situation:
I have a filter for filtering badwords in my native language. My language is very accurate not like simple English, so it is harder to give good exaple in English. I don't find good word / verb to have good example. But I will try.
I separated the pattern for three parts: prefix, middle and suffix. The middle will not change. The suffix can change. The prefix can be a specific letter or may not be present.
lets give example now:
Let's have the middle part: mil.
I want to find words like smile, smiles, smiling or mile, miles, miling
but not words like mill, mills, milling or words with different prefix like s. Here I dont find realistic example. So if there would be words like emile, emiles, emiling, amile, amiles, amiling, and so on. There could be also prefixes like pre-, un,- and so on. These words have not to be included in the result.
In my native language I tried something similar:
\bv?ojet.?\b
where ojet is the middle part and v is the only possible prefix. But this this not find anything.
My second try was
[v^d]?ojed[ueo][usm]
this time with different middle word: ojed. The suffix is changing here according declination. But always this does not work.
In my language the word would be either ojet in words like vojet,ojet,vojel,ojel,ojeli or in the second pattern it would be vojedu,vojedes,vojedem, and so on. These should be found and filtered. But there are next similar words which should not be in the result and not to be filtered: dojel,dojeli, kojeni, tojetvoje, tvoje, . So if the prefix is different than "v" it should not be found. Especially the last example is very problematic. Notice that is does not contain t or d on the preffix. So if "oje" from the "tvoje" string is selected, so this is wrong.
The common problem in my tests were that some of the characters of the incorrect middle word were captured. And I need only to capture the character of the correct word, in English example it is the mil, or smile, or smil... etc. So how can I specify pattern, that will capture as many characters as possible from the correct word, but not to capture the characters which are not presend.
Note:
I work only with a-z (small characters) no white characters in the text.
Hello. I am working on PHP project, there I use regular expresion search to find (bad)words which should be masked with stars. The characters which are match should be masked. Now I look dor regex for this particular situation:
I have a filter for filtering badwords in my native language. My language is very accurate not like simple English, so it is harder to give good exaple in English. I don't find good word / verb to have good example. But I will try.
I separated the pattern for three parts: prefix, middle and suffix. The middle will not change. The suffix can change. The prefix can be a specific letter or may not be present.
lets give example now:
Let's have the middle part: [b]mil[/b].
I want to find words like [b][u]sm[/u]il[u]e[/u], [u]s[/u]mil[u]es[/u], [u]s[/u]mil[u]ing[/u] or mil[u]e[/u], mil[u]es[/u], mil[u]ing[/u][/b]
but not words like mill, mills, milling or words with different prefix like s. Here I dont find realistic example. So if there would be words like [u]e[/u]mile, [u]e[/u]mil[u]es[/u], [u]e[/u]mil[u]ing[/u], [u]a[/u]mil[u]e[/u], [u]a[/u]mil[u]es[/u], [u]a[/u]mil[u]ing[/u], and so on. There could be also prefixes like pre-, un,- and so on. These words have not to be included in the result.
In my native language I tried something similar:
\b[b][u]v[/u][/b]?[b]ojet[/b].?\b
where ojet is the middle part and v is the only possible prefix. But this this not find anything.
My second try was
[[u][b]v[/b][/u]^d]?[b]ojed[/b][b][u][ueo][usm][/u][/b]
this time with different middle word: ojed. The suffix is changing here according declination. But always this does not work.
In my language the word would be either [b]oje[/b]t in words like v[b]oje[/b]t,[b]oje[/b]t,v[b]oje[/b]l,[b]oje[/b]l,o[b]jel[/b]i or in the second pattern it would be v[b]ojed[/b]u,v[b]ojed[/b]es,v[b]ojed[/b]em, and so on. These should be found and filtered. But there are next similar words which should not be in the result and not to be filtered: d[b]oje[/b]l,d[b]oje[/b]li, k[b]oje[/b]ni, [size=150]t[b]oje[/b]tv[b]oje[/b], tv[b]oje[/b][/size], . So if the prefix is different than "v" it should not be found. Especially the last example is very problematic. Notice that is does not contain t or d on the preffix. So if "oje" from the "tvoje" string is selected, so this is wrong.
The common problem in my tests were that some of the characters of the incorrect middle word were captured. And I need only to capture the character of the correct word, in English example it is the mil, or smile, or smil... etc. So how can I specify pattern, that will capture as many characters as possible from the correct word, but not to capture the characters which are not presend.
Note:
I work only with a-z (small characters) no white characters in the text.
