extract and save single words from txt files Topic is solved

[way2000]

how can i extract words from text files, there's around 500 text files. i need to extract all words (no duplicates) and save them as a word list in another text file

and also how can i make it so it reads external .txt files no matter what their name is through folder path address, it has to ignore symbols and numbers

i have this code so far, it only writes a "." in a text file, it doesn't seem to work

Code: Select all

Loop, 500

     {

          Path := "C:\test2" . A_Index . ".txt"

          FileRead, OutputVar, %Path%

          OutputVar = %OutputVar% . %OutputVar%

     }

FileAppend % OutputVar, list.txt
return

[Scr1pter]

These 500 text files contain each 1 word?
I'm my opinion you should include the FileAppend within the loop.
(At least this is how I would make it.)

It reads a file and writes the word in a new file.
Then it reads the next file and adds it to the output file.

Also, add a 'n after OutputVar, so that there will be a line-break after each word.
(On the smartphone I don't know if it is ' or ` or another one.

Your path looks odd to me as well.
I would try it with one of these:
Path := "C:\test2\%A_Index%.txt"
Or
Path := C:\test2\%A_Index%.txt
Or
Path = C:\test2\%A_Index%.txt
Or
Path = “C:\test2\%A_Index%.txt“

Can't test it, that's why I added several examples.

Regards

[CyL0N]

Code: Select all

Loop, Files, C:\*.txt
{	

	If IsAlpha(StrReplace(StrSplit(A_LoopFileName,".")[1],A_Space)){	;if file name has no numbers or symbols...
		FileRead, thisFile, % A_LoopFileFullPath
		wordlist .= wordlist ? "`n" GetStringWordList(thisFile) : GetStringWordList(thisFile)
	}
}

;MsgBox % finalWordList := GetStringWordList(wordList)	;sanitise wordlist for any duplicates during combining & remove any blank lines.
FileAppend, %finalWordList%, finalWordList.txt

GetStringWordList(text){	;returns a list with no duplicates
	StringReplace, text, text, `,, `n, ALL
	StringReplace, text, text, `r`n, `n, ALL
	StringReplace, text, text, %A_Space%, `n, ALL
	StringReplace, text, text, %A_Tab%, `n, ALL
	;remove white spaces
	wordListText := RegExReplace(text , "(^|\R)\K\s+")
	;rebuild wordlist using only strings longer than 3 characters
	Wordlist:=""
	Loop, Parse, wordListText, `n
		If StrLen(A_LoopField) >= 1		;strings of over 1 characters
			IfNotInString, Wordlist, %A_Space%%A_LoopField%%A_Space%	;avoid repeated strings
				Wordlist.= " " A_LoopField " " "`n"	;add spaces on either side so that words in other word can easily be added to list
	StringReplace, Wordlist, Wordlist, %A_Space%, , ALL ;spaces are no longer needed as list is done building
	Return WordList
}

IsAlpha(ByRef string){
	If string is alpha
		Return True
}

[way2000]

@CyL0N

how can i make it save to a text file the result instead of getting a msgbox

[CyL0N]

@CyL0N

how can i make it save to a text file the result instead of getting a msgbox

I've updated my post. The documentation & google are your best friends.

[garry]

just a short DOS example to copy text-files in one file

Code: Select all

transform,s,chr,34
f99=%a_scriptdir%\F99.txt
Loop, Files, C:\*.txt,
  e .= s . A_LoopFileFullPath . s . "+"   ;- copy not works if string too long
stringtrimright,e,e,1  
runwait, %comspec% /k copy /A /N %e% "%f99%"  
ifexist,%f99%
run,%f99%
exitapp

[Maestr0]

Kinda like this?

Code: Select all

Loop, Files, *.txt
{	
	FileRead, thisFile, % A_LoopFileFullPath
	StringReplace, contents, thisfile, ., %A_Space%, All
	StringReplace, contents, contents, %A_Tab%, %A_Space%, All
	StringReplace, contents, contents, `,, %A_Space%, All
	StringReplace, contents, contents, `r`n, %A_Space%, All
	StringReplace, contents, contents, %A_Space%%A_Space%, %A_Space%, All
	loop, parse, contents, %A_Space%
	{
		if A_LoopField
			wordlist .= A_LoopField "`n"
	}
}

FileAppend, %WordList%, WordList.txt

[way2000]

Kinda like this?

Code: Select all

Loop, Files, *.txt
{	
	FileRead, thisFile, % A_LoopFileFullPath
	StringReplace, contents, thisfile, ., %A_Space%, All
	StringReplace, contents, contents, %A_Tab%, %A_Space%, All
	StringReplace, contents, contents, `,, %A_Space%, All
	StringReplace, contents, contents, `r`n, %A_Space%, All
	StringReplace, contents, contents, %A_Space%%A_Space%, %A_Space%, All
	loop, parse, contents, %A_Space%
	{
		if A_LoopField
			wordlist .= A_LoopField "`n"
	}
}

FileAppend, %WordList%, WordList.txt

this works, thanks a lot

[Maestr0]

this works, thanks a lot

You're welcome!
Kindly mark this thread as solved, by marking the post that solved it.
Read how to do that here: https://autohotkey.com/boards/viewtopic.php?t=29007

- If someone answers your question, you can put a tick by it, this marks the question as 'solved', you can subsequently remove the tick, or put a tick on a different post.