Code to perform various operations, mostly on po files.
Import units from translations files into tmdb.
Convert PHP format .po files to Python format .po files.
Converts from PHP .po format to Python .po format.
inputfile – file handle of the source
outputfile – file handle to write to
template – unused
Converts PHP .po files to Python .po files.
Produces a clean file from an unclean file (Trados/Wordfast) by stripping out the tw4win indicators.
This does not convert an RTF file to PO/XLIFF, but produces the target file with only the target text in from a text version of the RTF.
Cleans the given file.
Cleans the targets in the given unit.
Reads in inputfile, cleans, writes to outputfile.
Compile XLIFF and Gettext PO localization files into Gettext MO (Machine Object) files.
See: http://docs.translatehouse.org/projects/translate-toolkit/en/latest/commands/pocompile.html for examples and usage instructions.
Reads in a base class derived inputfile, converts using pocompile, writes to outputfile.
Conflict finder for Gettext PO localization files.
See: http://docs.translatehouse.org/projects/translate-toolkit/en/latest/commands/poconflicts.html for examples and usage instructions.
a specialized Option Parser for the conflict tool…
Work out which strings are conflicting.
-> (values : Values, args : [string])
Check that the supplied option values and leftover arguments are valid. Returns the option values and leftover arguments (possibly adjusted, possibly completely new – whatever you like). Default implementation just returns the passed-in values; subclasses may override as desired.
Checks to see if subdir under options.output needs to be created, creates if neccessary.
Returns the cleaned string that contains the text to be matched.
Defines the given option, replacing an existing one of the same short name if neccessary…
Declare that you are done with this OptionParser. This cleans up reference cycles so the OptionParser (and all objects referenced by it) can be garbage-collected promptly. After calling destroy(), the OptionParser is unusable.
Set parsing to stop on the first non-option. Use this if you have a command processor which runs another command that has options of its own and you want to make sure these options don’t get confused.
Set parsing to not stop on the first non-option, allowing interspersing switches with command arguments. This is the default behavior. See also disable_interspersed_args() and the class documentation description of the attribute allow_interspersed_args.
Print a usage message incorporating ‘msg’ to stderr and exit. If you override this in a subclass, it should not return – it should either exit or raise an exception.
Write the temp outputfile to its final destination.
Flattens text to just be words.
Returns a formatted manpage.
Make a nice help string for describing formats…
Gets the full path to an input file.
Gets the full path to an output file.
Gets the full path to a template file.
Gets an output filename based on the input filename.
Works out which output format and processor method to use…
Get the options required to pass to the filtermethod…
Gets an output filename based on the input filename.
Returns the usage string for the given option.
Returns the usage string for the given option.
Checks if this path has been excluded.
Checks if fileoption is a recursive file.
Checks if this is a valid input filename.
Makes a subdirectory (recursively if neccessary).
Opens the input file.
Opens the output file.
Opens the template file (if required).
Opens a temporary output file.
Saves the result of the conflict match.
Parses the command line options, handling implicit input/output args.
Print an extended help message, listing all options and any help text provided with them, to ‘file’ (default stdout).
Outputs a manpage for the program using the help information.
Print the usage message for the current program (self.usage) to ‘file’ (default stdout). Any occurrence of the string “%prog” in self.usage is replaced with the name of the current program (basename of sys.argv[0]). Does nothing if self.usage is empty or not defined.
Print the version message for this program (self.version) to ‘file’ (default stdout). As with print_usage(), any occurrence of “%prog” in self.version is replaced by the current program’s name. Does nothing if self.version is empty or undefined.
Process an individual file.
Use a list of files, and find a common base directory for them.
Recurse through directories and return files to be processed.
Recurse through directories and process files.
Parses the arguments, and runs recursiveprocess with the resulting options…
Sets the usage string - if usage not given, uses getusagestring for each option.
Sets the errorlevel options.
Sets the format options using the given format dictionary.
formats (Dictionary or iterable) –
The dictionary keys should be:
Single strings (or 1-tuples) containing an input format (if not usetemplates)
Tuples containing an input format and template format (if usetemplates)
Formats can be None to indicate what to do with standard input
The dictionary values should be tuples of outputformat (string) and processor method.
creates a manpage option that allows the optionparser to generate a manpage.
Sets the progress options.
Splits pathname into name and ext, and removes the extsep.
pathname (string) – A file path
root, ext
Splits an inputpath into name and extension.
Splits a templatepath into name and extension.
Returns whether the given template exists…
Print a warning message incorporating ‘msg’ to stderr.
Count strings and words for supported localization files.
These include: XLIFF, TMX, Gettex PO and MO, Qt .ts and .qm, Wordfast TM, etc
See: http://docs.translatehouse.org/projects/translate-toolkit/en/latest/commands/pocount.html for examples and usage instructions.
Class to implement color mode.
indent – indentation of the 2nd column (length of longest filename)
indent – indentation of the 2nd column (length of longest filename)
Provide extended statuses (used by XLIFF).
Counts the words in the unit’s source and target, taking plurals into account. The target words are only counted if the unit is translated.
Insert debug messages into XLIFF and Gettext PO localization files.
See: http://docs.translatehouse.org/projects/translate-toolkit/en/latest/commands/podebug.html for examples and usage instructions.
Reads in inputfile, changes it to have debug strings, writes to outputfile.
Grep XLIFF, Gettext PO and TMX localization files.
Matches are output to snippet files of the same type which can then be reviewed and later merged using pomerge.
See: http://docs.translatehouse.org/projects/translate-toolkit/en/latest/commands/pogrep.html for examples and usage instructions.
Just a small data structure that represents a search match.
a specialized Option Parser for the grep tool…
-> (values : Values, args : [string])
Check that the supplied option values and leftover arguments are valid. Returns the option values and leftover arguments (possibly adjusted, possibly completely new – whatever you like). Default implementation just returns the passed-in values; subclasses may override as desired.
Checks to see if subdir under options.output needs to be created, creates if neccessary.
Defines the given option, replacing an existing one of the same short name if neccessary…
Declare that you are done with this OptionParser. This cleans up reference cycles so the OptionParser (and all objects referenced by it) can be garbage-collected promptly. After calling destroy(), the OptionParser is unusable.
Set parsing to stop on the first non-option. Use this if you have a command processor which runs another command that has options of its own and you want to make sure these options don’t get confused.
Set parsing to not stop on the first non-option, allowing interspersing switches with command arguments. This is the default behavior. See also disable_interspersed_args() and the class documentation description of the attribute allow_interspersed_args.
Print a usage message incorporating ‘msg’ to stderr and exit. If you override this in a subclass, it should not return – it should either exit or raise an exception.
Write the temp outputfile to its final destination.
Returns a formatted manpage.
Make a nice help string for describing formats…
Gets the full path to an input file.
Gets the full path to an output file.
Gets the full path to a template file.
Gets an output filename based on the input filename.
Works out which output format and processor method to use…
Get the options required to pass to the filtermethod…
Gets an output filename based on the input filename.
Returns the usage string for the given option.
Returns the usage string for the given option.
Checks if this path has been excluded.
Checks if fileoption is a recursive file.
Checks if this is a valid input filename.
Makes a subdirectory (recursively if neccessary).
Opens the input file.
Opens the output file.
Opens the template file (if required).
Opens a temporary output file.
Parses the command line options, handling implicit input/output args.
Print an extended help message, listing all options and any help text provided with them, to ‘file’ (default stdout).
Outputs a manpage for the program using the help information.
Print the usage message for the current program (self.usage) to ‘file’ (default stdout). Any occurrence of the string “%prog” in self.usage is replaced with the name of the current program (basename of sys.argv[0]). Does nothing if self.usage is empty or not defined.
Print the version message for this program (self.version) to ‘file’ (default stdout). As with print_usage(), any occurrence of “%prog” in self.version is replaced by the current program’s name. Does nothing if self.version is empty or undefined.
Process an individual file.
Use a list of files, and find a common base directory for them.
Recurse through directories and return files to be processed.
Recurse through directories and process files.
Parses the arguments, and runs recursiveprocess with the resulting options.
Sets the usage string - if usage not given, uses getusagestring for each option.
Sets the errorlevel options.
Sets the format options using the given format dictionary.
formats (Dictionary or iterable) –
The dictionary keys should be:
Single strings (or 1-tuples) containing an input format (if not usetemplates)
Tuples containing an input format and template format (if usetemplates)
Formats can be None to indicate what to do with standard input
The dictionary values should be tuples of outputformat (string) and processor method.
creates a manpage option that allows the optionparser to generate a manpage.
Sets the progress options.
Splits pathname into name and ext, and removes the extsep.
pathname (string) – A file path
root, ext
Splits an inputpath into name and extension.
Splits a templatepath into name and extension.
Returns whether the given template exists…
Print a warning message incorporating ‘msg’ to stderr.
Return the GrepFilter objects where re_search matches in strings.
Calculate the real index in the unnormalized string that corresponds to the index nfc_index in the normalized string.
Reads in inputfile, filters using checkfilter, writes to outputfile.
Merges XLIFF and Gettext PO localization files.
Snippet file produced by e.g. pogrep and updated by a translator can be merged back into the original files.
See: http://docs.translatehouse.org/projects/translate-toolkit/en/latest/commands/pomerge.html for examples and usage instructions.
Take any new translations in store2 and write them into store1.
Convert a string value to boolean.
option (String) – yes, true, 1, no, false, 0
Boolean
Restructure Gettxt PO files produced by poconflicts into the original directory tree for merging using pomerge.
See: http://docs.translatehouse.org/projects/translate-toolkit/en/latest/commands/pomerge.html for examples and usage instructions.
a specialized Option Parser for posplit.
-> (values : Values, args : [string])
Check that the supplied option values and leftover arguments are valid. Returns the option values and leftover arguments (possibly adjusted, possibly completely new – whatever you like). Default implementation just returns the passed-in values; subclasses may override as desired.
Checks to see if subdir under options.output needs to be created, creates if neccessary.
Defines the given option, replacing an existing one of the same short name if neccessary…
Declare that you are done with this OptionParser. This cleans up reference cycles so the OptionParser (and all objects referenced by it) can be garbage-collected promptly. After calling destroy(), the OptionParser is unusable.
Set parsing to stop on the first non-option. Use this if you have a command processor which runs another command that has options of its own and you want to make sure these options don’t get confused.
Set parsing to not stop on the first non-option, allowing interspersing switches with command arguments. This is the default behavior. See also disable_interspersed_args() and the class documentation description of the attribute allow_interspersed_args.
Print a usage message incorporating ‘msg’ to stderr and exit. If you override this in a subclass, it should not return – it should either exit or raise an exception.
Write the temp outputfile to its final destination.
Returns a formatted manpage.
Make a nice help string for describing formats…
Gets the full path to an input file.
Gets the full path to an output file.
Gets the full path to a template file.
Gets an output filename based on the input filename.
Works out which output format and processor method to use…
Get the options required to pass to the filtermethod…
Gets an output filename based on the input filename.
Returns the usage string for the given option.
Returns the usage string for the given option.
Checks if this path has been excluded.
Checks if fileoption is a recursive file.
Checks if this is a valid input filename.
Makes a subdirectory (recursively if neccessary).
Opens the input file.
Opens the output file.
Opens the template file (if required).
Opens a temporary output file.
Parses the command line options, handling implicit input/output args.
Print an extended help message, listing all options and any help text provided with them, to ‘file’ (default stdout).
Outputs a manpage for the program using the help information.
Print the usage message for the current program (self.usage) to ‘file’ (default stdout). Any occurrence of the string “%prog” in self.usage is replaced with the name of the current program (basename of sys.argv[0]). Does nothing if self.usage is empty or not defined.
Print the version message for this program (self.version) to ‘file’ (default stdout). As with print_usage(), any occurrence of “%prog” in self.version is replaced by the current program’s name. Does nothing if self.version is empty or undefined.
Process an individual file.
Use a list of files, and find a common base directory for them.
Recurse through directories and return files to be processed.
Recurse through directories and process files.
Parses the arguments, and runs recursiveprocess with the resulting options…
Sets the usage string - if usage not given, uses getusagestring for each option.
Sets the errorlevel options.
Sets the format options using the given format dictionary.
formats (Dictionary or iterable) –
The dictionary keys should be:
Single strings (or 1-tuples) containing an input format (if not usetemplates)
Tuples containing an input format and template format (if usetemplates)
Formats can be None to indicate what to do with standard input
The dictionary values should be tuples of outputformat (string) and processor method.
creates a manpage option that allows the optionparser to generate a manpage.
Sets the progress options.
Splits pathname into name and ext, and removes the extsep.
pathname (string) – A file path
root, ext
Splits an inputpath into name and extension.
Splits a templatepath into name and extension.
Returns whether the given template exists…
Print a warning message incorporating ‘msg’ to stderr.
Segment Gettext PO, XLIFF and TMX localization files at the sentence level.
See: http://docs.translatehouse.org/projects/translate-toolkit/en/latest/commands/posegment.html for examples and usage instructions.
Reads in inputfile, segments it then, writes to outputfile.
Builds a new translation file with the target of the input language as source language.
Note
Ensure that the two po files correspond 100% to the same pot file before using this.
To translate Kurdish (ku) through French:
poswap -i fr/ -t ku -o fr-ku
To convert the fr-ku files back to en-ku:
poswap --reverse -i fr/ -t fr-ku -o en-ku
See: http://docs.translatehouse.org/projects/translate-toolkit/en/latest/commands/poswap.html for examples and usage instructions.
Reads in inputpofile, removes the header, writes to outputpotfile.
Swap the source and target of each unit.
Create a terminology file by reading a set of .po or .pot files to produce a pootle-terminology.pot.
See: http://docs.translatehouse.org/projects/translate-toolkit/en/latest/commands/poterminology.html for examples and usage instructions.
a specialized Option Parser for the terminology tool…
-> (values : Values, args : [string])
Check that the supplied option values and leftover arguments are valid. Returns the option values and leftover arguments (possibly adjusted, possibly completely new – whatever you like). Default implementation just returns the passed-in values; subclasses may override as desired.
Checks to see if subdir under options.output needs to be created, creates if neccessary.
Defines the given option, replacing an existing one of the same short name if neccessary…
Declare that you are done with this OptionParser. This cleans up reference cycles so the OptionParser (and all objects referenced by it) can be garbage-collected promptly. After calling destroy(), the OptionParser is unusable.
Set parsing to stop on the first non-option. Use this if you have a command processor which runs another command that has options of its own and you want to make sure these options don’t get confused.
Set parsing to not stop on the first non-option, allowing interspersing switches with command arguments. This is the default behavior. See also disable_interspersed_args() and the class documentation description of the attribute allow_interspersed_args.
Print a usage message incorporating ‘msg’ to stderr and exit. If you override this in a subclass, it should not return – it should either exit or raise an exception.
Write the temp outputfile to its final destination.
Returns a formatted manpage.
Make a nice help string for describing formats…
Gets the full path to an input file.
Gets the full path to an output file.
Gets the full path to a template file.
Gets an output filename based on the input filename.
Works out which output format and processor method to use…
Get the options required to pass to the filtermethod…
Gets an output filename based on the input filename.
Returns the usage string for the given option.
Returns the usage string for the given option.
Checks if this path has been excluded.
Checks if fileoption is a recursive file.
Checks if this is a valid input filename.
Makes a subdirectory (recursively if neccessary).
Opens the input file.
Opens the output file.
Opens the template file (if required).
Opens a temporary output file.
Saves the generated terminology glossary.
Parses the command line options, handling implicit input/output args.
Print an extended help message, listing all options and any help text provided with them, to ‘file’ (default stdout).
Outputs a manpage for the program using the help information.
Print the usage message for the current program (self.usage) to ‘file’ (default stdout). Any occurrence of the string “%prog” in self.usage is replaced with the name of the current program (basename of sys.argv[0]). Does nothing if self.usage is empty or not defined.
Print the version message for this program (self.version) to ‘file’ (default stdout). As with print_usage(), any occurrence of “%prog” in self.version is replaced by the current program’s name. Does nothing if self.version is empty or undefined.
Process an individual file.
Use a list of files, and find a common base directory for them.
Recurse through directories and return files to be processed.
Recurse through directories and process files.
Parses the arguments, and runs recursiveprocess with the resulting options.
Sets the usage string - if usage not given, uses getusagestring for each option.
Sets the errorlevel options.
Sets the format options using the given format dictionary.
formats (Dictionary or iterable) –
The dictionary keys should be:
Single strings (or 1-tuples) containing an input format (if not usetemplates)
Tuples containing an input format and template format (if usetemplates)
Formats can be None to indicate what to do with standard input
The dictionary values should be tuples of outputformat (string) and processor method.
creates a manpage option that allows the optionparser to generate a manpage.
Sets the progress options.
Splits pathname into name and ext, and removes the extsep.
pathname (string) – A file path
root, ext
Splits an inputpath into name and extension.
Splits a templatepath into name and extension.
Returns whether the given template exists…
Print a warning message incorporating ‘msg’ to stderr.
Fill localization files with suggested translations based on translation memory and existing translations.
See: http://docs.translatehouse.org/projects/translate-toolkit/en/latest/commands/pretranslate.html for examples and usage instructions.
Return a fuzzy match from a queue of matchers.
Returns a matching unit from a template. matching based on unit id.
Returns a matching unit from a template. matching based on unit id.
Returns a matching unit from a template. matching based on locations.
Returns the TM store to use. Only initialises on first call.
Pretranslate any factory supported file with old translations and translation memory.
Do the actual pretranslation of a whole store.
Pretranslate a unit or return unchanged if no translation was found.
input_unit – Unit that will be pretranslated.
template_store – Fill input unit with units matching in this store.
matchers – List of fuzzy matcher
objects.
mark_reused – Whether to mark old translations as reused or not.
merge_on – Where will the merge matching happen on.
diff tool like GNU diff, but lets you have special options that are useful in dealing with PO files.
generates diffs between directories.
Checks if the given filename has been excluded from the diff.
Writes the actual diff to the given file.
generates diffs between files.
Returns the lines referred to by group, from the fromfile.
Returns the lines referred to by group, from the tofile.
takes the group of opcodes and generates a unified diff line by line.
Writes the actual diff to the given file.
Main program for pydiff.
Convert Python format .po files to PHP format .po files.
Converts from Python .po to PHP .po.
inputfile – file handle of the source
outputfile – file handle to write to
template – unused
Converts from Python .po to PHP .po.