lexilla/CONTRIBUTING0000664000175000017500000000355214647367374013036 0ustar neilneilLexilla is on GitHub at https://github.com/ScintillaOrg/lexilla Bugs, fixes and features should be posted to the Issue Tracker https://github.com/ScintillaOrg/lexilla/issues Patches should include test cases. Add a test case file in lexilla/test/examples/ and run the test program in lexilla/test. The result will be new files with ".styled.new" and ".folded.new" appended containing lexing or folding results. For lexing, there are brace surrounded style numbers for each style start as markup: {5}import{0} {11}contextlib{0} For folding, there are 4 columns of folding results preceding the example text: 2 400 0 + --[[ coding:UTF-8 0 402 0 | comment ]] See the test/README file for more explanation of the folding results. To build lexilla and the tests with gcc there are Windows batch and Unix shell files scripts/RunTest.bat scripts/RunTest.sh. Check the result of the .new files and, if correct, rename replacing ".styled.new" with ".styled" and ".folded.new" with ".folded". Run the tests again and success should be reported. Include the .styled and .folded files in the patch. Including test cases ensures that the change won't be undone by other changes in the future and clarifies the intentions of the author. Either send unified diffs (or patch files) or zip archives with whole files. Mercurial/Git patch files are best as they include author information and commit messages. Questions should go to the scintilla-interest mailing list https://groups.google.com/forum/#!forum/scintilla-interest Code should follow the guidelines at https://www.scintilla.org/SciCoding.html Lexilla is on GitHub so use its facilities rather than SourceForge which is the home of Scintilla. The neilh @ scintilla.org account receives much spam and is only checked occasionally. Almost all Scintilla mail should go to the mailing list. lexilla/License.txt0000664000175000017500000000154014647367374013322 0ustar neilneilLicense for Lexilla, Scintilla, and SciTE Copyright 1998-2021 by Neil Hodgson All Rights Reserved Permission to use, copy, modify, and distribute this software and its documentation for any purpose and without fee is hereby granted, provided that the above copyright notice appear in all copies and that both that copyright notice and this permission notice appear in supporting documentation. NEIL HODGSON DISCLAIMS ALL WARRANTIES WITH REGARD TO THIS SOFTWARE, INCLUDING ALL IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS, IN NO EVENT SHALL NEIL HODGSON BE LIABLE FOR ANY SPECIAL, INDIRECT OR CONSEQUENTIAL DAMAGES OR ANY DAMAGES WHATSOEVER RESULTING FROM LOSS OF USE, DATA OR PROFITS, WHETHER IN AN ACTION OF CONTRACT, NEGLIGENCE OR OTHER TORTIOUS ACTION, ARISING OUT OF OR IN CONNECTION WITH THE USE OR PERFORMANCE OF THIS SOFTWARE.lexilla/README0000664000175000017500000000340014647367374012054 0ustar neilneilREADME for Lexilla library. The Lexilla library contains a set of lexers and folders that provides support for programming, mark-up, and data languages for the Scintilla source code editing component. Lexilla is made available as both a shared library and static library. The shared library is called liblexilla.so / liblexilla.dylib / lexilla.dll on Linux / macOS / Windows. The static library is called liblexilla.a when built with GCC or Clang and liblexilla.lib when built with MSVC. Lexilla is developed on Windows, Linux, and macOS and requires a C++17 compiler. It may work on other Unix platforms like BSD but that is not a development focus. MSVC 2019.4, GCC 9.0, Clang 9.0, and Apple Clang 11.0 are known to work. MSVC is only available on Windows. GCC and Clang work on Windows and Linux. On macOS, only Apple Clang is available. Lexilla requires some headers from Scintilla to build and expects a directory named "scintilla" containing a copy of Scintilla 5+ to be a peer of the Lexilla top level directory conventionally called "lexilla". To use GCC, run lexilla/src/makefile: make To use Clang, run lexilla/test/makefile: make CLANG=1 On macOS, CLANG is set automatically so this can just be make To use MSVC, run lexilla/test/lexilla.mak: nmake -f lexilla.mak To build a debugging version of the library, add DEBUG=1 to the command: make DEBUG=1 The built libraries are copied into lexilla/bin. Lexilla relies on a list of lexers from the lexilla/lexers directory. If any changes are made to the set of lexers then source and build files can be regenerated with the lexilla/scripts/LexillaGen.py script which requires Python 3 and is tested with 3.7+. Unix: python3 LexillaGen.py Windows: pyw LexillaGen.py lexilla/access/0000775000175000017500000000000014647367374012440 5ustar neilneillexilla/access/README0000664000175000017500000000053214647367374013320 0ustar neilneilREADME for access directory. LexillaAccess is a module that simplifies using multiple libraries that follow the Lexilla protocol. It can be compiled into a Lexilla client application. Applications with complex needs can copy the code and customise it to meet their requirements. This module is not meant to be compiled into Lexilla. lexilla/access/LexillaAccess.h0000664000175000017500000000236714647367374015335 0ustar neilneil// SciTE - Scintilla based Text Editor /** @file LexillaAccess.h ** Interface to loadable lexers. ** This does not depend on SciTE code so can be copied out into other projects. **/ // Copyright 2019 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #ifndef LEXILLAACCESS_H #define LEXILLAACCESS_H namespace Lexilla { // Directory to load default Lexilla from, commonly the directory of the application. void SetDefaultDirectory(std::string_view directory); // Specify CreateLexer when statically linked so no hard dependency in LexillaAccess // so it doesn't have to be built in two forms - static and dynamic. void SetDefault(CreateLexerFn pCreate) noexcept; // sharedLibraryPaths is a ';' separated list of shared libraries to load. // On Win32 it is treated as UTF-8 and on Unix it is passed to dlopen directly. // Return true if any shared libraries are loaded. bool Load(std::string_view sharedLibraryPaths); Scintilla::ILexer5 *MakeLexer(std::string_view languageName); std::vector Lexers(); [[deprecated]] std::string NameFromID(int identifier); std::vector LibraryProperties(); void SetProperty(const char *key, const char *value); } #endif lexilla/access/LexillaAccess.cxx0000664000175000017500000001720714647367374015707 0ustar neilneil// SciTE - Scintilla based Text Editor /** @file LexillaAccess.cxx ** Interface to loadable lexers. ** Maintains a list of lexer library paths and CreateLexer functions. ** If list changes then load all the lexer libraries and find the functions. ** When asked to create a lexer, call each function until one succeeds. **/ // Copyright 2019 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #if !defined(_WIN32) #include #else #include #endif #include "ILexer.h" #include "Lexilla.h" #include "LexillaAccess.h" namespace { #if defined(_WIN32) typedef FARPROC Function; typedef HMODULE Module; constexpr const char *pathSeparator = "\\"; #else typedef void *Function; typedef void *Module; constexpr const char *pathSeparator = "/"; #endif /// Generic function to convert from a Function(void* or FARPROC) to a function pointer. /// This avoids undefined and conditionally defined behaviour. template T FunctionPointer(Function function) noexcept { static_assert(sizeof(T) == sizeof(function)); T fp {}; memcpy(&fp, &function, sizeof(T)); return fp; } #if defined(_WIN32) std::wstring WideStringFromUTF8(std::string_view sv) { const int sLength = static_cast(sv.length()); const int cchWide = ::MultiByteToWideChar(CP_UTF8, 0, sv.data(), sLength, nullptr, 0); std::wstring sWide(cchWide, 0); ::MultiByteToWideChar(CP_UTF8, 0, sv.data(), sLength, sWide.data(), cchWide); return sWide; } #endif // Turn off deprecation checks as LexillaAccess deprecates its wrapper over // the deprecated LexerNameFromID. Thus use within LexillaAccess is intentional. #if defined(__GNUC__) || defined(__clang__) #pragma GCC diagnostic ignored "-Wdeprecated-declarations" #else #pragma warning(disable: 4996) #endif std::string directoryLoadDefault; std::string lastLoaded; struct LexLibrary { Lexilla::CreateLexerFn fnCL; Lexilla::LexerNameFromIDFn fnLNFI; Lexilla::GetLibraryPropertyNamesFn fnGLPN; Lexilla::SetLibraryPropertyFn fnSLP; std::string nameSpace; }; std::vector libraries; std::vector lexers; std::vector libraryProperties; Function FindSymbol(Module m, const char *symbol) noexcept { #if defined(_WIN32) return ::GetProcAddress(m, symbol); #else return dlsym(m, symbol); #endif } Lexilla::CreateLexerFn pCreateLexerDefault = nullptr; bool NameContainsDot(std::string_view path) noexcept { for (std::string_view::const_reverse_iterator it = path.crbegin(); it != path.crend(); ++it) { if (*it == '.') return true; if (*it == '/' || *it == '\\') return false; } return false; } constexpr bool HasPrefix(std::string_view s, std::string_view prefix) noexcept { return (s.size() >= prefix.size()) && (prefix == s.substr(0, prefix.size())); } } void Lexilla::SetDefault(CreateLexerFn pCreate) noexcept { pCreateLexerDefault = pCreate; } void Lexilla::SetDefaultDirectory(std::string_view directory) { directoryLoadDefault = directory; } bool Lexilla::Load(std::string_view sharedLibraryPaths) { if (sharedLibraryPaths == lastLoaded) { return !libraries.empty(); } std::string_view paths = sharedLibraryPaths; lexers.clear(); libraries.clear(); while (!paths.empty()) { const size_t separator = paths.find_first_of(';'); std::string path(paths.substr(0, separator)); if (separator == std::string::npos) { paths.remove_prefix(paths.size()); } else { paths.remove_prefix(separator + 1); } if (path == ".") { if (directoryLoadDefault.empty()) { path = ""; } else { path = directoryLoadDefault; path += pathSeparator; } path += LEXILLA_LIB; } if (!NameContainsDot(path)) { // No '.' in name so add extension path.append(LEXILLA_EXTENSION); } #if defined(_WIN32) // Convert from UTF-8 to wide characters std::wstring wsPath = WideStringFromUTF8(path); Module lexillaDL = ::LoadLibraryW(wsPath.c_str()); #else Module lexillaDL = dlopen(path.c_str(), RTLD_LAZY); #endif if (lexillaDL) { GetLexerCountFn fnLexerCount = FunctionPointer( FindSymbol(lexillaDL, LEXILLA_GETLEXERCOUNT)); GetLexerNameFn fnLexerName = FunctionPointer( FindSymbol(lexillaDL, LEXILLA_GETLEXERNAME)); if (fnLexerCount && fnLexerName) { const int nLexers = fnLexerCount(); for (int i = 0; i < nLexers; i++) { char name[100] = ""; fnLexerName(i, name, sizeof(name)); lexers.push_back(name); } } CreateLexerFn fnCL = FunctionPointer( FindSymbol(lexillaDL, LEXILLA_CREATELEXER)); LexerNameFromIDFn fnLNFI = FunctionPointer( FindSymbol(lexillaDL, LEXILLA_LEXERNAMEFROMID)); GetLibraryPropertyNamesFn fnGLPN = FunctionPointer( FindSymbol(lexillaDL, LEXILLA_GETLIBRARYPROPERTYNAMES)); SetLibraryPropertyFn fnSLP = FunctionPointer( FindSymbol(lexillaDL, LEXILLA_SETLIBRARYPROPERTY)); GetNameSpaceFn fnGNS = FunctionPointer( FindSymbol(lexillaDL, LEXILLA_GETNAMESPACE)); std::string nameSpace; if (fnGNS) { nameSpace = fnGNS(); nameSpace += LEXILLA_NAMESPACE_SEPARATOR; } LexLibrary lexLib { fnCL, fnLNFI, fnGLPN, fnSLP, nameSpace }; libraries.push_back(lexLib); } } lastLoaded = sharedLibraryPaths; std::set nameSet; for (const LexLibrary &lexLib : libraries) { if (lexLib.fnGLPN) { const char *cpNames = lexLib.fnGLPN(); if (cpNames) { std::string_view names = cpNames; while (!names.empty()) { const size_t separator = names.find_first_of('\n'); std::string name(names.substr(0, separator)); nameSet.insert(name); if (separator == std::string::npos) { names.remove_prefix(names.size()); } else { names.remove_prefix(separator + 1); } } } } } // Standard Lexilla does not have any properties so can't be added to set. libraryProperties = std::vector(nameSet.begin(), nameSet.end()); return !libraries.empty(); } Scintilla::ILexer5 *Lexilla::MakeLexer(std::string_view languageName) { std::string sLanguageName(languageName); // Ensure NUL-termination // First, try to match namespace then name suffix for (const LexLibrary &lexLib : libraries) { if (lexLib.fnCL && !lexLib.nameSpace.empty()) { if (HasPrefix(languageName, lexLib.nameSpace)) { Scintilla::ILexer5 *pLexer = lexLib.fnCL(sLanguageName.substr(lexLib.nameSpace.size()).c_str()); if (pLexer) { return pLexer; } } } } // If no match with namespace, try to just match name for (const LexLibrary &lexLib : libraries) { if (lexLib.fnCL) { Scintilla::ILexer5 *pLexer = lexLib.fnCL(sLanguageName.c_str()); if (pLexer) { return pLexer; } } } if (pCreateLexerDefault) { return pCreateLexerDefault(sLanguageName.c_str()); } #if defined(LEXILLA_STATIC) Scintilla::ILexer5 *pLexer = CreateLexer(sLanguageName.c_str()); if (pLexer) { return pLexer; } #endif return nullptr; } std::vector Lexilla::Lexers() { return lexers; } std::string Lexilla::NameFromID(int identifier) { for (const LexLibrary &lexLib : libraries) { if (lexLib.fnLNFI) { const char *name = lexLib.fnLNFI(identifier); if (name) { return name; } } } return std::string(); } std::vector Lexilla::LibraryProperties() { return libraryProperties; } void Lexilla::SetProperty(const char *key, const char *value) { for (const LexLibrary &lexLib : libraries) { if (lexLib.fnSLP) { lexLib.fnSLP(key, value); } } // Standard Lexilla does not have any properties so don't set. } lexilla/bin/0000775000175000017500000000000014647367616011746 5ustar neilneillexilla/bin/empty.txt0000664000175000017500000000006714647367374013651 0ustar neilneilThis empty files ensures that the directory is created.lexilla/cppcheck.suppress0000664000175000017500000002337414647367374014576 0ustar neilneil// File to suppress cppcheck warnings for files that will not be fixed. // Does not suppress warnings where an additional occurrence of the warning may be of interest. // Configured for cppcheck 2.12 // Coding style is to use assignments in constructor when there are many // members to initialize or the initialization is complex or has comments. useInitializationList // These may be interesting but its not clear without examining each instance closely // Would have to ensure that any_of/all_of has same early/late exits as current code and // produces same result on empty collections useStlAlgorithm // Common for lexer object destructors missingOverride // Some non-explicit constructors are used for conversions or are private to lexers noExplicitConstructor // The performance cost of by-value passing is often small and using a reference decreases // code legibility. passedByValue // cppcheck 2.11 can't find system headers on Win32. missingIncludeSystem // Passing temporary string into hidden object creator functions: they do not hold the argument danglingTemporaryLifetime:lexilla/access/LexillaAccess.cxx returnDanglingLifetime:lexilla/access/LexillaAccess.cxx // cppcheck seems to believe that unique_ptr::get returns void* instead of char** arithOperationsOnVoidPointer:lexilla/lexlib/WordList.cxx // cppcheck 2.11 limits checking of complex functions unless --check-level=exhaustive but that // only finds one false issue in LexRuby checkLevelNormal:lexilla/lexers/LexBash.cxx checkLevelNormal:lexilla/lexers/LexCPP.cxx checkLevelNormal:lexilla/lexers/LexHTML.cxx checkLevelNormal:lexilla/lexers/LexPerl.cxx checkLevelNormal:lexilla/lexers/LexRuby.cxx // Physically but not logically const. constVariablePointer:lexilla/examples/CheckLexilla/CheckLexilla.c // Suppress most lexer warnings since the lexers are maintained by others redundantCondition:lexilla/lexers/LexA68k.cxx constParameterReference:lexilla/lexers/LexAbaqus.cxx constParameterReference:lexilla/lexers/LexAda.cxx constParameterReference:lexilla/lexers/LexAsciidoc.cxx constParameterCallback:lexilla/lexers/LexAsn1.cxx knownConditionTrueFalse:lexilla/lexers/LexAU3.cxx shadowVariable:lexilla/lexers/LexAU3.cxx constParameterReference:lexilla/lexers/LexBaan.cxx unreadVariable:lexilla/lexers/LexBaan.cxx variableScope:lexilla/lexers/LexBaan.cxx constParameterPointer:lexilla/lexers/LexBaan.cxx constParameterReference:lexilla/lexers/LexBash.cxx knownConditionTrueFalse:lexilla/lexers/LexBash.cxx variableScope:lexilla/lexers/LexBash.cxx constVariable:lexilla/lexers/LexBasic.cxx constParameterReference:lexilla/lexers/LexCLW.cxx knownConditionTrueFalse:lexilla/lexers/LexCLW.cxx variableScope:lexilla/lexers/LexCmake.cxx knownConditionTrueFalse:lexilla/lexers/LexCmake.cxx constParameterReference:lexilla/lexers/LexCmake.cxx constParameterReference:lexilla/lexers/LexCOBOL.cxx constParameterReference:lexilla/lexers/LexCoffeeScript.cxx constParameterPointer:lexilla/lexers/LexCoffeeScript.cxx knownConditionTrueFalse:lexilla/lexers/LexCoffeeScript.cxx constVariableReference:lexilla/lexers/LexConf.cxx constParameterReference:lexilla/lexers/LexCPP.cxx variableScope:lexilla/lexers/LexCSS.cxx knownConditionTrueFalse:lexilla/lexers/LexDataflex.cxx constParameterReference:lexilla/lexers/LexDataflex.cxx variableScope:lexilla/lexers/LexDataflex.cxx knownConditionTrueFalse:lexilla/lexers/LexECL.cxx variableScope:lexilla/lexers/LexECL.cxx constParameter:lexilla/lexers/LexEDIFACT.cxx constParameterPointer:lexilla/lexers/LexEDIFACT.cxx knownConditionTrueFalse:lexilla/lexers/LexEiffel.cxx variableScope:lexilla/lexers/LexErlang.cxx knownConditionTrueFalse:lexilla/lexers/LexEScript.cxx constParameter:lexilla/lexers/LexFortran.cxx constParameterReference:lexilla/lexers/LexFortran.cxx redundantContinue:lexilla/lexers/LexFortran.cxx knownConditionTrueFalse:lexilla/lexers/LexFSharp.cxx constParameterReference:lexilla/lexers/LexGAP.cxx constParameterReference:lexilla/lexers/LexGDScript.cxx variableScope:lexilla/lexers/LexGui4Cli.cxx constParameterReference:lexilla/lexers/LexHaskell.cxx constParameterReference:lexilla/lexers/LexHex.cxx knownConditionTrueFalse:lexilla/lexers/LexHex.cxx constVariable:lexilla/lexers/LexHollywood.cxx variableScope:lexilla/lexers/LexInno.cxx constVariableReference:lexilla/lexers/LexInno.cxx constParameterReference:lexilla/lexers/LexJSON.cxx constParameterPointer:lexilla/lexers/LexJulia.cxx constParameterReference:lexilla/lexers/LexJulia.cxx knownConditionTrueFalse:lexilla/lexers/LexJulia.cxx unreadVariable:lexilla/lexers/LexJulia.cxx variableScope:lexilla/lexers/LexJulia.cxx variableScope:lexilla/lexers/LexLaTeX.cxx constParameterReference:lexilla/lexers/LexLaTeX.cxx constParameterPointer:lexilla/lexers/LexMagik.cxx constParameterReference:lexilla/lexers/LexMagik.cxx constParameterReference:lexilla/lexers/LexMarkdown.cxx constParameterPointer:lexilla/lexers/LexMatlab.cxx constParameterReference:lexilla/lexers/LexMatlab.cxx unreadVariable:lexilla/lexers/LexMatlab.cxx variableScope:lexilla/lexers/LexMatlab.cxx variableScope:lexilla/lexers/LexMetapost.cxx constParameterReference:lexilla/lexers/LexModula.cxx variableScope:lexilla/lexers/LexModula.cxx constParameterReference:lexilla/lexers/LexMPT.cxx variableScope:lexilla/lexers/LexMSSQL.cxx shadowArgument:lexilla/lexers/LexMySQL.cxx constParameterReference:lexilla/lexers/LexNim.cxx constParameterReference:lexilla/lexers/LexNimrod.cxx knownConditionTrueFalse:lexilla/lexers/LexNimrod.cxx variableScope:lexilla/lexers/LexNimrod.cxx variableScope:lexilla/lexers/LexNsis.cxx constParameterReference:lexilla/lexers/LexNsis.cxx knownConditionTrueFalse:lexilla/lexers/LexNsis.cxx variableScope:lexilla/lexers/LexOpal.cxx constParameterReference:lexilla/lexers/LexOpal.cxx knownConditionTrueFalse:lexilla/lexers/LexOpal.cxx constParameterReference:lexilla/lexers/LexOScript.cxx constParameterReference:lexilla/lexers/LexPascal.cxx variableScope:lexilla/lexers/LexPB.cxx constParameterReference:lexilla/lexers/LexPerl.cxx constVariableReference:lexilla/lexers/LexPerl.cxx knownConditionTrueFalse:lexilla/lexers/LexPerl.cxx constParameterReference:lexilla/lexers/LexPLM.cxx constParameterReference:lexilla/lexers/LexPO.cxx constParameterReference:lexilla/lexers/LexPython.cxx shadowVariable:lexilla/lexers/LexPowerPro.cxx knownConditionTrueFalse:lexilla/lexers/LexPowerPro.cxx variableScope:lexilla/lexers/LexProgress.cxx constParameterReference:lexilla/lexers/LexProgress.cxx constParameterReference:lexilla/lexers/LexRaku.cxx variableScope:lexilla/lexers/LexRaku.cxx redundantInitialization:lexilla/lexers/LexRegistry.cxx constParameterReference:lexilla/lexers/LexRuby.cxx constParameterReference:lexilla/lexers/LexRust.cxx knownConditionTrueFalse:lexilla/lexers/LexScriptol.cxx variableScope:lexilla/lexers/LexSpecman.cxx unreadVariable:lexilla/lexers/LexSpice.cxx constParameterReference:lexilla/lexers/LexSpice.cxx constParameterReference:lexilla/lexers/LexSTTXT.cxx constParameterReference:lexilla/lexers/LexTACL.cxx knownConditionTrueFalse:lexilla/lexers/LexTACL.cxx clarifyCalculation:lexilla/lexers/LexTADS3.cxx constParameterReference:lexilla/lexers/LexTADS3.cxx constParameterReference:lexilla/lexers/LexTAL.cxx constVariableReference:lexilla/lexers/LexTCL.cxx invalidscanf:lexilla/lexers/LexTCMD.cxx constParameterReference:lexilla/lexers/LexTeX.cxx variableScope:lexilla/lexers/LexTeX.cxx knownConditionTrueFalse:lexilla/lexers/LexVB.cxx constParameterReference:lexilla/lexers/LexVerilog.cxx variableScope:lexilla/lexers/LexVerilog.cxx badBitmaskCheck:lexilla/lexers/LexVerilog.cxx uselessCallsSubstr:lexilla/lexers/LexVerilog.cxx constParameterReference:lexilla/lexers/LexVHDL.cxx constVariable:lexilla/lexers/LexVHDL.cxx shadowVariable:lexilla/lexers/LexVHDL.cxx unreadVariable:lexilla/lexers/LexVHDL.cxx variableScope:lexilla/lexers/LexVHDL.cxx unreadVariable:lexilla/lexers/LexVisualProlog.cxx variableScope:lexilla/lexers/LexVisualProlog.cxx shiftTooManyBitsSigned:lexilla/lexers/LexVisualProlog.cxx iterateByValue:lexilla/lexers/LexVisualProlog.cxx unreadVariable:lexilla/lexers/LexX12.cxx constVariableReference:lexilla/lexers/LexX12.cxx constParameterPointer:lexilla/lexers/LexX12.cxx uselessCallsSubstr:lexilla/lexers/LexX12.cxx constParameterReference:lexilla/lexers/LexYAML.cxx constParameterPointer:lexilla/lexers/LexYAML.cxx knownConditionTrueFalse:lexilla/lexers/LexYAML.cxx // These are due to Accessor::IndentAmount not declaring the callback as taking a const. // Changing this could cause problems for downstream projects. constParameterCallback:lexilla/lexers/LexEiffel.cxx constParameterCallback:lexilla/lexers/LexGDScript.cxx constParameterCallback:lexilla/lexers/LexPython.cxx constParameterCallback:lexilla/lexers/LexScriptol.cxx constParameterCallback:lexilla/lexers/LexVB.cxx constVariableReference:lexilla/lexers/LexBibTeX.cxx constVariableReference:lexilla/lexers/LexCSS.cxx constVariableReference:lexilla/lexers/LexCrontab.cxx constVariableReference:lexilla/lexers/LexGui4Cli.cxx constVariableReference:lexilla/lexers/LexMetapost.cxx constVariableReference:lexilla/lexers/LexOpal.cxx // Suppress everything in test example files *:lexilla/test/examples/* // Suppress everything in catch.hpp as won't be changing *:lexilla/test/unit/catch.hpp // cppcheck gives up inside catch.hpp *:lexilla/test/unit/UnitTester.cxx *:lexilla/test/unit/unitTest.cxx // Tests often test things that are always true knownConditionTrueFalse:lexilla/test/unit/testCharacterSet.cxx // cppcheck fails REQUIRE from Catch comparisonOfFuncReturningBoolError:lexilla/test/unit/*.cxx // cppcheck fails SECTION from Catch syntaxError:lexilla/test/unit/*.cxx // argv has a standardised type constParameter:lexilla/examples/CheckLexilla/CheckLexilla.c lexilla/delbin.bat0000775000175000017500000000027414647367374013132 0ustar neilneil@del /S /Q *.a *.aps *.bsc *.dll *.dsw *.exe *.idb *.ilc *.ild *.ilf *.ilk *.ils *.lib *.map *.ncb *.obj *.o *.opt *.ipdb *.pdb *.plg *.res *.sbr *.tds *.exp *.tlog *.lastbuildstate >NUL: lexilla/doc/0000775000175000017500000000000014647367374011744 5ustar neilneillexilla/doc/LexillaDownload.html0000664000175000017500000000500114647367374015710 0ustar neilneil Download Lexilla
Scintilla icon Download Lexilla
Windows   GTK/Linux  

Download.

The license for using Lexilla is similar to that of Python containing very few restrictions.

Release 5.3.3

Source Code

The source code package contains all of the source code for Lexilla but no binary executable code and is available in
  • zip format (1.3M) commonly used on Windows
  • tgz format (0.9M) commonly used on Linux and compatible operating systems
Instructions for building on both Windows and Linux are included in the readme file.

Windows Executable Code

There is no download available containing only the Lexilla DLL. However, it is included in the SciTE executable full download as Lexilla.DLL.

SciTE is a good demonstration of Lexilla.

Previous versions can be downloaded from the history page.

lexilla/doc/Lexilla.html0000664000175000017500000001620714647367374014232 0ustar neilneil Lexilla
A library of language lexers for use with Scintilla Release version 5.3.3
Site last modified July 22 2024 		 
  • Version 5.3.3 improves HTML, JavaScript, Lua, PHP, and XML.
  • Version 5.3.2 improves COBOL, HTML, Lua, Ruby, and Rust.
  • Version 5.3.1 improves Assembler, Bash, Batch, JavaScript, Python, and Ruby.
  • Version 5.3.0 improves Bash, HTML, and Lua.
  • Version 5.2.9 fixes potential problems on macOS 12 and older when built with Xcode 15.0.

Lexilla is a free library of language lexers that can be used with the Scintilla editing component. It comes with complete source code and a license that permits use in any free project or commercial product.

Originally, this functionality was incorporated inside Scintilla. It has been extracted as a separate project to make it easier for contributors to work on support for new languages and to fix bugs in existing lexers. It also defines a protocol where projects can implement their own lexers and distribute them as they wish.

Current development requires a recent C++ compiler that supports C++17. The testing framework uses some C++20 features but the basic library only uses C++17.

Lexilla is currently available for Intel Win32, macOS, and Linux compatible operating systems. It has been run on Windows 10, macOS 10.13+, and on Ubuntu 20.04 but is likely to run on earlier systems as it has no GUI functionality.

You can download Lexilla.

The source code can be downloaded via Git at GitHub Lexilla project page.
git clone https://github.com/ScintillaOrg/lexilla

Current repository status:


Related sites.

Bugs and other issues.

History and contribution credits.

Questions and comments about Lexilla should be directed to the scintilla-interest mailing list, which is for discussion of Scintilla and related projects, their bugs and future features. This is a low traffic list, averaging less than 20 messages per week. To avoid spam, only list members can write to the list. New versions of Lexilla are announced on scintilla-interest.

lexilla/doc/LexillaDoc.html0000664000175000017500000003221014647367374014650 0ustar neilneil Lexilla Documentation
Lexilla icon Lexilla

Lexilla Documentation

Last edited 21 April 2021 NH

Introduction

Lexilla is a library containing lexers for use with Scintilla. It can be either a static library that is linked into an application or a shared library that is loaded at runtime.

Lexilla does not interact with the display so there is no need to compile it for a particular GUI toolkit. Therefore there can be a common library shared by applications using different GUI toolkits. In some circumstances there may need to be both 32-bit and 64-bit versions on one system to match different applications.

Different extensions are commonly used for shared libraries: .so on Linux, .dylib on macOS, and .DLL on Windows.

The Lexilla protocol

A set of functions is defined by Lexilla for use by applications. Libraries that provide these functions can be used as a replacement for Lexilla or to add new lexers beyond those provided by Lexilla.

The Lexilla protocol is a superset of the external lexer protocol and defines these functions that may be exported from a shared library:
int GetLexerCount()
void GetLexerName(unsigned int index, char *name, int buflength)
LexerFactoryFunction GetLexerFactory(unsigned int index)
ILexer5 *CreateLexer(const char *name)
const char *LexerNameFromID(int identifier)
const char *GetLibraryPropertyNames()
void SetLibraryProperty(const char *key, const char *value)
const char *GetNameSpace()

ILexer5 is defined by Scintilla in include/ILexer.h as the interface provided by lexers which is called by Scintilla. Many clients do not actually need to call methods on ILexer5 - they just take the return from CreateLexer and plug it straight into Scintilla so it can be treated as a machine pointer (void *).

LexerFactoryFunction is defined as a function that takes no arguments and returns an ILexer5 *: ILexer5 *(*LexerFactoryFunction)() but this can be ignored by most client code.

The Lexilla protocol is a superset of the earlier external lexer protocol that defined the first 3 functions (GetLexerCount, GetLexerName, GetLexerFactory) so Lexilla can be loaded by applications that support that protocol. GetLexerFactory will rarely be used now as it is easier to call CreateLexer.

CreateLexer is the main call that will create a lexer for a particular language. The returned lexer can then be set as the current lexer in Scintilla by calling SCI_SETILEXER.

LexerNameFromID is an optional function that returns the name for a lexer identifier. LexerNameFromID(SCLEX_CPP) → "cpp". This is a temporary affordance to make it easier to convert applications to using Lexilla. Applications should move to using lexer names instead of IDs. This function is deprecated, showing warnings with some compilers, and will be removed in a future version of Lexilla.

SetLibraryProperty and GetLibraryPropertyNames are optional functions that can be defined if a library requires initialisation before calling other methods. For example, a lexer library that reads language definitions from XML files may require that the directory containing these files be set before a call to CreateLexer. SetLibraryProperty("definitions.directory", "/usr/share/xeditor/language-definitions") If a library implements SetLibraryProperty then it may also provide a set of valid property names with GetLibraryPropertyNames that can then be used by the application to define configuration file property names or user interface elements for options dialogs.

GetNameSpace is an optional function that returns a namespace string that can be used to disambiguate lexers with the same name from different providers. If Lexilla and XMLLexers both provide a "cpp" lexer than a request for "cpp" may be satisfied by either but "xmllexers.cpp" unambiguously refers to the "cpp" lexer from XMLLexers.

Building Lexilla

Before using Lexilla it must be built or downloaded.

Lexilla requires some headers from Scintilla to build and expects a directory named "scintilla" containing a copy of Scintilla 5+ to be a peer of the Lexilla top level directory conventionally called "lexilla".

To build Lexilla, in the lexilla/src directory, run make (for gcc or clang)
make
or nmake for MSVC
nmake -f lexilla.mak

After building Lexilla, its test suite can be run with make/nmake in the lexilla/test directory. For gcc or clang
make test
or for MSVC
nmake -f testlexers.mak test
Each test case should show "Lexing ..." and errors will display a diagnostic, commonly showing a difference between the actual and expected result:
C:\u\hg\lexilla\test\examples\python\x.py:1: is different

There are also RunTest.sh / RunTest.bat scripts in the scripts directory to build Lexilla and then build and run the tests. These both use gcc/clang, not MSVC.

There are Microsoft Visual C++ and Xcode projects that can be used to build Lexilla. For Visual C++: src/Lexilla.vcxproj. For Xcode: src/Lexilla/Lexilla.xcodeproj. There is also test/TestLexers.vcxproj to build the tests with Visual C++.

Using Lexilla

Definitions for using Lexilla from C and C++ are included in lexilla/include/Lexilla.h. For C++, scintilla/include/ILexer.h should be included before Lexilla.h as the ILexer5 type is used. For C, ILexer.h should not be included as C does not understand it and from C, void* is used instead of ILexer5*.

For many applications the main Lexilla operations are loading the Lexilla library, creating a lexer and using that lexer in Scintilla. Applications need to define the location (or locations) they expect to find Lexilla or libraries that support the Lexilla protocol. They also need to define how they request particular lexers, perhaps with a mapping from file extensions to lexer names.

From C - CheckLexilla

An example C program for accessing Lexilla is provided in lexilla/examples/CheckLexilla. Build with make and run with make check.

From C++ - LexillaAccess

A C++ module, LexillaAccess.cxx / LexillaAccess.h is provided in lexilla/access. This can either be compiled into the application when it is sufficient or the source code can be copied into the application and customized when the application has additional requirements (such as checking code signatures). SciTE uses LexillaAccess.

LexillaAccess supports loading multiple shared libraries implementing the Lexilla protocol at one time.

From Qt

For Qt, use either LexillaAccess from above or Qt's QLibrary class. With 'Call' defined to call Scintilla APIs.
#if _WIN32
    typedef void *(__stdcall *CreateLexerFn)(const char *name);
#else
    typedef void *(*CreateLexerFn)(const char *name);
#endif
    QFunctionPointer fn = QLibrary::resolve("lexilla", "CreateLexer");
    void *lexCpp = ((CreateLexerFn)fn)("cpp");
    Call(SCI_SETILEXER, 0, (sptr_t)(void *)lexCpp);

Applications may discover the set of lexers provided by a library by first calling GetLexerCount to find the number of lexers implemented in the library then looping over calling GetLexerName with integers 0 to GetLexerCount()-1.

Applications may set properties on a library by calling SetLibraryProperty if provided. This may be needed for initialisation so should before calling GetLexerCount or CreateLexer. A set of property names may be available from GetLibraryPropertyNames if provided. It returns a string pointer where the string contains a list of property names separated by '\n'. It is up to applications to define how properties are defined and persisted in its user interface and configuration files.

Modifying or adding lexers

Lexilla can be modified or a new library created that can be used to replace or augment Lexilla.

Lexer libraries that provide the same functions as Lexilla may provide lexers for use by Scintilla, augmenting or replacing those provided by Lexilla. To allow initialisation of lexer libraries, a SetLibraryProperty(const char *key, const char *value) may optionally be implemented. For example, a lexer library that uses XML based lexer definitions may be provided with a directory to search for such definitions. Lexer libraries should ignore any properties that they do not understand. The set of properties supported by a lexer library is specified as a '\n' separated list of property names by an optional const char *GetLibraryPropertyNames() function.

Lexilla and its contained lexers can be tested with the TestLexers program in lexilla/test. Read lexilla/test/README for information on building and using TestLexers.

An example of a simple lexer housed in a shared library that is compatible with the Lexilla protocol can be found in lexilla/examples/SimpleLexer. It is implemented in C++. Build with make and check by running CheckLexilla against it with make check.

lexilla/doc/LexillaLogo.png0000664000175000017500000010331514647367374014670 0ustar neilneilPNG  IHDRYIDATx}wvWwsM1-ChB `BPB  @ w0c{;+iUF#=_zhF{77n\"`7i0>S>6N 7/)8E##jx#다l4Z(8#IH;R:_ 0S8 ci3^,aس1lXí)Z&Zu`E5^g,xKcdΥ( ISo3|G6x6dD"q ]ޫ~QyNn~vn۔nٴrWfxs}VN K9ܼKRO:vÆE/(ؾGOROw8n꺺k^R?Je/<|S%>:ӹtn*JoL5/ZhG~,*HlXR.(J~dMSwN }6 bT 5a#wB<vSaVDTu %<7B=k 1fBD?UFF_* 7ȧnx 2'g 'ȉڝ+!K @  07f ! xNW7 |$6sNA.zhaќ)xE11ƦT0_Q44~s|)L"D.)?ұgoaCU]V/eM$Cou'£d1.+}'\:؞`3֪v?#E˲c^eU?gn M=`mD{}"cRn5 (>ێT@?@^:D-Gb1ӗ2ep/.^{N;`0#`KA Yrf@ @ fM82blO.1!/|T^RD+b|R5z<(s"E>ٛLcJcl]نq$&%`뛮y.Aiط/2 LaO{,X܍egSy36D6'8"{|)$S/WUUZj]qu;nx?imLZY$V=ve=zS;?~[;(}`f| LFgǃsSB׫VmuS;ø*rj]"L:XۤfID΅4Ƣ r"'i$`| @ aG,w|dB > +' 4"E0˄b©Ld*0 ~(o)JcQb11Ɠ"*הLYiVrcJ9֜.~dSڦh[M|dRԬLVN^[Y!'Co6f̘s ǿk6g/V8y֤ngΉD~?lρUb1crrr^#7`;c `| *`𳄉/.rҴ@ai$N )rek Oa?aRS;gGc X8Ia:t6^ϋw3@ @ ;?bXLَL 6F6I%l8c0ȞnG;s0 D0-2f 0r:؂󚚚Xd!cţuUӅeMMMGuYRtaNEEĜNK[7A>%fö9^p,Dh^vI]h'qIJLg%cџvI=h ‰=xlŹzI]O[q``.$@'CG"HJ`'Qʎ09xKdwTZeb(cBzq6@ @iaf>ǰ e&}&kk0xHt3Q{%2qbH/qŘƶsY}첋W$I3SvE |c~6tFQڣ|t0DwƽV]Rn\(*@iٶs5 /ӓyT*%3f3'.ґ;ذ/aBn#uEEr™Ikm)z%e-t5RG$wX.^bmOɒ8pOsF'+ />6|%f^az_:;|³ wjoօat0;[@ @A Om g XPS'`Pe-`ϢDZ*wwXcv O+aX 52*dB 5-^Bx%oRoX/~-_kV䍷5wFq}:;م3ߑ]+Də^.^6\-MKF$srXsIgq2gF<9Dꙙg9RL^Il2ڽ)lB-x` h 680Ifa☯[rrA9qnP~gg( 8q:I)-`l|0vf]u*F(  ?HKnG1H8)`(JOf!>,r} =,y9X.@ @ '; ]8+'Nhڧq2}ZKL,r/\khxOrczg/>ƹ@i.*ggek)x=2+I׊F;c}w0O2] "`-m_:QS[s(i^< v@ @ <2vd, + {g+0Oc._y R=^=o,@Q4aâ}`G`&Rz@m;%ǟse1=C,f[s5[~׈0 8KXfRᲈd UTTTTTŻ!ҧxkgvbwE,mֳn/s"-Oב1{L*@9No~:H[eAg =/Ë;51;ʅd;tG;' "v}3xSX@ސK`7y}`hwN @ 1kts׮]7=/P5\i:_OO$>`%?F]ȱԀ FF"- _/y / Sr9ԵKֲXW,#jIU0 ZqcZ;MhmJM.E@%ƭ"'0fP':{@MҒzLخ9ZΜh=+N>vh'Ɩ{`lv_Fv%~@7/an<:۝=a㮎7x)zmVN".@f 0M:)x&^ZdC9`^/fzS㿶Ͼc-@ @ ;?@o|rmŐphJf*Ai8pٲe^ |a}?;U#/v|ܴǑ+} n|;9V뷯 1 _`nA:s' 0!ql`Pu`~|W6C5'uK ;'ݼ\F=8?O408 nx&F_x9v? 0]@ fi(/" 3#{!󸘅'=NoR <r.'C'}ΰ ^N£ٍ-XTp3R-Y@ f"r oG[{l7k˖-_S-~"|"tCug[X{(X{ ɇ+,m²BXWFVD_sMXļV%r3&\kx1<(x5xgGJᤆIa&3eN@K+rń|ڛmގT!eD<܂4Q_%Dc0@(` Z)^@*c. 0;L @ Ώ?٘? c iM]q5~e/Wd*Oԁrt*?(v⨂rop(7 Jol17[D[/~|ցԀW ٷ3ooH = ^~1uy~ѾuwʤeIQm d0?SΡӏuΝ;wT+β*gAf5'l%-YDg,'lNq|O FOo'xN09w퉱y_k CH%cl CH-gyǛLK(I/;G2/\?wNYb_U`46@ @ ;' 51WFX~38aЯRJwo^ 'p,HDiG6$B>g ٲ} } d(f =.憑35ܘL&Ν+`߅+1v;j;_mCp3?d)F\߯L?Wŕ兟2y5ԁT2 ~1ھ*}  *+:͘@ @ 1edP]"+80͛WU³UI8T0gxAut6KͳNo^&0UGe`Ç%S4<0C׈(8ƅVjt/H-qlJ3˫(:xX>@#jk[v6t:=w]wZ/qDr[X=3:X,A!xZ^/Hˆ1K/fl^2UƬ\aMoq:#UH3xRF,\Nɧb\3)fx# 8@ nNbV@|H:?@ @ ;9`W! Pӻ{AʏϢSYF6`D$|X&#8&4KaL  ߐ`35>ŘTlOK?eӞJ= ^++9hS D\D"q>xLs-KE_D>NlS ͋/">a̢`<~ٚ0f "t.enGgH s[@?5sE+<8>@ @ j8>ZVk鸉|T2+Ӯ]83~ ateb]  xuFxg)/5Űxy݂PpAIyο7'y{7 vDG>9 {<+bl.rLҙ1cGWN#HF抑5%ﵾJ06Ey٪2w7bw慹u:#f³_xOq΅s"h*>0uRsJm\:#cx0@ @ ;&hѢzqmHH*qk=ZT׭?Tt,Y0Nc (r8F^"QG!W;f؊D‘}wRb罎Pe:x!1:m۶_ERy:8Z C/)Aep?:)6٣)FRpe$n\P2a|%P-*:)t|lzg``> ib( _ 0وaΑkK}p_eڸ"@ dd?zL^Kx"MډL:OLJpk-񗯎6f߾RAkՐ {-L3ۦs8}-3@*w@ @ vrĐ+Q"I`pLnA9U9CUg&3տ/?}3 ςLj+}HKQy5557|\҉Cm<+ gDͶ+tcΛJ&29/_6jDKrDKG2mUWdDU[ wرr686kdcë7[)Vj#=H^:㝷~-G{S*cŻ/Z2{InzF1nwۖ+֑[Bۑ;3,b |nޘ>bw^|ɩ촉1.lMH}Q~z'!"LB8CnΰMX\` c{?v_NEW 쐞U :g'DZL YӕC>E[c_ۘV9fqcn8gZT0TEynB O|{n|Իa&PdoY>{W&o\n),38)=}R"N˷o.^?B\n99[Jn g7DWgIOsǬ=5#L&Q{/˳fMWKZ[rɼ 2dSVn̻/~؂1!-ͩ-Au4+w ;ҥK>}~e}c\!ak. &³j|)0DLzu +ʹv]" lcV+ym}{͈r'"@ 5aܲQ<7Nzqg6zwdf)JIl|V}Jcܑcf8Bj WiuDYQqi6mj~SA^J/?D-֔ ɕ_,,:60[{2;w_$Oo9ҶO6<~t&fVSSkc|•/_(T9mK|`z y9q&d+'D;hyNQ,xA[_憺w… :0Ɗʻ~;,3[(βq<}ٟOI78jvLNK&߿ [slHU}ŽX j*)ľ|˅߲-]+Scw0aҎ#K:/PtBN[7đ*/2 y#m>'88WׂSVԘp"rq.H0!ˆY9s3s,3_wm3F+`[bsoݶm:m!~[ A $eT jy2Y0U˴+d}H2hb\ȁc;Ca?A*'1gX@C0  ` _חE3}zMHqSۦS.l낔@ @ 1ۿ6E049;ٟiUYq/)"K4۹sg0r8j 9(gϾu[(gjTx *xk{wʑˠ]q4 ~ܯFuug?TV\'ŕ;rE\>X)IIW=]פC-**D"J-9nrh-:t0`פFTOgݶK}9o& x|`R~`N}lS̴TjΜ9>O[!!W|caXu8\XW,Y/7-"WgO'N%;r~x1e_Kz'v~"\-)clGft3䜼~~L{X,ތh{I:C9C9pAywkz?|]X;Qo~wLkq>jF`&n-`9l=^rڗS!N g[`t]0 3l놴0+jxmE$@ a';܎@/fiv7"JZM>Q:%bd5M 8i%ۖu-kMS]V/9ȑo4WnliiꂢTЎerON˟W7k6]X iͪTxI<JG2ĝEkxk3K foٳE٩]Yp!ٚƖ9أ{/%"ŋ"i&׾gGÍuZS4e?fqF_Ahׯ_~zY:=p[NfcJE[$zy GF$Qj&A_;Jx<͡0/֔#GΟN՝T6(p!$3" 6)m{~}:` Ư V/!?gy͈dHU:~p<%`zKeXp#rt^zvv˗CޢhO3`k!@ agC ҁDahOׯ_cj)@2Ka\YA))tblDǎ]Dg29Z!ݮh3cGao=&zxZON?*U΍ixl1K$r ߫vkxA1ٌCEY^{?y˹̒xrRԯ:skKi*/.>9ӿ9DO].#clIg3jw~摗s}mnRVO>`G+'~F7EN:3:;8ßsf'x&O*g+?+'+oYϱMmkǏg KXhEZ^>ym7a XQ3Kl_4x4ӆ SMä&.z ).x"(ԇ^rZII å㜍D:Y/3xRHʾR`\9 P7Doiy0ˍ$`|cJa9)Ech} "faEݗykvlխ|)Q39"`ɼ\Ə>-JRWd9V[ZECtν7 Ck^.sCN~{crLUQ\߾O??N<+Nԝ*zݦ$v ccv,Tg&2LZ;s&*Dr=Bv|}]#~y}?yeǼ;zh㤰 ,[) ƔݶȖ]m:oנ2V<^38߫^Vm[#lTz#ːa11| ̌W53%Ürah@7S'ѕ3<"nk וF|Ә&@IWxn}I @ j p?WcEn7s:F%񨤭G3׹ú=:77-Rq2gH<,ur{TljSjF?c ijg?]vƍdt|oR-[͠g/62)/ޱc~1V+5;eڬeԨQ .LsqO#|w}̽vF n"9). =PvK`2`e{J4rO_u>d;3~[5&WUwE"jywe~7=8}ދ}fZa+XyӲ^vMi<Ï%7^1;G!mƋa7a"9流)`BXW)b(56ˋ[x@O"ع"),B@ @`2Lد_#ckx[DE\OE'3||ڝa&`>L0,LO7lذn:`Z_W36vN:ƕSp=[dӼ0X6ê3A9~Z;_*HC[)J&'<aϸ ({͏*]+je Q7Y`ӪYlqhis~j'7 n)W5Iuuu# 0>dɒ:^N0A_:vx</%%%oŠZ9KKSɞSČ{_ɘ>mit_ȯso;0'? rѯ`3Q)oesz7)0{qMʱmxR1ɀs{gĬ2Cc|O#YZC|gÈHQp tƃpD"aF3m1@ @ ?f>1$Hnp[R~۲2T0ìg2Ǝ6r!#@г&gCIAթ(O͌i˷7c%0F}ͫWpfRTN~sTdgm`za`"1{T*%lO%..+/Bo1t"˾[ܹjX$O{6r<)iՂ[ ʴmÞ^aɶ?uС/VRW>#ZNى[vE˳Ey.YgcJFQXc21vۓMo=o`|!e]s0<\އe8n#FD~?ЀϘJ1e՘ `Aۂ4|kiT :߱ν, `&xehW/}qNW(@ @ ~(@#QSSwĺP=O(sCGڧW:r40";uE-Wzе?@('I後eesjd-MF01BѺu6l` |'\9Tҕk|HADO߃'|hO$]^ZRR"*Zw]ʹeYFoSLҤޭ8>{ttvm%2!SygD}\@>c;耣tn{o"s׽]McHXer pSNQ6ّ9 z^7[Z".08 <58aBkiU8nn6W5;{1F @ ΀W:Ȉ4W0sbu̔宋[>ߋsf!2ES;O:,zOϙg:8 μ˘t)ziR;1dǖ}"9 tԫ}!+FWBs9u[Ҵ1VSS31zinnjͲ#NcPˑZ~I<%/zUPP+7:j=ةתwƔwY2 QFe;ut~Ƅś Ʒݿ=Wui֭611:vKѭL:e4ooE]7aѸA6a`)*++-Zsds%ضɥ c؁.H0:we+Ϩfl]7gLDm]`x1;c7:R eRsKh^ ?;Ep elN6fj>a syil1knxl= @ @A ύ 0֨`xEVyJ'zm\0bY"u`9CVnʣφVKi{ڵ͛I{^ˍ-eY*CGXs:;#y\'0{3[? ⢦Z*zYvu]PիWo޼YhL.VR:MMMϿnR[nijjhGQ!t:5745c-u-qV{?nbNL+YTF7coldڛ |ՔgI(V.!/Gе(ɕC>GҗY- שaJcl n\R&8\ dYݷOf37_$|fٯr-Z'x?o)X,!oa)}}"S ۽h ϧGD ƱaN|t@մ5"]#@"DHƢ,1@ @ ? XkySFϧo9D*2fr9 P0`@:1 4%ӺkZ+~k$'\ǏL|bhfKv-ٻ&LLS ;nhejذs}ֽ4k ׅrpU\v%WzضX*xg$2\lP kO$yk^_Wܒ*E}?lZ`Ni_s:cpfpF7w`tȊ("ΤZ8I)tQv)^4rEM:bxj=ch{Ӳk b{W[&׳kOYŚ|YFV1n#x}߃ XSP.ZRRr{X#QG w6Rd5Ne4slbAGH6lxɯ[K+K S*RO=a3%9 dR26SOc| 0~.'u&mYbߟ "rs S#zlc<~q,19E,D^$BHda`6X,gOFi!wQɩ 3 s@ @  0rld O>KB"ۚU,CntaAg uD (nnd[R*x]:+/ foB6T_"9ć0#"J3DYSSsEʷw8X @+ĺ}_fF= mIbhηM9(/'.36,;=nKJJԹ}Ʌ1f )œQr6]WZ?hРٳg H /\+vؖ--W&Vwرٍ򬩱SPUԩ~ɿʴ+2=,$qɴl}ӹsO߾jXYYY{Et~LvmpFIz. 3ku p@ΗaԾ2ƌmH9m^Zugs_z}0 X/R Pu@r}Nne` ^X ~+ @ aA Ϟ!g0&̊ O8J3 oo/& Z B`![ \S-)=YGwiqnN&g5Gtēin 7T5`8y/e_m V*'T:#Eζ4zU3i+yiTz_w8!DdM#s-y fvs;#~hw]ˍ싚k3&z@uu2<q*#G9PߵMy_(z@J3 %xm{qjj~Y` b ex7w)-:ۑ@ p 4&~-|c-'L8xX& i拞ٜlS%cH1!"dt3)>n'>7a-2֓-e9*` fɶS(R2'2%؝nxĨiɾf`ax:a:wvp-lxa @ @ةv W+Sm޼yr̞mg ([JDnzC3) b,HbZ/=&(Q.4%"8c oINjl9s\W>E&oJ.\T *Ch` SmmLsF7oatΠ^~3cE,_9.*f9+<(~a5^T[h<} S*c/,ͯoU\eu_KKKwv^E"7J6%[=vO>}ݟj DLX@?UxԘNݭ%Zrή2y8hџ#{p#ۥ7P 76 ̅tҁ aU6X^mC` QQWi؜ýh q  @ @ 0,DbE6F Jy}Ji'0i%"d[.öo :Q3Lѿ& &5љZJC=uҥR/:xԨ}[VzG~X8X[x!0ˮW-yKG֞EϞ=n}ݰv:|7fWSKM]`$ltG* Gw=ʐvܾE@ @ /q3DE7ko<{rJ\i7m@=׬"FS:8 )}+SRdHL$u:ZժIYv/b)'2[|kQRL88 `<w=e]Jucq#aopB1_7irBJ>YLm|jG,C2?_s=t1rc.nW g|atܸ@Cvm:L{eC9jk]SI:tl{>7\·UqaƜ_1ؾ}?m~ϟ"-r?>M41#H,8׆fX\&1{]\H5s63N"x[`j s<)'0%Q(m '^ށQx@ ? sCt8F-p8c1>(@v`{W0K{(2KଝivcNN͉nQ>7~޳OZ~}mx_^#MXx;} N!@ at 42%|YzZH| "N5ZD,@ @ v6Č uvύ1 tNgcA\㤜3 %mm|`ôܹ͌sXKKKl$M>Tݚ\;SU2y74c{ޟֺ8drqv}w?1kXv:WYV8v?'uDFz,ZxJr v2kHa*+:g]<OA(>ՖP`my]իq0}=kV: yZNܻH¯ȯ3`6=C_CE,۷^ổ}6<%Y2wsm w#8I1Ɇ f{҅Ʌ.=mڞzTC8C؋,R;: Fy1`3N"0119h#XN-0Ycʎ'`A@ @ @G ~D=GtH=y@#T[7[Fٗ=*wfr GQQ(d\)#&*cSce_xrkm_%a+R"ӖhUɗI ɭdӿ"CAl O466n6π˶EX>@"[7~\(u6W9<2f̜xAw OLr%gSh/kݖ[f}1 +>or W@҈D[Yl +h>H|P^cr7\<|EG1*}RindzJ#r1t ^l΅*)/f^_1RxmQl) @xR8橭R_Q:Oq*?ڣ4 `Α#vam14񝝣$@ SAL8%2YbŶmHde"Z/r)rGq#0Bh2<&ͼ[n6mM'QʑLTäC Ԃ(Lw-^Fj߆;[XzBoTm[/)UzWl"'C7NX]E){6儤r;7X,VZZ^Sw}ݥo8J|:oo9WȡC' n.ߞ["ڶLh7JzeСC}7 k~x5SM-Js zά7^r^<&DtENzO[Rc0Ό@ ;6r_8 ^ adD ޴1_x!-Fcxf`$ wm?ziW:1DR@ @ v@줩sk#9:EDg_$XQ̇-wh 0īQǶļ_q#.{^~lJc&yy.C:jJbk7p| 9ПD'v9LJF)AapnGxثܺꣷ4/sQF<晙N*R<_q8lR?J>&4;w2MMQ0%չ!+76EKf念&f YsIR-?Pڕ+++3.-/2?GYn禦ƙ蠟7?`Fr?_эɰsF~ V 6{=E=7>fvCxk ۸d]#bS;0 H1R^zs F @ ΀Xo+ѵk͛7Ă|LLKA(\3k~ (UAN`9E>ƴx\Y-+V9Z>UM` omǛ:tN0`h2NgϞ,0TtuQok[0J ycYohn9o/;]5/-ٱgfAǸfӆ?t,q~7wg@$kzuJ6D[~)WS|vIE8eBJle73 Nħtz+`NN @ ΀d0.#1jjö ɾ(Xdybe!t)37F&m#*˾XL]f0CE srPH7Ը>B 랸 @@ ALj+蜈HL/&L*ō56ؾ=lԵk ʹ"J6  fKY6߹I9vTr>C~%C(j؟02Y_q-Pˡ$1b"u[r-[*63cNOSIɝ̙d "N9W?P}%qʵ-ve7於#Μ2e6.]} n3n-{FBjI̤R\񆎱@cƦc(fu ~K2Mj'x0Y݋.qld9n d o^(xx~) I @ =~xo,A<0a\"1'JWz(3,ԲL0/w^hGeڵ7n-5ট߸1^CZ^{[?O ݘUKӢO;/L8 b_/,pRIInoo_G$nJ3xQɲOv8&16[|] V)fobBZ֖euT.m;t}9ɍ " Rn&dlBy.gϞJO+]vkWg]n60CD<g1JMXkg,2^U#6n{]?8\Q&B.Wݫ]$ޭ(羄!y,cK GZ߇j^>D`ACe"g165m0`F<Pn 3v'pC&/1@D5m+"ڏ(i0"kY&9y)9S@ @ 1ۿp0 hAҎ7vʤ>Ԗ\)WҘ/?im>, X8 cX_Ξ%{QƤsg*.&ʨ7J󊺉drҪ2-399uɿVӗl~ztql9Uc䌨B;s\cϞ=em۶b ܌m i WKKK6bn%UmזN`Ç d❻ozaY(Y W pAop_8˹KR LC1!VJΣW7sy^yaDk]cL>x:G@swJ6}T +rffрe-+Lړ#,!k~?@߽·S- sWc}Zrbf8ۘ7?{ұA b%X1R ā)ԫr|@ Y@{Eb Y+tLJpUfŕ2-M }m[Tn +*V%)ʔ\%bꥺx" ߢ)d\Ɔi٦u6fdaf,Cb;[P>y_~rrR4wޫWf>Tn:S6gY- >gƞ5jT^Z%Vu3g.mQ,$y_ bY[dK"߫؞hb~كbxرFm<{:_]RP%jYz+֭"2kk$%~<ȡMN FyuYA6a8Ck eR_t ܠX* MѹY`鼾"y=9zs:$^BaZ2//v:,?O}@ @ 180د_8vA(Yb 3RU[1~Ctj;y)A lVIIuwuctU K9V0?O7ʚ|K/w9] ?Ṋ6V;) `1y})Q^tiD"x)kAtƬ~>1*=I{m½5N􈰝oI4@ @ 1l8 (,X$LD$CR Vwvy- hDs8s2L"3.-/2?,:۷o_|ҔnVH*uD0g{oXLQFѹc+/^R6k< Z>aU=OBze+c=1Z|# .lhh0XtHp - .USY;V"!i<#Z>xdb~mciN2.\koE.(y6ov䞰ȑ#fbT{7Lq]6ݨ:(K난Yoa>ù^?)j$oN0xUf`m ᤆDHgkv<L 6ל $tva@ @ %kB E|\AЭ[M6kꙺ#ay:V;쨺:HpaܹӺ/hgҧ ϢJώ;X=. 2_3WCov1F/-Gv?gxTrkݖ]젪V-aR6^$JBDP>6z3g>E'tclHגPsY:A ͔D=;z긕֎D"q?VYZՏFn1iJ^;?aٖ`<(8[zD6z;rJ cC?tɹӍpNt|e΀g}CȧQ.羑3ïBF~[c,ҿ͆u=jҙ]~u%,PY'?e^2o<ӯZ uDu1!׉}jwOu~lJXr-[5X= /:nlw0ѥAj|7*Z֮]qFFZ>vgm/(5o^~a7LcEΝ;Objr)Mʀu4ckDRAVQIx Yv;PsZDl/Hz-k[qQSps7׎䔯q+d9cKmYᶾՓΫ5Z~iE1漳W9@`yoc6i?F-7b8.i#yjG'e%!n9x3+`یF"X-.}"xaiCXPzۜ9ssv0(Sqi<81?XLIw]k;\|oiD5c"e~ln:Zw"&՗/P6a) S[+;6nu*ق&a /V/]Km Xq-g_ $5;V7.Xj[CbUUnnn^N΢s: 1%9eK٦{ts>'۪k׮Gmʜk,^wt[1UZ>t¿4663a4''<G3+߿=SҢ%Brԕ愜C<׼x cOh?vc@n N@ǰd7(mY+8^Z@ @ ;3b}wտr444lٲ*l5ynJNB %jʙ4ꭂ_JJJbXXT-\~]EEťG:s17?X[Rd!yg=ךzXU}KE&rQEL˖-;WJ`[d%]d[3[.puI5tghLJXŒL5+s۹r;X,ۍucmd|AN cOrp=HUV5EÆ +8%T, a-GJ(Ex J\"unN5 *ۿ+k0W uaee٧!>iȐ! dM$mYkr^f-V*o=hL7b'!,KRoޖ ƙZb )|E8k!5#=`pƕ !5glnԶ? ,ȍ3CN_CO`d 7d I9y3@ aήw&.<`j̚# *~f@ @ ?\eb6ʇ 5$Νˆ^Meݚʻ7WTua<SUuJG[33|`>P*E CI3UTX12L&Վ kX&/>Dviw2DL$97L9ltEi2gvԘ2tM]_l&!*Sy=3%-53H?YtwrJE;v3\dK:yհB[%z)//6?k|,,bjFD*A'$j?J`LH4G3p{\e(fR2xSz/=sѻLQW8K·wŒM*Me9}Dƶy߶)~m5?|Ƽ.غ`EJY^`gSa_;ۺ+WToWdmwO=rDwΎ`+3@4`8\n<3NlE 00 ض= =e p1HE#J\H0|" %8@ @ ;bgޞ$']*PIxaOGDXXc\rL OeZR P XG~=/9҂"UZF>LI*"Ly!H*^4L٘\F=0jkk.]|M@R,3Mڀ ؖ(<7s9hY BkSPSڰdW\ui ?IxY|9b\)6H]W,b`R]]}Eb1e97XWY85@@${- 4ư eӸw /C/H_粿^snZF3f̓bt7 /뢽q LszXҢW%oswcā b?+I(#"@7'-?眬:L)hNJ!=br7g~} ~5g.\s H;LʤΘM>uv8\/ M+_o6 ݁qR_;N`O5< xaO;t_ }ߞaуΑF̎! |- VBKƯ&!- ?s @ @ ?l+"ܖ4N*w2:),;#iU 79Tζ月*91$O=yAdyƄ$gϛ @%δo!AgX,𻹱nk|ܸsFκtwԄ?#j:X]j_rCī%;'qמ[\R/PT+|>;i999'+}i-͍F0=:>}Yw`GIJzܘ⑹׽cB.? //ԙiG#͍7jX9?OersBZ`6UmΘ^l|goZ6z*1V.YfRx*ׁ+G[+8uK7w/`M̤Uؐf椃1lp*й{M q*=ت[1 # f0kԶS36aEqR/qc7ضal h>k4o/7fKq^\`Y0~ i)e,@ @ ?ƹ76bc^ jЂWhCK^x[_ 6"Pqܱ0w.#\ۃFe2EE1~ỾK[Esrss1b-tWoc,ZQ2ٞm }uU-Yiu0KS\z.=6' mCx TIiT,v]QmqqӺKV1_yضuqxBǗu_.d/5x尯oyQn}~I})>8HfxR{ hAZ/x0+dπxDCZrbaix"Nm 1ka#w!`v3 @ @A f W!#gAcO/ν9FfDa!,f횛+׭zsӮi9/Zb] TzXS*V&oh^Wu^ ?phv=#Q `I?w]x:a-**G2nݒSXL&WUϋR5S tc^ޖxlk;zx}E-M*+TKQ`宻#~CCë-+)VZ/K3ƚZb'7WmHoRqM+3تuXuhhyyCvrH*X%M4//`J ;zǻV#ix?2|-jNv\ Lexilla
Scintilla icon Lexilla

History of Lexilla

Lexilla was originally code that was part of the Scintilla project. Thus it shares much of the history and contributors of Scintilla before it was extracted as its own project.

Contributors

Thanks to all the people that have contributed patches, bug reports and suggestions.

Source code and documentation have been contributed by

Atsuo Ishimoto Mark Hammond Francois Le Coguiec Dale Nagata
Ralf Reinhardt Philippe Lhoste Andrew McKinlay Stephan R. A. Deibel
Hans Eckardt Vassili Bourdo Maksim Lin Robin Dunn
John Ehresman Steffen Goeldner Deepak S. DevelopMentor
Yann Gaillard Aubin Paul Jason Diamond Ahmad Baitalmal
Paul Winwood Maxim Baranov Ragnar Højland Christian Obrecht
Andreas Neukoetter Adam Gates Steve Lhomme Ferdinand Prantl
Jan Dries Markus Gritsch Tahir Karaca Ahmad Zawawi
Laurent le Tynevez Walter Braeu Ashley Cambrell Garrett Serack
Holger Schmidt ActiveState James Larcombe Alexey Yutkin
Jan Hercek Richard Pecl Edward K. Ream Valery Kondakoff
Smári McCarthy Clemens Wyss Simon Steele Serge A. Baranov
Xavier Nodet Willy Devaux David Clain Brendon Yenson
Vamsi Potluru Praveen Ambekar Alan Knowles Kengo Jinno
Valentin Valchev Marcos E. Wurzius Martin Alderson Robert Gustavsson
José Fonseca Holger Kiemes Francis Irving Scott Kirkwood
Brian Quinlan Ubi Michael R. Duerig Deepak T
Don Paul Beletsky Gerhard Kalab Olivier Dagenais Josh Wingstrom
Bruce Dodson Sergey Koshcheyev Chuan-jian Shen Shane Caraveo
Alexander Scripnik Ryan Christianson Martin Steffensen Jakub Vrána
The Black Horus Bernd Kreuss Thomas Lauer Mike Lansdaal
Yukihiro Nakai Jochen Tucht Greg Smith Steve Schoettler
Mauritius Thinnes Darren Schroeder Pedro Guerreiro Steven te Brinke
Dan Petitt Biswapesh Chattopadhyay Kein-Hong Man Patrizio Bekerle
Nigel Hathaway Hrishikesh Desai Sergey Puljajev Mathias Rauen
Angelo Mandato Denis Sureau Kaspar Schiess Christoph Hösler
João Paulo F Farias Ron Schofield Stefan Wosnik Marius Gheorghe
Naba Kumar Sean O'Dell Stefanos Togoulidis Hans Hagen
Jim Cape Roland Walter Brian Mosher Nicholas Nemtsev
Roy Wood Peter-Henry Mander Robert Boucher Christoph Dalitz
April White S. Umar Trent Mick Filip Yaghob
Avi Yegudin Vivi Orunitia Manfred Becker Dimitris Keletsekis
Yuiga Davide Scola Jason Boggs Reinhold Niesner
Jos van der Zande Pescuma Pavol Bosik Johannes Schmid
Blair McGlashan Mikael Hultgren Florian Balmer Hadar Raz
Herr Pfarrer Ben Key Gene Barry Niki Spahiev
Carsten Sperber Phil Reid Iago Rubio Régis Vaquette
Massimo Corà Elias Pschernig Chris Jones Josiah Reynolds
Robert Roessler rftp.com Steve Donovan Jan Martin Pettersen Sergey Philippov
Borujoa Michael Owens Franck Marcia Massimo Maria Ghisalberti
Frank Wunderlich Josepmaria Roca Tobias Engvall Suzumizaki Kimitaka
Michael Cartmell Pascal Hurni Andre Randy Butler
Georg Ritter Michael Goffioul Ben Harper Adam Strzelecki
Kamen Stanev Steve Menard Oliver Yeoh Eric Promislow
Joseph Galbraith Jeffrey Ren Armel Asselin Jim Pattee
Friedrich Vedder Sebastian Pipping Andre Arpin Stanislav Maslovski
Martin Stone Fabien Proriol mimir Nicola Civran
Snow Mitchell Foral Pieter Holtzhausen Waldemar Augustyn
Jason Haslam Sebastian Steinlechner Chris Rickard Rob McMullen
Stefan Schwendeler Cristian Adam Nicolas Chachereau Istvan Szollosi
Xie Renhui Enrico Tröger Todd Whiteman Yuval Papish
instanton Sergio Lucato VladVRO Dmitry Maslov
chupakabra Juan Carlos Arevalo Baeza Nick Treleaven Stephen Stagg
Jean-Paul Iribarren Tim Gerundt Sam Harwell Boris
Jason Oster Gertjan Kloosterman alexbodn Sergiu Dotenco
Anders Karlsson ozlooper Marko Njezic Eugen Bitter
Christoph Baumann Christopher Bean Sergey Kishchenko Kai Liu
Andreas Rumpf James Moffatt Yuzhou Xin Nic Jansma
Evan Jones Mike Lischke Eric Kidd maXmo
David Severwright Jon Strait Oliver Kiddle Etienne Girondel
Haimag Ren Andrey Moskalyov Xavi Toby Inkster
Eric Forgeot Colomban Wendling Neo Jordan Russell
Farshid Lashkari Sam Rawlins Michael Mullin Carlos SS
vim Martial Demolins Tino Weinkauf Jérôme Laforge
Udo Lechner Marco Falda Dariusz Knociński Ben Fisher
Don Gobin John Yeung Adobe Elizabeth A. Irizarry
Mike Schroeder Morten MacFly Jaime Gimeno Thomas Linder Puls
Artyom Zuikov Gerrit Occam's Razor Ben Bluemel
David Wolfendale Chris Angelico Marat Dukhan Stefan Weil
Rex Conn Ross McKay Bruno Barbieri Gordon Smith
dimitar Sébastien Granjoux zeniko James Ribe
Markus Nißl Martin Panter Mark Yen Philippe Elsass
Dimitar Zhekov Fan Yang Denis Shelomovskij darmar
John Vella Chinh Nguyen Sakshi Verma Joel B. Mohler
Isiledhel Vidya Wasi G. Hu Byron Hawkins
Alpha John Donoghue kudah Igor Shaula
Pavel Bulochkin Yosef Or Boczko Brian Griffin Özgür Emir
Neomi OmegaPhil SiegeLord Erik
TJF Mark Robinson Thomas Martitz felix
Christian Walther Ebben Robert Gieseke Mike M
nkmathew Andreas Tscharner Lee Wilmott johnsonj
Vicente Nick Gravgaard Ian Goldby Holger Stenger
danselmi Mat Berchtold Michael Staszewski Baurzhan Muftakhidinov
Erik Angelin Yusuf Ramazan Karagöz Markus Heidelberg Joe Mueller
Mika Attila JoMazM Markus Moser Stefan Küng
Jiří Techet Jonathan Hunt Serg Stetsuk Jordan Jueckstock
Yury Dubinsky Sam Hocevar Luyomi Matt Gilarde
Mark C Johannes Sasongko fstirlitz Robin Haberkorn
Pavel Sountsov Dirk Lorenzen Kasper B. Graversen Chris Mayo
Van de Bugger Tse Kit Yam SmartShare Systems Morten Brørup
Alexey Denisov Justin Dailey oirfeodent A-R-C-A
Roberto Rossi Kenny Liu Iain Clarke desto
John Flatness Thorsten Kani Bernhard M. Wiedemann Baldur Karlsson
Martin Kleusberg Jannick Zufu Liu Simon Sobisch
Georger Araújo Tobias Kühne Dimitar Radev Liang Bai
Gunter Königsmann Nicholai Benalal Uniface Raghda Morsy
Giuseppe Corbelli Andreas Rönnquist Henrik Hank Luke Rasmussen
Philipp maboroshin Gokul Krishnan John Horigan
jj5 Jad Altahan Andrea Ricchi Juarez Rudsatz
Wil van Antwerpen Hodong Kim Michael Conrad Dejan Budimir
Andreas Falkenhahn Mark Reay David Shuman McLoo
Shmuel Zeigerman Chris Graham Hugues Larrive Prakash Sahni
Michel Sauvard uhf7 gnombat Derek Brown
Robert Di Pardo riQQ YX Hao Bertrand Lacoste
Ivan Ustûžanin Rainer Kottenhoff feitoi vsl7
Michael Heath Antonio Cebrián David Yu Yang Arkadiusz Michalski
Red_M cdbdev Andrey Smolyakov Knut Leimbert
German Aizek Tsuyoshi Miyake Martin Schäfer RainRat

Releases

Release 5.3.3

  • Released 22 July 2024.
  • ASP: Control whether ASP is enabled for XML and HTML with lexer.xml.allow.asp and lexer.html.allow.asp. Issue #252.
  • JavaScript: Recognize regular expressions at start or after '>' in JavaScript when lexer is cpp, hypertext, or xml. Issue #250, Bug #918.
  • JavaScript: Recognize initial #! 'shebang' line as a comment in standalone files. Issue #253.
  • Lua: Fix non-ASCII identifiers joined with '.' or ':'. Issue #242.
  • Lua: Fix folding for multi-line SCE_LUA_LITERALSTRING and SCE_LUA_COMMENT when performed incrementally. Issue #247.
  • PHP: Control whether PHP is enabled for XML and HTML with lexer.xml.allow.php and lexer.html.allow.php. Issue #252.

Release 5.3.2

  • Released 23 April 2024.
  • COBOL: Stop string literal continuing over line end. Issue #229.
  • COBOL: Stop doc comment assigning different styles to \r and \n at line end. Issue #229.
  • COBOL: Recognize keywords that start with 'V'. Issue #230.
  • COBOL: Recognize comments after tag or that start with '/'. Issue #231.
  • HTML: Implement substyles for tags, attributes, and identifiers SCE_H_TAG, SCE_H_ATTRIBUTE, SCE_HJ_WORD, SCE_HJA_WORD, SCE_HB_WORD, SCE_HP_WORD, SCE_HPHP_WORD.
  • HTML: Implement context-sensitive attributes. "tag.attribute" matches "attribute" only inside "tag".
  • HTML: Match standard handling of comments. Issue #232.
  • Lua: Implement substyles for identifiers SCE_LUA_IDENTIFIER.
  • Ruby: Allow non-ASCII here-doc delimiters. Issue #234.
  • Ruby: Allow modifier if, unless, while and until after heredoc delimiter. Issue #236.
  • Rust: Recognize raw identifiers. Issue #239, Pull request #240.

Release 5.3.1

  • Released 5 March 2024.
  • Assembler: After comments, treat \r\n line ends the same as \n. This makes testing easier.
  • Bash: Fix folding when line changed to/from comment and previous line is comment. Issue #224.
  • Batch: Fix handling ':' next to keywords. Issue #222.
  • JavaScript: in cpp lexer, add lexer.cpp.backquoted.strings=2 mode to treat ` back-quoted strings as template literals which allow embedded ${expressions}. Issue #94.
  • Python: fix lexing of rb'' and rf'' strings. Issue #223, Pull request #227.
  • Ruby: fix lexing of methods on numeric literals like '3.times' so the '.' and method name do not appear in numeric style. Issue #225.

Release 5.3.0

  • Released 27 December 2023.
  • Fix calling AddStaticLexerModule by defining as C++ instead of C which matches header. Bug #2421.
  • Bash: Fix shift operator << incorrectly recognized as here-doc. Issue #215.
  • Bash: Fix termination of '${' with first unquoted '}' instead of nesting. Issue #216.
  • HTML: JavaScript double-quoted strings may escape line end with '\'. Issue #214.
  • Lua: recognize --- doc comments. Defined by LDoc. Does not recognize --[[-- doc comments which seem less common.

Release 5.2.9

  • Released 18 November 2023.
  • Xcode build settings changed to avoid problems with Xcode 15.0.

Release 5.2.8

  • Released 5 November 2023.
  • Python: Update f-string handling to match PEP 701 and Python 3.12. Controlled with property lexer.python.strings.f.pep.701. Issue #150, Pull request #209.
  • R: Fix escape sequence highlighting with change of for loop to while loop. Issue #206, Pull request #207.
  • Minimum supported macOS release increased to 10.13.

Release 5.2.7

  • Released 22 September 2023.
  • Fix building on Windows with non-English environment. Pull request #200.
  • Bash: fix line continuation for comments and when multiple backslashes at line end. Issue #195.
  • Bash: treat += as operator and, inside arithmetic expressions, treat ++ and -- as operators. Issue #197.
  • Bash: improve backslash handling inside backquoted command substitution and fix $ at end of backtick expression. Issue #194.
  • Bash: treat words that are similar to numbers but invalid wholly as identifiers. Issue #199.
  • Bash: consistently handle '-' options at line start and after '|' as identifiers. Issue #202.
  • Bash: handle '-' options differently in [ single ] and [[ double ]] bracket constructs. Issue #203.
  • F#: improve speed of folding long lines. Issue #198.
  • HTML: fix invalid entity at line end and terminate invalid entity before invalid character. Issue #192.

Release 5.2.6

  • Released 26 July 2023.
  • Include empty word list names in value returned by DescribeWordListSets and SCI_DESCRIBEKEYWORDSETS. Issue #175, Pull request #176.
  • Bash: style here-doc end delimiters as SCE_SH_HERE_DELIM instead of SCE_SH_HERE_Q. Issue #177.
  • Bash: allow '$' as last character in string. Issue #180, Pull request #181.
  • Bash: fix state after expansion. Highlight all numeric and file test operators. Don't highlight dash in long option as operator. Issue #182, Pull request #183.
  • Bash: strict checking of special parameters ($*, $@, $$, ...) with property lexer.bash.special.parameter to specify valid parameters. Issue #184, Pull request #186.
  • Bash: recognize keyword before redirection operators (< and >). Issue #188, Pull request #189.
  • Errorlist: recognize Bash diagnostic messages.
  • HTML: allow ASP block to terminate inside line comment. Issue #185.
  • HTML: fix folding with JSP/ASP.NET <%-- comment. Issue #191.
  • HTML: fix incremental styling of multi-line ASP.NET directive. Issue #191.
  • Matlab: improve arguments blocks. Add support for multiple arguments blocks. Prevent "arguments" from being keyword in function declaration line. Fix semicolon handling. Pull request #179.
  • Visual Prolog: add support for embedded syntax with SCE_VISUALPROLOG_EMBEDDED and SCE_VISUALPROLOG_PLACEHOLDER.
    Styling of string literals changed with no differentiation between literals with quotes and those that are prefixed with "@". Quote characters are in a separate style (SCE_VISUALPROLOG_STRING_QUOTE) to contents (SCE_VISUALPROLOG_STRING).
    SCE_VISUALPROLOG_CHARACTER, SCE_VISUALPROLOG_CHARACTER_TOO_MANY, SCE_VISUALPROLOG_CHARACTER_ESCAPE_ERROR, SCE_VISUALPROLOG_STRING_EOL_OPEN, and SCE_VISUALPROLOG_STRING_VERBATIM_SPECIAL were removed (replaced with SCE_VISUALPROLOG_UNUSED[1-5]). Pull request #178.

Release 5.2.5

  • Released 31 May 2023.
  • Add CharacterSetArray constructor without setBase initial argument for common case where this is setNone and the initialSet argument completely defines the characters. This shortens and clarifies use of CharacterSetArray.
  • Bash: implement highlighting inside quoted elements and here-docs. Controlled with properties lexer.bash.styling.inside.string, lexer.bash.styling.inside.backticks, lexer.bash.styling.inside.parameter, and lexer.bash.styling.inside.heredoc. Issue #154, Issue #153, Feature #1033.
  • Bash: add property lexer.bash.command.substitution to choose how to style command substitutions. 0 → SCE_SH_BACKTICKS; 1 → surrounding "$(" and ")" as operators and contents styled as bash code; 2 → use distinct styles (base style + 64) for contents. Choice (2) is a provisional feature and details may change before it is finalized. Issue #153.
  • Bash: fix nesting of parameters (SCE_SH_PARAM) like ${var/$sub/"${rep}}"}. Issue #154.
  • Bash: fix single character special parameters like $? by limiting style. Issue #154.
  • Bash: treat "$$" as special parameter and end scalars before "$". Issue #154.
  • Bash: treat "<<" in arithmetic contexts as left bitwise shift operator instead of here-doc. Issue #137.
  • Batch: style SCE_BAT_AFTER_LABEL used for rest of line after label which is not executed. Issue #148.
  • F#: Lex interpolated verbatim strings as verbatim. Issue #156.
  • VB: allow multiline strings when lexer.vb.strings.multiline set. Issue #151.

Release 5.2.4

Release 5.2.3

  • Released 8 March 2023.
  • Add scripts/PromoteNew.bat script to promote .new files after checking.
  • Makefile: Remove 1024-byte line length limit..
  • Ruby: Add new lexical classes for % literals SCE_RB_STRING_W (%w non-interpolable string array), SCE_RB_STRING_I (%i non-interpolable symbol array), SCE_RB_STRING_QI (%I interpolable symbol array), and SCE_RB_STRING_QS (%s symbol). Issue #124.
  • Ruby: Disambiguate %= which may be a quote or modulo assignment. Issue #124, Bug #1255, Bug #2182.
  • Ruby: Fix additional fold level for single character in SCE_RB_STRING_QW. Issue #132.
  • Ruby: Set SCE_RB_HERE_QQ for unquoted and double-quoted heredocs and SCE_RB_HERE_QX for backticks-quoted heredocs. Issue #134.
  • Ruby: Recognise #{} inside SCE_RB_HERE_QQ and SCE_RB_HERE_QX. Issue #134.
  • Ruby: Improve regex and heredoc recognition. Issue #136.
  • Ruby: Highlight #@, #@@ and #$ style interpolation. Issue #140.
  • Ruby: Fix folding for multiple heredocs started on one line. Fix folding when there is a space after heredoc opening delimiter. Issue #135.
  • YAML: Remove 1024-byte line length limit.

Release 5.2.2

  • Released 8 February 2023.
  • C++: Fix keywords that start with non-ASCII. Also affects other lexers. Issue #130.
  • Matlab: Include more prefix and suffix characters in numeric literals. Issue #120.
  • Matlab: More accurate treatment of line ends inside strings. Matlab and Octave are different here. Issue #18.
  • Modula-3: Don't treat identifier suffix that matches keyword as keyword. Issue #129.
  • Modula-3: Fix endless loop in folder. Issue #128.
  • Modula-3: Fix access to lines beyond document end in folder. Issue #131.
  • Python: Don't highlight match and case as keywords in contexts where they probably aren't used as keywords. Pull request #122.
  • X12: Support empty envelopes. Bug #2369.

Release 5.2.1

  • Released 6 December 2022.
  • Update to Unicode 14. Feature #1461.
  • Change default compilation optimization option to favour speed over space. -O2 for MSVC and -O3 for gcc and clang.
  • Batch: Fix comments starting inside strings. Issue #115.
  • F#: Lex signed numeric literals more accurately. Issue #110, Issue #111.
  • F#: Add specifiers for 64-bit integer and floating point literals. Issue #112.
  • Markdown: Stop styling numbers at line start in PRECHAR style. Issue #117.
  • PowerShell: Recognise numeric literals more accurately. Issue #118.

Release 5.2.0

  • Released 12 October 2022.
  • PowerShell: End comment before \r carriage return so \r and \n in same SCE_POWERSHELL_DEFAULT style. Pull request #99.
  • PowerShell: Fix character truncation bug that lead to 'ġ' styled as an operator since its low 8 bits are equal to '!'.
  • R: Support hexadecimal, float exponent and number suffix. Issue #101.
  • R: Highlight backticks. Pull request #102.
  • R: Highlight raw strings. Issue #100.
  • R: Optionally highlight escape sequences in strings. Issue #100.
  • Fix early truncation from LexAccessor::GetRange and LexAccessor::GetRangeLowered. Issue #17.

Release 5.1.9

  • Released 27 August 2022.
  • Julia: Parse unicode forall and exists as identifiers #42314. Pull request #98.
  • Julia: Parse apostrophe as char and not adjoint after exclamation. Issue #97, Pull request #98.
  • Properties: Don't set header flag for empty section. Issue #96.

Release 5.1.8

  • Released 10 July 2022.
  • F#: Recognize nested comments in F#. Issue #93.
  • MS SQL: Recognize nested comments in Transact-SQL. Issue #87.
  • MS SQL: Preference data types more consistently to not depend on how lexing is broken up into segments. This is needed because there are keywords that are both data type names and function names such as 'CHAR'. Issue #90.
  • PowerShell: Fix single quoted strings to not treat backtick as escape. Pull request #92.
  • Visual Prolog: Treat \r\n line ends the same as \n. This makes testing easier. Add test case. Issue #83.
  • Visual Prolog: Allow disabling verbatim strings. Pull request #89.
  • Visual Prolog: Support backquoted strings. Pull request #89.

Release 5.1.7

  • Released 22 May 2022.
  • Add LexAccessor::StyleIndexAt to retrieve style values as unsigned to handle styles > 127 better. Issue #61.
  • Associate more than one file extension with a setting for testing. Issue #81.
  • CMake: Fix folding of "ElseIf". Issue #77, Pull request #78, Bug #2213.
  • HTML: Fix folding of JavaScript doc comments. Bug #2219.
  • Matlab: add "classdef" and "spmd" to folding keywords. Pull request #70.
  • Matlab: handle "arguments" contextual keyword. Pull request #70.
  • Matlab: improve support of class definition syntax. Pull request #75.
  • Raku: fix escape detection. Pull request #76.
  • Ruby: fix character sequence "?\\#" to not include '#' in SCE_RB_NUMBER as only second '\' is quoted. Issue #69.
  • Ruby: improve styling of ternary expressions as commonly used. Issue #69.
  • VHDL: support folding for VHDL 08 else-generate and case-generate. Pull request #80.

Release 5.1.6

  • Released 31 March 2022.
  • Implement conditional statements "if" and "match", comparison function "$(=", and "FileNameExt" property in TestLexers to allow varying lexer properties over different files. Issue #62.
  • Add LexAccessor::BufferStyleAt to retrieve style values to simplify logic and improve performance. Issue #54.
  • Markdown: Optionally style all of Markdown header lines. Enabled with lexer.markdown.header.eolfill=1. Issue #60.
  • Ruby: Fix operator method styling so next word not treated as method name. Issue #65.
  • Ruby: Fix folding for Ruby 3 endless method definition. Issue #65.
  • Ruby: Fold string array SCE_RB_STRING_QW. Issue #65.
  • Ruby: Fix final \n in indented heredoc to be SCE_RB_HERE_Q. Issue #66.
  • Ruby: Fix heredoc recognition when '.' and ',' used in method calls and after SCE_RB_GLOBAL. Classify word after heredoc delimiter instead of styling as keyword. Issue #67.
  • Ruby: Improve method highlighting so method name is styled as SCE_RB_DEFNAME and class/object is styled appropriately. Issue #68.

Release 5.1.5

  • Released 9 February 2022.
  • Bash: Treat \r\n line ends the same as \n. This makes testing easier. Issue #57.
  • Batch: Recognise "::" comments when second command on line. Bug #2304.
  • F#: Recognise format specifiers in interpolated strings and %B for binary. Issue #46.
  • F#: More accurate line-based folding. Issue #56.
  • HTML: Fix folding inside script blocks. Issue #47, Issue #53.
  • Inno Setup: Fix multiline comments in code. Issue #44.
  • Python: Add attribute style with properties lexer.python.identifier.attributes and lexer.python.decorator.attributes. Pull request #49.
  • Allow choice of object file directory with makefile by setting DIR_O. Issue #50.

Release 5.1.4

  • Released 7 December 2021.
  • Add AsciiDoc lexer. Pull request #39.
  • Add GDScript lexer. Some behaviour and lexical states may change before this lexer is stable. Pull request #41.
  • Fix strings ending in escaped '\' in F#. Issue #38.
  • Better handling of bad terminators and folding for X12. Feature #1420.

Release 5.1.3

  • Released 8 November 2021.
  • Fix parsing of 128-bit integer literals in Rust. Issue #33.
  • Fix different styles between \r and \n at end of line comments for Rust. Issue #34.
  • For Rust, don't go past end when file ends with unterminated block comment. Issue #35.

Release 5.1.2

  • Released 23 September 2021.
  • Implement conditional group rules in CSS. Issue #25, Pull request #28.
  • Allow F# triple-quoted strings to interpolate string literals. Issue #21.
  • Highlight F# printf specifiers in type-checked interpolated strings. Issue #24.
  • Fix styling for Inno Setup scripts handling unterminated strings, message sections, and avoid terminating comments between CR and LF. Pull request #29. Feature #1415.
  • Fix Markdown hang when document ends with "`", "*", "_", or similar. Issue #23.
  • Treat '.' as an operator instead of part of a word for PHP. Issue #22. Bug #2225.
  • Check PHP numeric literals, showing invalid values with default style instead of numeric. Issue #20.
  • For PHP, recognize start of comment after numeric literal. Issue #20. Bug #2143.
  • For PHP, recognize PHP code within JavaScript strings. Pull request #27.

Release 5.1.1

  • Released 26 July 2021.
  • On 32-bit Win32 using Visual C++ projects, stop exported functions ending with @n causing failures with GetProcAddress.
  • Fixed crash when calling TagsOfStyle on C++ lexer after allocating substyles.
  • Fixed folding for Julia which could be inconsistent depending on range folded. Added SCE_JULIA_KEYWORD4 and SCE_JULIA_TYPEOPERATOR lexical styles and changed keyword set 4 from "Raw string literals" to "Built in functions". Property lexer.julia.string.interpolation removed. Updated set of characters for identifiers. Pull request #13.
  • Fixed Markdown emphasis spans to only be recognized when closed in same paragraph. Bug #1216.
  • Fixed Markdown code block to terminate when end marker is indented. Display all of end marker in code block style. Only recognize inline code when closed in same paragraph. Bug #2247.
  • Fixed Matlab to not allow escape sequences in double-quoted strings. Issue #18.
  • Support flexible heredoc and nowdoc syntax for PHP. Issue #19.
  • Enabled '_' digit separator in numbers for PHP. Issue #19.
  • Stop styling attributes as comments for PHP. Issue #19.

Release 5.1.0

  • Released 23 June 2021.
  • This is a stable release. The Lexilla protocol should remain compatible through 5.x releases.
  • Fixed bugs with styling Erlang by handling \n and \r\n line endings consistently.
  • Fixed folding for F# open statements and for strings that contain comment prefixes.
  • Format specifiers lexed in F# strings.
  • Fixed folding for ASP files where scripts were treated inconsistently when '<%' was included or not included in range examined.
  • Fixed folding of Raku heredocs that start with "q:to" or "qq:to".
  • Fixed folding at end of Ruby files where these is no final new line.
  • Made folding of Tcl files more consistent by always treating completely empty lines as whitespace.
  • Fixed styling of "a:b" with no spaces in YAML as a single piece of text instead of a key-value pair. Pull request #15.

Release 5.0.3

  • Released 2 June 2021.
  • Add namespace feature with GetNameSpace function.
  • Add Julia lexer. Feature #1380.
  • Fix transition to comment for --> inside JavaScript string. Bug #2207.
  • Fix variable expansion in Batch. Issue #4.
  • Fix empty link titles in Markdown. Bug #2235. Also fix detection of whether the previous line had content which treated '\n' and '\r\n' line endings differently.
  • Remove nested comment and long string support as these were removed from Lua. Bug #2205.
  • Update to Unicode 13. Feature #1379.
  • AddStaticLexerModule function adds a static lexer to Lexilla's list.
  • On Win32 enable hardware-enforced stack protection. Feature #1405.
  • On 32-bit Win32 using g++, stop exported functions ending with @n causing failures with GetProcAddress. Issue #10.

Release 5.0.2

  • Released 23 April 2021.
  • Fix assertion in cpp lexer handling of preprocessor. Empty preprocessor statement '#' caused preprocessor history to be stored on incorrect line number. Dangling #else or #elif without corresponding #if led to inconsistent state. Change treatment of empty preprocessor statement to set subsequent line end characters in preprocessor style as this is more consistent with other preprocessor directives and avoids differences between \n and \r\n line ends. Bug #2245.

Release 5.0.1

  • Released 9 April 2021.
  • Add LexerNameFromID function to Lexilla protocol as optional and temporary to help applications migrate to Lexilla. It is marked deprecated and will be removed in a future release.
  • The cpp lexer supports XML styled comment doc keywords. Pull request #2.
  • The errorlist lexer detects NMAKE fatal errors and Microsoft linker errors as SCE_ERR_MS.

Release 5.0.0

  • Released 5 March 2021.
  • First version that separates Lexilla from Scintilla. Each of the 3 projects now has a separate history page but history before 5.0.0 remains combined.
  • Lexer added for F#.

Lexilla became a separate project at this point.

Release 4.4.6

  • Released 1 December 2020.
  • Fix building with Xcode 12. Bug #2187.

Release 4.4.5

  • Released 11 September 2020.
  • Lexilla interface supports setting initialisation properties on lexer libraries with SetLibraryProperty and GetLibraryPropertyNames functions. These are called by SciTE which will forward properties to lexer libraries that are prefixed with "lexilla.context.".
  • Allow cross-building for GTK by choosing pkg-config. Bug #2189.
  • On GTK, allow setting CPPFLAGS (and LDFLAGS for SciTE) to support hardening. Bug #2191.
  • Changed SciTE's indent.auto mode to set tab size to indent size when file uses tabs for indentation. Bug #2198.
  • Fix position of marker symbols for SC_MARGIN_RTEXT which were being moved based on width of text.
  • Fixed bug on Win32 where cursor was flickering between hand and text over an indicator with hover style. Bug #2170.
  • Fixed bug where hovered indicator was not returning to non-hover appearance when mouse moved out of window or into margin. Bug #2193.
  • Fixed bug where a hovered INDIC_TEXTFORE indicator was not applying the hover colour to the whole range. Bug #2199.
  • Fixed bug where gradient indicators were not showing hovered appearance.
  • Fixed bug where layout caching was ineffective. Bug #2197.
  • For SciTE, don't show the output pane for quiet jobs. Feature #1365.
  • Support command.quiet for SciTE on GTK. Feature #1365.
  • Fixed a bug in SciTE with stack balance when a syntax error in the Lua startup script caused continuing failures to find functions after the syntax error was corrected. Bug #2176.
  • Added method for iterating through multiple vertical edges: SCI_GETMULTIEDGECOLUMN. Feature #1350.

Release 4.4.4

  • Released 21 July 2020.
  • End of line annotations implemented. Bug #2141.
  • Add SCI_BRACEMATCHNEXT API. Feature #1368.
  • The latex lexer supports lstlisting environment that is similar to verbatim. Feature #1358.
  • For SciTE on Linux, place liblexilla.so and libscintilla.so in /usr/lib/scite. Bug #2184.
  • Round SCI_TEXTWIDTH instead of truncating as this may be more accurate when sizing application elements to match text. Feature #1355.
  • Display DEL control character as visible "DEL" block like other control characters. Feature #1369.
  • Allow caret width to be up to 20 pixels. Feature #1361.
  • SciTE on Windows adds create.hidden.console option to stop console window flashing when Lua script calls os.execute or io.popen.
  • Fix translucent rectangle drawing on Qt. When drawing a translucent selection, there were edge artifacts as the calls used were drawing outlines over fill areas. Make bottom and right borders on INDIC_ROUNDBOX be same intensity as top and left. Replaced some deprecated Qt calls with currently supported calls.
  • Fix printing on Windows to use correct text size. Bug #2185.
  • Fix bug on Win32 where calling WM_GETTEXT for more text than in document could return less text than in document.
  • Fixed a bug in SciTE with Lua stack balance causing failure to find functions after reloading script. Bug #2176.

Release 4.4.3

  • Released 3 June 2020.
  • Fix syntax highlighting for SciTE on Windows by setting executable directory for loading Lexilla. Bug #2181.

Release 4.4.2

  • Released 2 June 2020.
  • On Cocoa using Xcode changed Lexilla.dylib install path to @rpath as would otherwise try /usr/lib which won't work for sandboxed applications.
  • On Cocoa using Xcode made work on old versions of macOS by specifying deployment target as 10.8 instead of 10.15.
  • On Win32 fix static linking of Lexilla by specifying calling convention in Lexilla.h.
  • SciTE now uses default shared library extension even when directory contains '.'.

Release 4.4.0

  • Released 1 June 2020.
  • Added Xcode project files for Lexilla and Scintilla with no lexers (cocoa/Scintilla).
  • For GTK, build a shared library with no lexers libscintilla.so or libscintilla.dll.
  • Lexilla used as a shared library for most builds of SciTE except for the single file executable on Win32. On GTK, Scintilla shared library used. LexillaLibrary code can be copied out of SciTE for other applications that want to interface to Lexilla.
  • Constants in Scintilla.h can be disabled with SCI_DISABLE_AUTOGENERATED.
  • Implement per-monitor DPI Awareness on Win32 so both Scintilla and SciTE will adapt to the display scale when moved between monitors. Applications should forward WM_DPICHANGED to Scintilla. Bug #2171, Bug #2063.
  • Optimized performance when opening huge files. Feature #1347.
  • Add Appearance and Contrast properties to SciTE that allow customising visuals for dark mode and high contrast modes.
  • Fixed bug in Batch lexer where a single character line with a single character line end continued state onto the next line.
  • Added SCE_ERR_GCC_EXCERPT style for GCC 9 diagnostics in errorlist lexer.
  • Fixed buffer over-read bug with absolute references in MMIXAL lexer. Bug #2019.
  • Fixed bug with GTK on recent Linux distributions where underscores were invisible. Bug #2173.
  • Fixed GTK on Linux bug when pasting from closed application. Bug #2175.
  • Fixed bug in SciTE with Lua stack balance. Bug #2176.
  • For macOS, SciTE reverts to running python (2) due to python3 not being available in the sandbox.

Release 4.3.3

  • Released 27 April 2020.
  • Added Visual Studio project files for Lexilla and Scintilla with no lexers.
  • Add methods for iterating through the marker handles and marker numbers on a line: SCI_MARKERHANDLEFROMLINE and SCI_MARKERNUMBERFROMLINE. Feature #1344.
  • Assembler lexers asm and as can change comment character with lexer.as.comment.character property. Feature #1314.
  • Fix brace styling in Batch lexer so that brace matching works. Bug #1624, Bug #1906, Bug #1997, Bug #2065.
  • Change Perl lexer to style all line ends of comment lines in comment line style. Previously, the last character was in default style which made the characters in \r\n line ends have mismatching styles. Bug #2164.
  • When a lexer has been set with SCI_SETILEXER, fix SCI_GETLEXER and avoid sending SCN_STYLENEEDED notifications.
  • On Win32 fix handling Japanese IME input when both GCS_COMPSTR and GCS_RESULTSTR set.
  • With Qt on Win32 add support for line copy format on clipboard, compatible with Visual Studio. Bug #2167.
  • On Qt with default encoding (ISO 8859-1) fix bug where 'µ' (Micro Sign) case-insensitively matches '?' Bug #2168.
  • On GTK with Wayland fix display of windowed IME. Bug #2149.
  • For Python programs, SciTE defaults to running python3 on Unix and pyw on Windows which will run the most recently installed Python in many cases. Set the "python.command" property to override this. Scripts distributed with Scintilla and SciTE are checked with Python 3 and may not work with Python 2.

Release 4.3.2

  • Released 6 March 2020.
  • On Win32 fix new bug that treated all dropped text as rectangular.

Release 4.3.1

  • Released 4 March 2020.
  • Add default argument for StyleContext::GetRelative. Feature #1336.
  • Fix drag and drop between different encodings on Win32 by always providing CF_UNICODETEXT only. Bug #2151.
  • Automatically scroll while dragging text. Feature #497.
  • On Win32, the numeric keypad with Alt pressed can be used to enter characters by number. This can produce unexpected results in non-numlock mode when function keys are assigned. Potentially problematic keys like Alt+KeypadUp are now ignored. Bug #2152.
  • Crash fixed with Direct2D on Win32 when updating driver. Bug #2138.
  • For SciTE on Win32, fix crashes when Lua script closes application. Bug #2155.

Release 4.3.0

  • Released 16 January 2020.
  • Lexers made available as Lexilla library. TestLexers program with tests for Lexilla and lexers added in lexilla/test.
  • SCI_SETILEXER implemented to use lexers from Lexilla or other sources.
  • ILexer5 interface defined provisionally to support use of Lexilla. The details of this interface may change before being stabilised in Scintilla 5.0.
  • SCI_LOADLEXERLIBRARY implemented on Cocoa.
  • Build Scintilla with SCI_EMPTYCATALOGUE to avoid making lexers available.
  • Lexer and folder added for Raku language. Feature #1328.
  • Don't clear clipboard before copying text with Qt. Bug #2147.
  • On Win32, remove support for CF_TEXT clipboard format as Windows will convert to CF_UNICODETEXT.
  • Improve IME behaviour on GTK. Set candidate position for windowed IME. Improve location of candidate window. Prevent movement of candidate window while typing. Bug #2135.

Release 4.2.3

  • Released 11 December 2019.
  • Fix failure in SciTE's Complete Symbol command.

Release 4.2.2

  • Released 7 December 2019.
  • Move rather than grow selection when insertion at start. Bug #2140.
  • Allow target to have virtual space. Add methods for finding the virtual space at start and end of multiple selections. Feature #1316.
  • SciTE on Win32 adds mouse button "Forward" and "Backward" key definitions for use in properties like user.shortcuts. Feature #1317.
  • Lexer and folder added for Hollywood language. Feature #1324.
  • HTML lexer treats custom tags from HTML5 as known tags. These contain "-" like "custom-tag". Feature #1299.
  • HTML lexer fixes bug with some non-alphabetic characters in unknown tags. Feature #1320.
  • Fix bug in properties file lexer where long lines were only styled for the first 1024 characters. Bug #1933.
  • Ruby lexer recognizes squiggly heredocs. Feature #1326.
  • Avoid unnecessary IME caret movement on Win32. Feature #1304.
  • Clear IME state when switching language on Win32. Bug #2137.
  • Fixed drawing of translucent rounded rectangles on Win32 with Direct2D. Bug #2144.
  • Setting rectangular selection made faster. Bug #2130.
  • SciTE reassigns *.s extension to the GNU Assembler language from the S+ statistical language.

Release 4.2.1

  • Released 24 October 2019.
  • Add SCI_SETTABMINIMUMWIDTH to set the minimum width of tabs. This allows minimaps or overviews to be laid out to match the full size editing view. Bug #2118.
  • SciTE enables use of SCI_ commands in user.context.menu.
  • XML folder adds fold.xml.at.tag.open option to fold tags at the start of the tag "<" instead of the end ">". Bug #2128.
  • Metapost lexer fixes crash with 'interface=none' comment. Bug #2129.
  • Perl lexer supports indented here-docs. Bug #2121.
  • Perl folder folds qw arrays. Feature #1306.
  • TCL folder can turn off whitespace flag by setting fold.compact property to 0. Bug #2131.
  • Optimize setting up keyword lists in lexers. Feature #1305.
  • Updated case conversion and character categories to Unicode 12.1. Feature #1315.
  • On Win32, stop the IME candidate window moving unnecessarily and position it better.
    Stop candidate window overlapping composition text and taskbar.
    Position candidate window closer to composition text.
    Stop candidate window moving while typing.
    Align candidate window to target part of composition text.
    Stop Google IME on Windows 7 moving while typing.
    Bug #2120. Feature #1300.

Release 4.2.0

  • Released 5 July 2019.
  • Scintilla.iface adds line and pointer types, increases use of the position type, uses enumeration types in methods and properties, and adds enumeration aliases to produce better CamelCase identifiers. Feature #1297.
  • Source of input (direct / IME composition / IME result) reported in SCN_CHARADDED so applications can treat temporary IME composition input differently. Bug #2038.
  • Lexer added for DataFlex. Feature #1295.
  • Matlab lexer now treats keywords as case-sensitive. Bug #2112.
  • SQL lexer fixes single quoted strings where '" (quote, double quote) was seen as continuing the string. Bug #2098.
  • Platform layers should use InsertCharacter method to perform keyboard and IME input, replacing AddCharUTF method. Feature #1293.
  • Add CARETSTYLE_BLOCK_AFTER option to always display block caret after selection. Bug #1924.
  • On Win32, limit text returned from WM_GETTEXT to the length specified in wParam. This could cause failures when using assistive technologies like NVDA. Bug #2110, Bug #2114.
  • Fix deletion of isolated invalid bytes. Bug #2116.
  • Fix position of line caret when overstrike caret set to block. Bug #2106.

Release 4.1.7

  • Released 13 June 2019.
  • Fixes an incorrect default setting in SciTE which caused multiple visual features to fail to display.

Release 4.1.6

  • Released 10 June 2019.
  • For Visual C++ 2019, /std:c++latest now includes some C++20 features so switch to /std:c++17.
  • SciTE supports editing files larger than 2 gigabytes when built as a 64-bit application.
  • Lexer added for X12. Feature #1280.
  • CMake folder folds function - endfunction. Feature #1289.
  • VB lexer adds support for VB2017 binary literal &B and digit separators 123_456. Feature #1288.
  • Improved performance of line folding code on large files when no folds are contracted. This improves the time taken to open or close large files.
  • Fix bug where changing identifier sets in lexers preserved previous identifiers.
  • Fixed bug where changing to Unicode would rediscover line end positions even if still sticking to ASCII (not Unicode NEL, LS, PS) line ends. Only noticeable on huge files with over 100,000 lines.
  • Changed behaviour of SCI_STYLESETCASE(*,SC_CASE_CAMEL) so that it only treats 'a-zA-Z' as word characters because this covers the feature's intended use (viewing case-insensitive ASCII-only keywords in a specified casing style) and simplifies the behaviour and code. Feature #1238.
  • In SciTE added Camel case option "case:c" for styles to show keywords with initial capital.

Release 4.1.5

  • Released 17 April 2019.
  • On Win32, removed special handling of non-0 wParam to WM_PAINT.
  • Implement high-priority idle on Win32 to make redraw smoother and more efficient.
  • Add vertical bookmark symbol SC_MARK_VERTICALBOOKMARK. Feature #1276.
  • Set default fold display text SCI_SETDEFAULTFOLDDISPLAYTEXT(text). Feature #1272.
  • Add SCI_SETCHARACTERCATEGORYOPTIMIZATION API to optimize speed of character category features like determining whether a character is a space or number at the expense of memory. Feature #1259.
  • Improve the styling of numbers in Nim. Feature #1268.
  • Fix exception when inserting DBCS text. Bug #2093.
  • Improve performance of accessibility on GTK. Bug #2094.
  • Fix text reported for deletion with accessibility on GTK. Bug #2095.
  • Fix flicker when inserting primary selection on GTK. Bug #2087.
  • Support coloured text in Windows 8.1+. Feature #1277.
  • Avoid potential long hangs with idle styling for huge documents on Cocoa and GTK.

Release 4.1.4

  • Released 7 March 2019.
  • Calltips implemented on Qt. Bug #1548.
  • Block caret in overtype mode SCI_SETCARETSTYLE(caretStyle | CARETSTYLE_OVERSTRIKE_BLOCK). Feature #1217.
  • SciTE supports changing caret style via caret.style property. Feature #1264.
  • Lexer added for .NET's Common Intermediate Language CIL. Feature #1265.
  • The C++ lexer, with styling.within.preprocessor on, now interprets "(" in preprocessor "#if(" as an operator instead of part of the directive. This improves folding as well which could become unbalanced.
  • Fix raw strings in Nim. Feature #1253.
  • Fix inconsistency with dot styling in Nim. Feature #1260.
  • Enhance the styling of backticks in Nim. Feature #1261.
  • Enhance raw string identifier styling in Nim. Feature #1262.
  • Fix fold behaviour with comments in Nim. Feature #1254.
  • Fix TCL lexer recognizing '"' after "," inside a bracketed substitution. Bug #1947.
  • Fix garbage text from SCI_MOVESELECTEDLINESUP and SCI_MOVESELECTEDLINESDOWN for rectangular or thin selection by performing no action. Bug #2078.
  • Ensure container notified if Insert pressed when caret off-screen. Bug #2083.
  • Fix memory leak when checking running instance on GTK. Feature #1267.
  • Platform layer font cache removed on Win32 as there is a platform-independent cache.
  • SciTE for GTK easier to build on macOS. Bug #2084.

Release 4.1.3

  • Released 10 January 2019.
  • Add SCI_SETCOMMANDEVENTS API to allow turning off command events as they can be a significant performance cost.
  • Improve efficiency of idle wrapping by wrapping in blocks as large as possible while still remaining responsive.
  • Updated case conversion and character categories to Unicode 11.
  • Errorlist lexer recognizes negative line numbers as some programs show whole-file errors occurring on line -1. SciTE's parsing of diagnostics also updated to handle this case.
  • Added "nim" lexer (SCLEX_NIM) for the Nim language which was previously called Nimrod. For compatibility, the old "nimrod" lexer is still present but is deprecated and will be removed at the next major version. Feature #1242.
  • The Bash lexer implements substyles for multiple sets of keywords and supports SCI_PROPERTYNAMES. Bug #2054.
  • The C++ lexer interprets continued preprocessor lines correctly by reading all of the logical line. Bug #2062.
  • The C++ lexer interprets preprocessor arithmetic expressions containing multiplicative and additive operators correctly by following operator precedence rules. Bug #2069.
  • The EDIFACT lexer handles message groups as well as messages. Feature #1247.
  • For SciTE's Find in Files, allow case-sensitivity and whole-word options when running a user defined command. Bug #2053.
  • Notify with SC_UPDATE_SELECTION when user performs a multiple selection add.
  • On macOS 10.14 Cocoa, fix incorrect horizontal offset. Bug #2022.
  • On Cocoa, fix a crash that occurred when entering a dead key diacritic then a character that can not take that diacritic, such as option+e (acute accent) followed by g. Bug #2061.
  • On Cocoa, use dark info bar background when system is set to Dark Appearance. Bug #2055.
  • Fixed a crash on Cocoa in bidirectional mode where some patterns of invalid UTF-8 caused failures to create Unicode strings.
  • SCI_MARKERADD returns -1 for invalid lines as documented instead of 0. Bug #2051.
  • Improve performance of text insertion when Unicode line indexing off.
  • For Qt on Windows, stop specifying -std:c++latest as that is no longer needed to enable C++17 with MSVC 2017 and Qt 5.12 and it caused duplicate flag warnings.
  • On Linux, enable Lua to access dynamic libraries. Bug #2058.

Release 4.1.2

  • Released 2 October 2018.
  • C++ lexer fixes evaluation of "#elif". Bug #2045.
  • Markdown lexer fixes highlighting of non-ASCII characters in links.
  • SciTE on Win32 drops menukey feature, makes Del key work again in find and replace strips and disables F5 while command running. Bug #2044.

Release 4.1.1

  • Released 9 September 2018.
  • Optional indexing of line starts in UTF-8 documents by UTF-32 code points and UTF-16 code units added. This can improve performance for clients that provide UTF-32 or UTF-16 interfaces or that need to interoperate with UTF-32 or UTF-16 components.
  • Lexers added for SAS and Stata. Feature #1185.
  • Shell folder folds "if", "do", and "case". Feature #1144.
  • SciTE's menukey feature implemented on Windows.
  • For SciTE on Windows, user defined strip lists are now scrollable. Cursor no longer flickers in edit and combo boxes. Focus in and out events occur for combo boxes.
  • Fix a leak in the bidirectional code on Win32.
  • Fix crash on Win32 when switching technology to default after setting bidirectional mode.
  • Fix margin cursor on Cocoa to point more accurately.
  • Fix SciTE crash on GTK+ when using director interface.

Release 4.1.0

  • Released 19 June 2018.
  • Experimental and incomplete support added for bidirectional text on Windows using DirectWrite and Cocoa for UTF-8 documents by calling SCI_SETBIDIRECTIONAL(SC_BIDIRECTIONAL_L2R). This allows documents that contain Arabic or Hebrew to be edited more easily in a way that is similar to other editors.
  • INDIC_GRADIENT and INDIC_GRADIENTCENTRE indicator types added. INDIC_GRADIENT starts with a specified colour and alpha at top of line and fades to fully transparent at bottom. INDIC_GRADIENTCENTRE starts with a specified colour and alpha at centre of line and fades to fully transparent at top and bottom.
  • Wrap indent mode SC_WRAPINDENT_DEEPINDENT added which indents two tabs from previous line.
  • Indicators are drawn for line end characters when displayed.
  • Most invalid bytes in DBCS encodings are displayed as blobs to make problems clear and ensure something is shown.
  • On Cocoa, invalid text in DBCS encodings will be interpreted through the single-byte MacRoman encoding as that will accept any byte.
  • Diff lexer adds styles for diffs containing patches.
  • Crashes fixed on macOS for invalid DBCS characters when dragging text, changing case of text, case-insensitive searching, and retrieving text as UTF-8.
  • Regular expression crash fixed on macOS when linking to libstdc++.
  • SciTE on GTK+, when running in single-instance mode, now forwards all command line arguments to the already running instance. This allows "SciTE filename -goto:line" to work.

Release 4.0.5

  • Released 10 May 2018.
  • Add experimental SC_DOCUMENTOPTION_TEXT_LARGE option to accommodate documents larger than 2 GigaBytes.
  • Additional print option SC_PRINT_SCREENCOLOURS prints with the same colours used on screen including line numbers.
  • SciTE can read settings in EditorConfig format when enabled with editor.config.enable property.
  • EDIFACT lexer adds property lexer.edifact.highlight.un.all to highlight all UN* segments. Feature #1166.
  • Fortran folder understands "change team" and "endteam". Feature #1216.
  • Set the last X chosen when SCI_REPLACESEL called to ensure macros work when text insertion followed by caret up or down.
  • Bugs fixed in regular expression searches in Scintilla where some matches did not occur in an effort to avoid infinite loops when replacing on empty matches like "^" and "$". Applications should always handle empty matches in a way that avoids infinite loops, commonly by incrementing the search position after replacing an empty match. SciTE fixes a bug where replacing "^" always matched on the first line even when it was an "in selection" replace and the selection started after the line start.
  • Bug fixed in SciTE where invalid numeric properties could crash.
  • Runtime warnings fixed with SciTE on GTK after using Find in Files.
  • SciTE on Windows find and replace strips place caret at end of text after search.
  • Bug fixed with SciTE on macOS where corner debris appeared in the margin when scrolling. Fixed by not completely hiding the status bar so the curved corner is no longer part of the scrolling region. By default, 4 pixels of the status bar remain visible and this can be changed with the statusbar.minimum.height property or turned off if the debris are not a problem by setting the property to 0.

Release 4.0.4

  • Released 10 April 2018.
  • On Win32, the standard makefiles build a libscintilla static library as well as the existing dynamic libraries. The statically linked version of SciTE, Sc1, links to this static library. A new file, ScintillaDLL.cxx, provides the DllMain function required for a stand-alone Scintilla DLL. Build and project files should include this file when producing a DLL and omit it when producing a static library or linking Scintilla statically. The STATIC_BUILD preprocessor symbol is no longer used.
  • On Win32, Direct2D support is no longer automatically detected during build. DISABLE_D2D may still be defined to remove Direct2D features.
  • In some cases, invalid UTF-8 is handled in a way that is a little friendlier. For example, when copying to the clipboard on Windows, an invalid lead byte will be copied as the equivalent ISO 8859-1 character and will not hide the following byte. Feature #1211.
  • Lexer added for the Maxima computer algebra language. Feature #1210.
  • Fix hang in Lua lexer when lexing a label up to the terminating "::". Bug #1999.
  • Lua lexer matches identifier chains with dots and colons. Bug #1952.
  • For rectangular selections, pressing Home or End now moves the caret to the Home or End position instead of the limit of the rectangular selection.
  • Fix move-extends-selection mode for rectangular and line selections.
  • On GTK+, change lifetime of selection widget to avoid runtime warnings.
  • Fix building on Mingw/MSYS to perform file copies and deletions. Bug #1993.
  • SciTE can match a wider variety of file patterns where '*' is in the middle of the pattern and where there are multiple '*'. A '?' matches any single character.
  • SciTE on Windows can execute Python scripts directly by name when on path. Feature #1209.
  • SciTE on Windows Find in Files checks for cancel after every 10,000 lines read so can be stopped on huge files.
  • SciTE remembers entered values in lists in more cases for find, replace and find in files. Bug #1715.

Release 4.0.3

  • Released 12 February 2018.
  • Features from C++14 and C++17 are used more often, with build files now specifying c++17, gnu++17, c++1z, or std:c++latest (MSVC). Requires Microsoft Visual C++ 2017.5, GCC 7, Xcode 9.2 or Clang 4.0 or newer.
  • SCI_CREATEDOCUMENT adds a bytes argument to allocate memory for an initial size. SCI_CREATELOADER and SCI_CREATEDOCUMENT add a documentOption argument to allow choosing different document capabilities.
  • Add SC_DOCUMENTOPTION_STYLES_NONE option to stop allocating memory for styles.
  • Add SCI_GETMOVEEXTENDSSELECTION to allow applications to add more complex selection commands.
  • SciTE property bookmark.symbol allows choosing symbol used for bookmarks. Feature #1208.
  • Improve VHDL lexer's handling of character literals and escape characters in strings.
  • Fix double tap word selection on Windows 10 1709 Fall Creators Update. Bug #1983.
  • Fix closing autocompletion lists on Cocoa for macOS 10.13 where the window was emptying but staying visible. Bug #1981.
  • Fix drawing failure on Cocoa with animated find indicator in large files with macOS 10.12 by disabling animation.
  • SciTE on GTK+ installs its desktop file as non-executable and supports the common LDLIBS make variable. Bug #1989, Bug #1990.
  • SciTE shows correct column number when caret in virtual space. Bug #1991.
  • SciTE preserves selection positions when saving with strip.trailing.spaces and virtual space turned on. Bug #1992.

Release 4.0.2

  • Released 26 October 2017.
  • Fix HTML lexer handling of Django so that nesting a {{ }} or {% %} Django tag inside of a {# #} Django comment does not break highlighting of rest of file
  • The Matlab folder now treats "while" as a fold start. Bug #1985.
  • Fix failure on Cocoa with animated find indicator in large files with macOS 10.13 by disabling animation on 10.13.
  • Fix Cocoa hang when Scintilla loaded from SMB share on macOS 10.13. Bug #1979.

Release 4.0.1

  • Released 23 October 2017.
  • The ILoader interface is defined in its own header ILoader.h as it is not related to lexing so doesn't belong in ILexer.h.
  • The Scintilla namespace is always active for internal symbols and for the lexer interfaces ILexer4 and IDocument.
  • The Baan lexer checks that matches to 3rd set of keywords are function calls and leaves as identifiers if not. Baan lexer and folder support #context_on / #context_off preprocessor feature.
  • The C++ lexer improved preprocessor conformance.
    Default value of 0 for undefined preprocessor symbols.
    #define A is treated as #define A 1.
    "defined A" removes "A" before replacing "defined" with value. Bug #1966.
  • The Python folder treats triple-quoted f-strings like triple-quoted strings. Bug #1977.
  • The SQL lexer uses sql.backslash.escapes for double quoted strings. Bug #1968.
  • Minor undefined behaviour fixed. Bug #1978.
  • On Cocoa, improve scrolling on macOS 10.12. Bug #1885.
  • On Cocoa, fix line selection by clicking in the margin when scrolled. Bug #1971.

Release 4.0.0

  • Released 16 August 2017.
  • This is an unstable release with changes to interfaces used for lexers and platform access. Some more changes may occur to internal and external interfaces before stability is regained with 4.1.0.
  • Uses C++14 features. Requires Microsoft Visual C++ 2017, GCC 7, and Clang 4.0 or newer.
  • Support dropped for GTK+ versions before 2.24.
  • The lexer interfaces ILexer and ILexerWithSubStyles, along with additional style metadata methods, were merged into ILexer4. Most lexers will need to be updated to match the new interfaces.
  • The IDocumentWithLineEnd interface was merged into IDocument.
  • The platform layer interface has changed with unused methods removed, a new mechanism for reporting events, removal of methods that take individual keyboard modifiers, and removal of old timer methods.
  • Style metadata may be retrieved from lexers that support this through the SCI_GETNAMEDSTYLES, SCI_NAMEOFSTYLE, SCI_TAGSOFSTYLE, and SCI_DESCRIPTIONOFSTYLE APIs.
  • The Cocoa platform layer uses Automatic Reference Counting (ARC).
  • The default encoding in Scintilla is UTF-8.
  • An SCN_AUTOCSELECTIONCHANGE notification is sent when items are highlighted in an autocompletion or user list.
  • The data parameter to ILoader::AddData made const. Bug #1955.
  • SciTE's embedded Lua interpreter updated to Lua 5.3.
  • SciTE allows event handlers to be arbitrary callables, not just functions. Feature #1190.
  • SciTE allows user.shortcuts to be defined with symbolic Scintilla messages like 'Ctrl+L|SCI_LINEDELETE|'.
  • The Matlab lexer treats 'end' as a number rather than a keyword when used as an index. This also stops incorrect folding. Bug #1951.
  • The Matlab folder implements "fold", "fold.comment", and "fold.compact" properties. Bug #1965.
  • The Rust lexer recognizes 'usize' numeric literal suffixes. Bug #1919.
  • Ensure redraw when application changes overtype mode so caret change visible even when not blinking. Notify application with SC_UPDATE_SELECTION when overtype changed - previously sent SC_UPDATE_CONTENT.
  • Fix drawing failure when in wrap mode for delete to start/end of line which affects later lines but did not redraw them. Also fixed drawing for wrap mode on GTK+ 2.x. Bug #1949.
  • On GTK+ fix drawing problems including incorrect scrollbar redrawing and flickering of text. Bug #1876.
  • On Linux, both for GTK+ and Qt, the default modifier key for rectangular selection is now Alt. This is the same as Windows and macOS. This was changed from Ctrl as window managers are less likely to intercept Alt+Drag for moving windows than in the past.
  • On Cocoa, fix doCommandBySelector but avoid double effect of 'delete' key. Bug #1958.
  • On Qt, the updateUi signal includes the 'updated' flags. No updateUi signal is sent for focus in events. These changes make Qt behave more like the other platforms.
  • On Qt, dropping files on Scintilla now fires the SCN_URIDROPPED notification instead of inserting text.
  • On Qt, focus changes send the focusChanged signal. Bug #1957.
  • On Qt, mouse tracking is reenabled when the window is reshown. Bug #1948.
  • On Windows, the DirectWrite modes SC_TECHNOLOGY_DIRECTWRITEDC and SC_TECHNOLOGY_DIRECTWRITERETAIN are no longer provisional.
  • SciTE on macOS fixes a crash when platform-specific and platform-independent session restoration clashed. Bug #1960.
  • SciTE on GTK+ implements find.close.on.find. Bug #1152, Bug #1254, Bug #1762, Feature #849.

Release 3.7.6

  • Released 8 August 2017.
  • This is the first release of the long term branch which avoids using features from C++14 or later in order to support older systems.
  • The Baan lexer correctly highlights numbers when followed by an operator.
  • On Cocoa, fix a bug with retrieving encoded bytes.

Release 3.7.5

  • Released 26 May 2017.
  • This is the final release of SciTE 3.x.
  • Support dropped for Microsoft Visual C++ 2013 due to increased use of C++11 features.
  • Added a caret line frame as an alternative visual for highlighting the caret line.
  • Added "Reverse Selected Lines" feature.
  • SciTE adds "Select All Bookmarks" command.
  • SciTE adds a save.path.suggestion setting to suggest a file name when saving an unnamed buffer.
  • Updated case conversion and character categories to Unicode 9.
  • The Baan lexer recognizes numeric literals in a more compliant manner including hexadecimal numbers and exponentials.
  • The Bash lexer recognizes strings in lists in more cases. Bug #1944.
  • The Fortran lexer recognizes a preprocessor line after a line continuation &. Bug #1935.
  • The Fortran folder can fold comments. Bug #1936.
  • The PowerShell lexer recognizes escaped quotes in strings. Bug #1929.
  • The Python lexer recognizes identifiers more accurately when they include non-ASCII characters.
  • The Python folder treats comments at the end of the file as separate from the preceding structure.
  • The YAML lexer recognizes comments in more situations and styles a "..." line like a "---" line. Bug #1931.
  • Update scroll bar when annotations added, removed, or visibility changed. Feature #1187.
  • Canceling modes with the Esc key preserves a rectangular selection. Bug #1940.
  • Builds are made with a sorted list of lexers to be more reproducible. Bug #1946.
  • On Cocoa, a leak of mouse tracking areas was fixed.
  • On Cocoa, the autocompletion is 4 pixels wider to avoid text truncation.
  • On Windows, stop drawing a focus rectangle on the autocompletion list and raise the default list length to 9 items.
  • SciTE examines at most 1 MB of a file to automatically determine indentation for indent.auto to avoid a lengthy pause when loading very large files.
  • SciTE user interface uses lighter colours and fewer 3D elements to match current desktop environments.
  • SciTE sets buffer dirty and shows message when file deleted if load.on.activate on.
  • SciTE on Windows Find strip Find button works in incremental no-close mode. Bug #1926.

Release 3.7.4

  • Released 21 March 2017.
  • Requires a C++11 compiler. GCC 4.8 and MSVC 2015 are supported.
  • Support dropped for Windows NT 4.
  • Accessibility support may be queried with SCI_GETACCESSIBILITY. On GTK+, accessibility may be disabled by calling SCI_SETACCESSIBILITY.
  • Lexer added for "indent" language which is styled as plain text but folded by indentation level.
  • The Progress ABL lexer handles nested comments where comment starts or ends are adjacent like "/*/*" or "*/*/".
  • In the Python lexer, improve f-string support. Add support for multiline expressions in triple quoted f-strings. Handle nested "()", "[]", and "{}" in f-string expressions and terminate expression colouring at ":" or "!". End f-string if ending quote is seen in a "{}" expression. Fix terminating single quoted f-string at EOL. Bug #1918.
  • The VHDL folder folds an "entity" on the first line of the file.
  • For IMEs, do not clear selected text when there is no composition text to show.
  • Fix to crash with fold tags where line inserted at start.
  • Fix to stream selection mode when moving caret up or down. Bug #1905.
  • Drawing fixes for fold tags include fully drawing lines and not overlapping some drawing and ensuring edges and mark underlines are visible.
  • Fix Cocoa failure to display accented character chooser for European languages by partially reverting a change made to prevent a crash with Chinese input by special-casing the Cangjie input source. Bug #1881.
  • Fix potential problems with IME on Cocoa when document contains invalid UTF-8.
  • Fix crash on Cocoa with OS X 10.9 due to accessibility API not available. Bug #1915.
  • Improved speed of accessibility code on GTK+ by using additional memory as a cache. Bug #1910.
  • Fix crash in accessibility code on GTK+ < 3.3.6 caused by previous bug fix. Bug #1907.
  • Fix to prevent double scrolling on GTK+ with X11. Bug #1901.
  • SciTE on GTK+ adds an "accessibility" property to allow disabling accessibility on GTK+ as an optimization.
  • SciTE on GTK+ has changed file chooser behaviour for some actions: overwriting an existing file shows a warning; the default session file name "SciTE.session" is shown and a "*.session" filter is applied; appropriate filters are applied when exporting; the current file name is displayed in "Save As" even when that file no longer exists.
  • SciTE fixed a bug where, on GTK+, when the output pane had focus, menu commands performed by mouse were sent instead to the edit pane.
  • SciTE on Windows 8+ further restricts the paths searched for DLLs to the application and system directories which may prevent some binary planting attacks.
  • Fix failure to load Direct2D on Windows when used on old versions of Windows. Bug #1653.

Release 3.7.3

  • Released 19 February 2017.
  • Display block caret over the character at the end of a selection to be similar to other editors.
  • In SciTE can choose colours for fold markers. Feature #1172.
  • In SciTE can hide buffer numbers in tabs. Feature #1173.
  • The Diff lexer recognizes deleted lines that start with "--- ".
  • The Lua lexer requires the first line to start with "#!" to be treated as a shebang comment, not just "#". Bug #1900.
  • The Matlab lexer requires block comment start and end to be alone on a line. Bug #1902.
  • The Python lexer supports f-strings with new styles, allows Unicode identifiers, and no longer allows @1 to be a decorator. Bug #1848.
  • Fix folding inconsistency when fold header added above a folded part. Avoid unnecessary unfolding when a deletion does not include a line end. Bug #1896.
  • Fix finalization crash on Cocoa. Bug #1909.
  • SciTE on GTK+ can have a wide divider between the panes with the split.wide property.
  • Fix display of autocompletion lists and calltips on GTK+ 3.22 on Wayland. Newer APIs used on GTK+ 3.22 as older APIs were deprecated.
  • Fix crash in accessibility code on GTK+ due to signal receipt after destruction. Bug #1907.
  • Make trackpad scrolling work on Wayland. Bug #1901.

Release 3.7.2

  • Released 30 December 2016.
  • Minimize redrawing for SCI_SETSELECTIONN* APIs. Bug #1888.
  • Use more precision to allow selecting individual lines in files with more than 16.7 million lines.
  • For Qt 5, define QT_WS_MAC or QT_WS_X11 on those platforms. Bug #1887.
  • For Cocoa, fix crash on view destruction with macOS 10.12.2. Bug #1891.
  • Fix crash on GTK+ <3.8 due to incorrect lifetime of accessibility object. More accurate reporting of attribute ranges and deletion lengths for accessibility.
  • In SciTE, if a Lua script causes a Scintilla failure exception, display error message in output pane instead of exiting. Bug #1773.

Release 3.7.1

  • Released 4 December 2016.
  • The Scintilla namespace is no longer applied to struct definitions in Scintilla.h even when SCI_NAMESPACE defined. Client code should not define SCI_NAMESPACE.
  • Structure names in Scintilla.h without prefixes are deprecated and will now only be usable with INCLUDE_DEPRECATED_FEATURES defined.
    Use the newer names with the "Sci_" prefix:
    CharacterRange → Sci_CharacterRange
    TextRange → Sci_TextRange
    TextToFind → Sci_TextToFind
    RangeToFormat → Sci_RangeToFormat
    NotifyHeader → Sci_NotifyHeader
  • Previously deprecated features SC_CP_DBCS, SCI_SETUSEPALETTE. and SCI_GETUSEPALETTE have been removed and can no longer be used in client code.
  • Single phase drawing SC_PHASES_ONE is deprecated along with the SCI_SETTWOPHASEDRAW and SCI_GETTWOPHASEDRAW messages.
  • Accessibility support allowing screen readers to work added on GTK+ and Cocoa.
  • Textual tags may be displayed to the right on folded lines with SCI_TOGGLEFOLDSHOWTEXT. This is commonly something like "{ ... }" or "<tr>...</tr>". It is displayed with the STYLE_FOLDDISPLAYTEXT style and may have a box drawn around it with SCI_FOLDDISPLAYTEXTSETSTYLE.
  • A mouse right-click over the margin may send an SCN_MARGINRIGHTCLICK event. This only occurs when popup menus are turned off. SCI_USEPOPUP now has three states: SC_POPUP_NEVER, SC_POPUP_ALL, or SC_POPUP_TEXT.
  • INDIC_POINT and INDIC_POINTCHARACTER indicators added to display small arrows underneath positions or characters.
  • Added alternate appearance for visible tabs which looks like a horizontal line. Controlled with SCI_SETTABDRAWMODE. Feature #1165.
  • On Cocoa, a modulemap file is included to allow Scintilla to be treated as a module. This makes it easier to use Scintilla from the Swift language.
  • Baan folder accommodates sections and lexer fixes definition of SCE_BAAN_FUNCDEF.
  • EDIFACT lexer and folder added. Feature #1166.
  • JSON folder fixed where it didn't resume folding with the correct fold level.
  • Matlab folder based on syntax instead of indentation so more accurate. Bug #1692.
  • YAML lexer fixed style of references and keywords when followed by a comment. Bug #1872.
  • Margin click to select line now clears rectangular and additional selections.
  • Fixed a NULL access bug on GTK+ where the scrollbars could be used during destruction. Bug #1873.
  • A potential bug on GTK+ fixed where asynchronous clipboard could be delivered after its target Scintilla instance was destroyed.
  • Cocoa IME made more compliant with documented behaviour to avoid bugs that caused huge allocations. Bug #1881.
  • On Win32 fix EM_SETSEL to match Microsoft documentation.. Bug #1886.
  • SciTE on GTK+ allows localizing tool bar tool tips. Feature #1167.
  • SciTE on Windows restores focus to edit pane after closing user strip.
  • SciTE measures files larger that 2 GB which allows it to refuse to open huge files more consistently and to show better warning messages.

Release 3.7.0

  • Released 16 October 2016.
  • Word selection, navigation, and manipulation is now performed on characters instead of bytes leading to more natural behaviour for multi-byte encodings like UTF-8. For UTF-8 characters 0x80 and above, classification into word; punctuation; space; or line-end is based on the Unicode general category of the character and is not customizable. Bug #1832.
  • Two enums changed in Scintilla.iface which may lead to changed bindings. There were 2 FontQuality enums and the first is now PhasesDraw. The prefix for FoldAction was SC_FOLDACTION and is now SC_FOLDACTION_ which is similar to other enums. These changes do not affect the standard C/C++ binding.
  • EDGE_MULTILINE and SCI_MULTIEDGEADDLINE added to allow displaying multiple vertical edges simultaneously.
  • The number of margins can be changed with SCI_SETMARGINS.
  • Margin type SC_MARGIN_COLOUR added so that the application may choose any colour for a margin with SCI_SETMARGINBACKN.
  • On Win32, mouse wheel scrolling can be restricted to only occur when the mouse is within the window.
  • The WordList class in lexlib used by lexers adds an InListAbridged method for matching keywords that have particular prefixes and/or suffixes.
  • The Baan lexer was changed significantly with more lexical states, keyword sets, and support for abridged keywords.
  • The CoffeeScript lexer styles interpolated code in strings. Bug #1865.
  • The Progress lexer "progress" has been replaced with a new lexer "abl" (Advanced Business Language) with a different set of lexical states and more functionality. The lexical state prefix has changed from SCE_4GL_ to SCE_ABL_. Feature #1143.
  • The PowerShell lexer understands the grave accent escape character. Bug #1868.
  • The YAML lexer recognizes inline comments. Bug #1660.
  • SciTE on Windows can retain coloured selection when inactive with selection.always.visible property.
  • SciTE on Windows adds a state to close.on.find to close the find strip when a match is found.
  • Fix caret position after left or right movement with rectangular selection. Bug #1861.
  • In SciTE, optional prefix argument added to scite.ConstantName method. Bug #1860.
  • On Cocoa, include ILexer.h in the public headers of the framework. Bug #1855.
  • On Cocoa, allow subclass of SCIContentView to set cursor. Bug #1863.
  • On Cocoa, recognize the numeric keypad '+', '-', and '/' keys as SCK_ADD, SCK_SUBTRACT, and SCK_DIVIDE. Bug #1867.
  • On GTK+ 3.21+ fix incorrect font size in auto-completion list. Bug #1859.
  • Fix SciTE crash when command.mode ends with comma. Bug #1857.
  • SciTE on Windows has a full size toolbar icon for "Close".

Release 3.6.7

  • Released 4 September 2016.
  • C++11 range-based for loops used in SciTE so GCC 4.6 is now the minimum supported version.
  • SC_CHARSET_DEFAULT now means code page 1252 on Windows unless a code page is set. This prevents unexpected behaviour and crashes on East Asian systems where default locales are commonly DBCS. Projects which want to default to DBCS code pages in East Asian locales should set the code page and character set explicitly.
  • SCVS_NOWRAPLINESTART option stops left arrow from wrapping to the previous line. Most commonly wanted when virtual space is used. Bug #1648.
  • The C++ lexer can fold on #else and #elif with the fold.cpp.preprocessor.at.else property. Bug #210.
  • The errorlist lexer detects warnings from Visual C++ which do not contain line numbers.
  • The HTML lexer no longer treats "<?" inside a string in a script as potentially starting an XML document. Bug #767.
  • The HTML lexer fixes a problem resuming at a script start where the starting state continued past where it should. Bug #1849.
  • When inserting spaces for virtual space and the position is in indentation and tabs are enabled for indentation then use tabs. Bug #1850.
  • Fix fold expand when some child text not styled. Caused by fixes for Bug #1799. Bug #1842.
  • Fix key binding bug on Cocoa for control+. Bug #1854.
  • Fix scroll bar size warnings on GTK+ caused by #1831. Bug #1851.
  • Small fixes for GTK+ makefile. Bug #1844. Bug #1845. Bug #1846.
  • Fix SciTE indentation after code like "void function () {}".
  • Fix SciTE global regex replace of "^" with something which missed the line after empty lines with LF line ends. Bug #1839.
  • Fix SciTE on GTK+ 3.20 bug where toggle buttons on find and replace strips did not show active state. Bug #1853.

Release 3.6.6

  • Released 24 May 2016.
  • C++ 11 <regex> support built by default. Can be disabled by defining NO_CXX11_REGEX.
  • SciTE_USERHOME environment variable allows separate location for writeable properties files. Feature #965.
  • GObject introspection supports notify and command events.
  • The Progress lexer now allows comments preceded by a tab.
  • Scripts reading Scintilla.iface file include comments for enu and lex definitions. Bug #1829.
  • Fix crashes on GTK+ if idle work active when destroyed. Bug #1827.
  • Fixed bugs when used on GTK+ 3.20. Bug #1825. Bug #1831.
  • Fix SciTE search field background with dark theme on GTK+ 2.x. Bug #1826.
  • Fixed bug on Win32 that allowed resizing autocompletion from bottom when it was located above the caret.
  • On Win32, when using a screen reader and selecting text using Shift+Arrow, fix bug when scrolling made the caret stay at the same screen location so the screen reader did not speak the added or removed selection.

Release 3.6.5

  • Released 26 April 2016.
  • JSON lexer added. Feature #1140.
  • The C++ lexer fixes a bug with multi-line strings with line continuation where the string style overflowed after an edit. Bug #1824.
  • The Python lexer treats '@' as an operator except when it is the first visible character on a line. This is for Python 3.5.
  • The Rust lexer allows '?' as an operator. Feature #1146.
  • Doubled size of compiled regex buffer. Bug #1822.
  • For GTK+, the Super modifier key can be used in key bindings. Feature #1142.
  • For GTK+, fix some crashes when using multiple threads.
  • Platform layer font cache removed on GTK+ as platform-independent caches are used. This avoids the use of thread locking and initialization of threads so any GTK+ applications that rely on Scintilla initializing threads will have to do that themselves.
  • SciTE bug fixed with exported HTML where extra line shown. Bug #1816.
  • SciTE on Windows fixes bugs with pop-up menus in the find and replace strips. For the replace strip, menu choices change the state. For the find strip, menu choices are reflected in the appearance of their corresponding buttons.
  • SciTE on Windows on high DPI displays fixes the height of edit boxes in user strips.

Release 3.6.4

  • Released 13 March 2016.
  • SciTE allows setting the autocompletion type separator character.
  • The C++ folder folds code on '(' and ')' to allow multi-line calls to be folded. Feature #1138.
  • For the HTML lexer, limit the extent of Mako line comments to finish before the line end characters.
  • Folds unfolded when two fold regions are merged by either deleting an intervening line or changing its fold level by adding characters. This was fixed both in Scintilla and in SciTE's equivalent code. Bug #1799.
  • The Progress lexer supports hexadecimal numeric literals, single-line comments, abbreviated keywords and extends nested comments to unlimited levels.
  • Ruby lexer treats alternate hash key syntax "key:" as a symbol. Bug #1810.
  • Rust lexer handles bracketed Unicode string escapes like "\u{123abc}". Bug #1809.
  • For GTK+ on Windows fix 64-bit build which was broken in 3.6.3.
  • For Qt, release builds have assertions turned off.
  • For Qt on Windows, fix compilation failure for Qt 4.x.
  • IME target range displayed on Qt for OS X.
  • On Windows, make clipboard operations more robust by retrying OpenClipboard if it fails as this may occur when another application has opened the clipboard.
  • On Windows back out change that removed use of def file to ensure Scintilla_DirectFunction exported without name mangling. Bug #1813.
  • On GTK+ and Qt over Win32 in Korean fix bug caused by last release's word input change.
  • For SciTE, more descriptive error messages are displayed when there are problems loading the Lua startup script. Feature #1139.

Release 3.6.3

  • Released 18 January 2016.
  • Allow painting without first styling all visible text then styling in the background using idle-time. This helps performance when scrolling down in very large documents. Can also incrementally style after the visible area to the end of the document so that the document is already styled when the user scrolls to it.
  • Support GObject introspection on GTK+.
  • SciTE supports pasting to each selection with the selection.multipaste setting. Feature #1123.
  • SciTE can optionally display a read-only indicator on tabs and in the Buffers menu.
  • Bash lexer flags incomplete here doc delimiters as syntax errors. Bug #1789.
    Support added for using '#' in non-comment ways as is possible with zsh. Bug #1794.
    Recognize more characters as here-doc delimiters. Bug #1778.
  • Errorlist lexer highlights warning messages from the Microsoft linker.
  • Errorlist lexer fixes bug with final line in escape sequence recognition mode.
  • Lua lexer includes '&' and '|' bitwise operators for Lua 5.3. Bug #1790.
  • Perl lexer updated for Perl 5.20 and 5.22.
    Allow '_' for subroutine prototypes. Bug #1791.
    Double-diamond operator <<>>.
    Hexadecimal floating point literals.
    Repetition in list assignment. Bug #1793.
    Highlight changed subroutine prototype syntax for Perl 5.20. Bug #1797.
    Fix module ::-syntax when special characters such as 'x' are used.
    Added ' and " detection as prefix chars for x repetition operator. Bug #1800.
  • Visual Prolog lexer recognizes numbers more accurately and allows non-ASCII verbatim quoting characters. Feature #1130.
  • Send SCN_UPDATEUI with SC_UPDATE_SELECTION when the application changes multiple selection.
  • Expand folded areas before deleting fold header line. Bug #1796.
  • Treat Unicode line ends like common line ends when maintaining fold state.
  • Highlight whole run for hover indicator when wrapped. Bug #1784.
  • On Cocoa, fix crash when autocompletion list closed during scroll bounce-back. Bug #1788.
  • On Windows, fix non-BMP input through WM_CHAR and allow WM_UNICHAR to work with non-BMP characters and on non-Unicode documents. Bug #1779.
  • On Windows using DirectWrite, for ligatures and other character clusters, display caret and selections part-way through clusters so that the caret doesn't stick to the end of the cluster making it easier to understand editing actions.
  • On Windows, Scintilla no longer uses a .DEF file during linking as it duplicates source code directives.
  • On GTK+ and Qt, Korean input by word fixed.
  • On GTK+, Qt, and Win32 block IME input when document is read-only or any selected text is protected.
  • On GTK+ on OS X, fix warning during destruction. Bug #1777.
  • Fix SciTE crashes when using LPEG lexers.

Release 3.6.2

  • Released 6 November 2015.
  • Whitespace may be made visible just in indentation.
  • Whitespace dots are centred when larger than 1 pixel.
  • The Scintilla framework on Cocoa now contains version numbers.
  • SciTE's standard properties collect values from all active .properties file to produce the Language menu and the file types pull-down in the File open dialog.
  • The single executable version of SciTE, Sc1, uses 'module' statements within its embedded properties. This makes it act more like the full distribution allowing languages to be turned on and off by setting imports.include and imports.exclude. The default imports.exclude property adds eiffel, erlang, ps, and pov so these languages are turned off by default.
  • SciTE adds an output.blank.margin.left property to allow setting the output pane margin to a different width than the edit pane.
  • CoffeeScript lexer highlights ranges correctly. Bug #1765.
  • Markdown lexer treats line starts consistently to always highlight *foo* or similar at line start. Bug #1766.
  • Optimize marker redrawing by only drawing affected lines when markers shown in the text.
  • On Cocoa, timers and idling now work in modal dialogs. This also stops some crashes.
  • On Cocoa, fix crashes when deleting a ScintillaView. These crashes could occur when scrolling at the time the ScintillaView was deleted although there may have been other cases.
  • On GTK+ 2.x, fix height of lines in autocompletion lists. Bug #1774.
  • Fix bug with SCI_LINEENDDISPLAY where the caret moved to the next document line instead of the end of the display line. Bug #1772.
  • Report error (SC_STATUS_FAILURE) when negative length passed to SCI_SETSTYLING. Bug #1768.
  • When SC_MARK_UNDERLINE is not assigned to a margin, stop drawing the whole line.
  • When reverting an untitled document in SciTE, just clear it with no message about a file. Bug #1764.
  • SciTE on GTK+ allows use of Ctrl+A (Select All) inside find and replace strips. Bug #1769.

Release 3.6.1

  • Released 15 September 2015.
  • The oldest version of GTK+ supported now is 2.18 and for glib it is 2.22.
  • On GTK+, SC_CHARSET_OEM866 added to allow editing Russian files encoded in code page 866. Feature #1019.
  • On Windows, reconversion is performed when requested by the IME.
  • CoffeeScript lexer adds lexical class for instance properties and fixes some cases of regex highlighting. Bug #1749.
  • The errorlist lexer understands some ANSI escape sequences to change foreground colour and intensity. This is sufficient to colour diagnostic output from gcc and clang when -fdiagnostics-color set.
  • The errorlist lexer allows the line number to be 0 in GCC errors as some tools report whole file errors as line 0.
  • MySql lexer fixes empty comments /**/ so the comment state does not continue.
  • VHDL folder supports "protected" keyword.
  • Treat CRLF line end as two characters in SCI_COUNTCHARACTERS. Bug #1757.
  • On GTK+ 3.x, fix height of lines in autocompletion lists to match the font. Switch from deprecated style calls to CSS styling. Removed setting list colours on GTK+ 3.16+ as no longer appears needed.
  • On GTK+, avoid "Invalid rectangle passed" warning messages by never reporting the client rectangle with a negative width or height. Bug #1743.
  • On Cocoa, copy Sci_Position.h into the framework so clients can build.
  • On Cocoa fix bug with drag and drop that could lead to crashes. Bug #1751.
  • Fix SciTE disk exhaustion bug by reporting failures when writing files. Bug #1760.
  • Fix find strip in SciTE on Windows XP to be visible.
  • SciTE on Windows changes the way it detects that a tool has finished executing to ensure all output data from the process is read.
  • SciTE on Windows improves the time taken to read output from tools that produce a large amount of output by a factor of around 10.
  • On GTK+ the keyboard command for View | End of Line was changed to Ctrl+Shift+N to avoid clash with Search | Selection Add Next. Bug #1750.

Release 3.6.0

  • Released 3 August 2015.
  • External interfaces use the Sci_Position and Sci_PositionU typedefs instead of int and unsigned int to allow for changes to a 64-bit interface on 64-bit platforms in the future. Applications and external lexers should start using the new type names so that they will be compatible when the 64-bit change occurs. There is also Sci_PositionCR (long) for use in the Sci_CharacterRange struct which will also eventually become 64-bit.
  • Multiple selection now works over more key commands. The new multiple-selection handling commands include horizontal movement and selection commands, line up and down movement and selection commands, word and line deletion commands, and line end insertion. This change in behaviours is conditional on setting the SCI_SETADDITIONALSELECTIONTYPING property.
  • Autocompletion lists send an SCN_AUTOCCOMPLETED notification after the text has been inserted. Feature #1109.
  • The case mode style attribute can now be SC_CASE_CAMEL.
  • The Python lexer supports substyles for identifiers.
  • SciTE adds support for substyles.
  • SciTE's Export as RTF and Copy as RTF commands support UTF-8.
  • SciTE can display autocompletion on all IME input with ime.autocomplete property.
  • SciTE properties files now discard trailing white space on variable names.
  • Calling SCI_SETIDENTIFIERS resets styling to ensure any added identifier are highlighted.
  • Avoid candidate box randomly popping up away from edit pane with (especially Japanese) IME input.
  • On Cocoa fix problems with positioning of autocompletion lists near screen edge or under dock. Cancel autocompletion when window moved. Bug #1740.
  • Fix drawing problem when control characters are in a hidden style as they then have a zero width rectangle to draw but modify that rectangle in a way that clears some pixels.
  • Report error when attempt to resize buffer to more than 2GB with SC_STATUS_FAILURE.
  • Fix bug on GTK+ with scroll bars leaking. Bug #1742.
  • LexOthers.cxx file split into one file per lexer: LexBatch, LexDiff, LexErrorList, LexMake, LexNull, and LexProps.
  • SciTE exporters handle styles > 127 correctly now.
  • SciTE on Windows can scale window element sizes based on the system DPI setting.
  • SciTE implements find.in.files.close.on.find on all platforms, not just Windows.

Release 3.5.7

  • Released 20 June 2015.
  • Added SCI_MULTIPLESELECTADDNEXT to add the next occurrence of the main selection within the target to the set of selections as main. If the current selection is empty then select word around caret. SCI_MULTIPLESELECTADDEACH adds each occurrence of the main selection within the target to the set of selections.
  • SciTE adds "Selection Add Next" and "Selection Add Each" commands to the Search menu.
  • Added SCI_ISRANGEWORD to determine if the parameters are at the start and end of a word.
  • Added SCI_TARGETWHOLEDOCUMENT to set the target to the whole document.
  • Verilog lexer recognizes protected regions and the folder folds protected regions.
  • A performance problem with markers when deleting many lines was fixed. Bug #1733.
  • On Cocoa fix crash when ScintillaView destroyed if no autocompletion ever displayed. Bug #1728.
  • On Cocoa fix crash in drag and drop.
  • On GTK+ 3.4+, when there are both horizontal and vertical scrollbars, draw the lower-right corner so that it does not appear black when text selected. Bug #1611.
  • Fixed most calls deprecated in GTK+ 3.16. Does not fix style override calls as they are more complex.
  • SciTE on GTK+ 3.x uses a different technique for highlighting the search strip when there is no match which is more compatible with future and past versions and different themes.

Release 3.5.6

  • Released 26 May 2015.
  • On Qt, use fractional positioning calls and avoid rounding to ensure consistency.
  • SCI_TARGETASUTF8 and SCI_ENCODEDFROMUTF8 implemented on Win32 as well as GTK+ and Cocoa.
  • C++ lexer fixes empty backquoted string. Bug #1711.
  • C++ lexer fixes #undef directive. Bug #1719.
  • Fortran folder fixes handling of "selecttype" and "selectcase". Bug #1724.
  • Verilog folder folds interface definitions.
  • VHDL folder folds units declarations and fixes a case insensitivity bug with not treating "IS" the same as "is".
  • Fix bug when drawing text margins in buffered mode which would use default encoding instead of chosen encoding. Bug #1703.
  • Fix bug with Korean Hanja conversions in DBCS encoding on Windows.
  • Fix for reading a UTF-16 file in SciTE where a non-BMP character is split over a read buffer boundary. Bug #1710.
  • Fix bug on GTK+ 2.x for Windows where there was an ABI difference between compiler version. Bug #1726.
  • Fix undo bug on Cocoa that could lose data..
  • Fix link error on Windows when SCI_NAMESPACE used.
  • Fix exporting from SciTE when using Scintillua for lexing.
  • SciTE does not report twice that a search string can not be found when "Replace" pressed. Bug #1716.
  • SciTE on GTK+ 3.x disables arrow in search combo when no entries. Bug #1717.

Release 3.5.5

  • Released 17 April 2015.
  • Scintilla on Windows is now always a wide character window so SCI_SETKEYSUNICODE has no effect and SCI_GETKEYSUNICODE always returns true. These APIs are deprecated and should not be called.
  • The wxWidgets-specific ascent member of Font has been removed which breaks compatibility with current wxStyledTextCtrl. Bug #1682.
  • IME on Qt supports multiple carets and behaves more like other platforms.
  • Always use inline IME on GTK+ for Korean.
  • SQL lexer fixes handling of '+' and '-' in numbers so the '-' in '1-1' is seen as an operator and for '1--comment' the comment is recognized.
  • TCL lexer reverts change to string handling. Bug #1642.
  • Verilog lexer fixes bugs with macro styling. Verilog folder fixes bugs with `end completing an `if* instead of `endif and fold.at.else, and implements folding at preprocessor `else.
  • VHDL lexer supports extended identifiers.
  • Fix bug on Cocoa where the calltip would display incorrectly when switching calltips and the new calltip required a taller window.
  • Fix leak on Cocoa with autocompletion lists. Bug #1706.
  • Fix potential crash on Cocoa with drag and drop. Bug #1709.
  • Fix bug on Windows when compiling with MinGW-w64 which caused text to not be drawn when in wrap mode. Bug #1705.
  • Fix SciTE bug with missing file open filters and add hex to excluded set of properties files so that its settings don't appear. Bug #1707.
  • Fix SciTE bug where files without extensions like "makefile" were not highlighted correctly.

Release 3.5.4

  • Released 8 March 2015.
  • Indicators may have a different colour and style when the mouse is over them or the caret is moved into them.
  • An indicator may display in a large variety of colours with the SC_INDICFLAG_VALUEFORE flag taking the colour from the indicator's value, which may differ for every character, instead of its foreground colour attribute.
  • On Cocoa, additional IME methods implemented so that more commands are enabled. For Japanese: Reverse Conversion, Convert to Related Character, and Search Similar Kanji can now be performed. The global definition hotkey Command+Control+D and the equivalent three finger tap gesture can be used.
  • Minimum version of Qt supported is now 4.8 due to the use of QElapsedTimer::nsecsElapsed.
  • On Windows, for Korean, the VK_HANJA key is implemented to choose Hanja for Hangul and to convert from Hanja to Hangul.
  • C++ lexer adds lexer.cpp.verbatim.strings.allow.escapes option that allows verbatim (@") strings to contain escape sequences. This should remain off (0) for C# and be turned on (1) for Objective C.
  • Rust lexer accepts new 'is'/'us' integer suffixes instead of 'i'/'u'. Bug #1098.
  • Ruby folder can fold multiline comments. Bug #1697.
  • SQL lexer fixes a bug with the q-quote operator.
  • TCL lexer fixes a bug with some strings. Bug #1642.
  • Verilog lexer handles escaped identifiers that begin with \ and end with space like \reset* . Verilog folder fixes one bug with inconsistent folding when fold.comment is on and another with typedef class statements creating a fold point, expecting an endclass statement.
  • VHDL folder fixes hang in folding when document starts with "entity".
  • Add new indicators INDIC_COMPOSITIONTHIN, INDIC_FULLBOX, and INDIC_TEXTFORE. INDIC_COMPOSITIONTHIN is a thin underline that mimics the appearance of non-target segments in OS X IME. INDIC_FULLBOX is similar to INDIC_STRAIGHTBOX but covers the entire character area which means that indicators with this style on contiguous lines may touch. INDIC_TEXTFORE changes the text foreground colour.
  • Fix adaptive scrolling speed for GTK+ on OS X with GTK Quartz backend (as opposed to X11 backend). Bug #1696.
  • Fix position of autocompletion and calltips on Cocoa when there were two screens stacked vertically.
  • Fix crash in SciTE when saving large files in background when closing application. Bug #1691.
  • Fix decoding of MSVC warnings in SciTE so that files in the C:\Program Files (x86)\ directory can be opened. This is a common location of system include files.
  • Fix compilation failure of C++11 <regex> on Windows using gcc.

Release 3.5.3

  • Released 20 January 2015.
  • Support removed for Windows 95, 98, and ME.
  • Lexers added for Motorola S-Record files, Intel hex files, and Tektronix extended hex files with folding for Intel hex files. Feature #1091. Feature #1093. Feature #1095. Feature #1096.
  • C++ folder allows folding on square brackets '['. Feature #1087.
  • Shell lexer fixes three issues with here-documents. Bug #1672.
  • Verilog lexer highlights doc comment keywords; has separate styles for input, output, and inout ports (lexer.verilog.portstyling); fixes a bug in highlighting numbers; can treat upper-case identifiers as keywords (lexer.verilog.allupperkeywords); and can use different styles for code that is inactive due to preprocessor commands (lexer.verilog.track.preprocessor, lexer.verilog.update.preprocessor).
  • When the calltip window is taller than the Scintilla window, leave it in a position that avoids overlapping the Scintilla text.
  • When a text margin is displayed, for annotation lines, use the background colour of the base line.
  • On Windows GDI, assume font names are encoded in UTF-8. This matches the Direct2D code path.
  • Fix paste for GTK+ on OS X. Bug #1677.
  • Reverted a fix on Qt where Qt 5.3 has returned to the behaviour of 4.x. Bug #1575.
  • When the mouse is on the line between margin and text changed to treat as within text. This makes the PLAT_CURSES character cell platform work better.
  • Fix a crash in SciTE when the command line is just "-close:". Bug #1675.
  • Fix unexpected dialog in SciTE on Windows when the command line has a quoted filename then ends with a space. Bug #1673.
  • On Windows and GTK+, use indicators for inline IME.
  • SciTE shuts down quicker when there is no user-written OnClose function and no directors are attached.

Release 3.5.2

  • Released 2 December 2014.
  • For OS X Cocoa switch C++ runtime to libc++ to enable use of features that will never be added to libstdc++ including those part of C++11. Scintilla will now run only on OS X 10.7 or later and only in 64-bit mode.
  • Include support for using C++11 <regex> for regular expression searches. Enabling this requires rebuilding Scintilla with a non-default option. This is a provisional feature and may change API before being made permanent.
  • Allocate indicators used for Input Method Editors after 31 which was the previous limit of indicators to ensure no clash between the use of indicators for IME and for the application.
  • ANNOTATION_INDENTED added which is similar to ANNOTATION_BOXED in terms of positioning but does not show a border. Feature #1086.
  • Allow platform overrides for drawing tab arrows, wrap markers, and line markers. Size of double click detection area is a variable. These enable better visuals and behaviour for PLAT_CURSES as it is character cell based.
  • CoffeeScript lexer fixes "/*" to not be a comment. Bug #1420.
  • VHDL folder fixes "block" keyword. Bug #1664.
  • Prevent caret blinking when holding down Delete key. Bug #1657.
  • On Windows, allow right click selection in popup menu. Feature #1080.
  • On Windows, only call ShowCaret in GDI mode as it interferes with caret drawing when using Direct2D. Bug #1643.
  • On Windows, another DirectWrite mode SC_TECHNOLOGY_DIRECTWRITEDC added which may avoid drawing failures in some circumstances by drawing into a GDI DC. This feature is provisional and may be changed or removed if a better solution is found.
  • On Windows, avoid processing mouse move events where the mouse has not moved as these can cause unexpected dwell start notifications. Bug #1670.
  • For GTK+ on Windows, avoid extra space when pasting from external application.
  • On GTK+ 2.x allow Scintilla to be used inside tool tips by changing when preedit window created. Bug #1662.
  • Support MinGW compilation under Linux. Feature #1077.

Release 3.5.1

  • Released 30 September 2014.
  • BibTeX lexer added. Feature #1071.
  • SQL lexer supports the q-quote operator as SCE_SQL_QOPERATOR(24).
  • VHDL lexer supports block comments. Bug #1527.
  • VHDL folder fixes case where "component" used before name. Bug #613.
  • Restore fractional pixel tab positioning which was truncated to whole pixels in 3.5.0. Bug #1652.
  • Allow choice between windowed and inline IME on some platforms.
  • On GTK+ cache autocomplete window to avoid platform bug where windows were sometimes lost. Bug #1649.
  • On GTK+ size autocomplete window more accurately.
  • On Windows only unregister windows classes registered. Bug #1639.
  • On Windows another DirectWrite mode SC_TECHNOLOGY_DIRECTWRITERETAIN added which may avoid drawing failures on some cards and drivers. This feature is provisional and may be changed or removed if a better solution is found.
  • On Windows support the Visual Studio 2010+ clipboard format that indicates a line copy. Bug #1636.
  • SciTE session files remember the scroll position.

Release 3.5.0

  • Released 13 August 2014.
  • Text may share space vertically so that extreme ascenders and descenders are not cut off by calling SCI_SETPHASESDRAW(SC_PHASES_MULTIPLE).
  • Separate timers are used for each type of periodic activity and they are turned on and off as required. This saves power as there are fewer wake ups. On recent releases of OS X Cocoa and Windows, coalescing timers are used to further save power. Bug #1086. Bug #1532.
  • Explicit tab stops may be set for each line.
  • On Windows and GTK+, when using Korean input methods, IME composition is moved from a separate window into the Scintilla window.
  • SciTE adds a "Clean" command to the "Tools" menu which is meant to be bound to a command like "make clean".
  • Lexer added for Windows registry files.
  • HTML lexer fixes a crash with SGML after a Mako comment. Bug #1622.
  • KiXtart lexer adds a block comment state. Feature #1053.
  • Matlab lexer fixes transpose operations like "X{1}'". Bug #1629.
  • Ruby lexer fixes bugs with the syntax of symbols including allowing a symbol to end with '?'. Bug #1627.
  • Rust lexer supports byte string literals, naked CR can be escaped in strings, and files starting with "#![" are not treated as starting with a hashbang comment. Feature #1063.
  • Bug fixed where style data was stale when deleting a rectangular selection.
  • Bug fixed where annotations disappeared when SCI_CLEARDOCUMENTSTYLE called.
  • Bug fixed where selection not redrawn after SCI_DELWORDRIGHT. Bug #1633.
  • Change the function prototypes to be complete for functions exported as "C". Bug #1618.
  • Fix a memory leak on GTK+ with autocompletion lists. Bug #1638.
  • On GTK+, use the full character width for the overstrike caret for multibyte characters.
  • On Qt, set list icon size to largest icon. Add padding on OS X. Bug #1634.
  • On Qt, fix building on FreeBSD 9.2. Bug #1635.
  • On Qt, add a get_character method on the document. Feature #1064.
  • On Qt, add SCI_* for methods to ScintillaConstants.py. Feature #1065.
  • SciTE on GTK+ crash fixed with Insert Abbreviation command.
  • For SciTE with read-only files and are.you.sure=0 reenable choice to save to another location when using Save or Close commands.
  • Fix SciTE bug where toggle bookmark did not work after multiple lines with bookmarks merged. Bug #1617.

Release 3.4.4

  • Released 3 July 2014.
  • Style byte indicators removed. They were deprecated in 2007. Standard indicators should be used instead. Some elements used by lexers no longer take number of bits or mask arguments so lexers may need to be updated for LexAccessor::StartAt, LexAccessor::SetFlags (removed), LexerModule::LexerModule.
  • When multiple selections are active, autocompletion text may be inserted at each selection with new SCI_AUTOCSETMULTI method.
  • C++ lexer fixes crash for "#define x(". Bug #1614.
  • C++ lexer fixes raw string recognition so that R"xxx(blah)xxx" is styled as SCE_C_STRINGRAW.
  • The Postscript lexer no longer marks token edges with indicators as this used style byte indicators.
  • The Scriptol lexer no longer displays indicators for poor indentation as this used style byte indicators.
  • TCL lexer fixes names of keyword sets. Bug #1615.
  • Shell lexer fixes fold matching problem caused by "<<<". Bug #1605.
  • Fix bug where indicators were not removed when fold highlighting on. Bug #1604.
  • Fix bug on Cocoa where emoji were treated as being zero width.
  • Fix crash on GTK+ with Ubuntu 12.04 and overlay scroll bars.
  • Avoid creating a Cairo context when measuring text on GTK+ as future versions of GTK+ may prohibit calling gdk_cairo_create except inside drawing handlers. This prohibition may be required on Wayland.
  • On Cocoa, the registerNotifyCallback method is now marked as deprecated so client code that uses it will display an error message. Client code should use the delegate mechanism or subclassing instead. The method will be removed in the next version.
  • On Cocoa, package Scintilla more in compliance with platform conventions. Only publish public headers in the framework headers directory. Only define the Scintilla namespace in Scintilla.h when compiling as C++. Use the Cocoa NS_ENUM and NS_OPTIONS macros for exposed enumerations. Hide internal methods from public headers. These changes are aimed towards publishing Scintilla as a module which will allow it to be used from the Swift programming language, although more changes will be needed here.
  • Fix crash in SciTE when stream comment performed at line end. Bug #1610.
  • For SciTE on Windows, display error message when common dialogs fail. Bug #156.
  • For SciTE on GTK+ fix bug with initialization of toggle buttons in find and replace strips. Bug #1612.

Release 3.4.3

  • Released 27 May 2014.
  • Fix hangs and crashes in DLL at shutdown on Windows when using Direct2D.

Release 3.4.2

  • Released 22 May 2014.
  • Insertions can be filtered or modified by calling SCI_CHANGEINSERTION inside a handler for SC_MOD_INSERTCHECK.
  • DMIS lexer added. DMIS is a language for coordinate measuring machines. Feature #1049.
  • Line state may be displayed in the line number margin to aid in debugging lexing and folding with SC_FOLDFLAG_LINESTATE (128).
  • C++ lexer understands more preprocessor statements. #if defined SYMBOL is understood. Some macros with arguments can be understood and these may be predefined in keyword set 4 (keywords5 for SciTE) with syntax similar to CHECKVERSION(x)=(x<3). Feature #1051.
  • C++ lexer can highlight task marker keywords in comments as SCE_C_TASKMARKER.
  • C++ lexer can optionally highlight escape sequences in strings as SCE_C_ESCAPESEQUENCE.
  • C++ lexer supports Go back quoted raw string literals with lexer.cpp.backquoted.strings option. Feature #1047.
  • SciTE performs word and search match highlighting as an idle task to improve interactivity and allow use of these features on large files.
  • Bug fixed on Cocoa where previous caret lines were visible. Bug #1593.
  • Bug fixed where caret remained invisible when period set to 0. Bug #1592.
  • Fixed display flashing when scrolling with GTK+ 3.10. Bug #1567.
  • Fixed calls and constants deprecated in GTK+ 3.10.
  • Fixed bug on Windows where WM_GETTEXT did not provide data in UTF-16 for Unicode window. Bug #685.
  • For SciTE, protect access to variables used by threads with a mutex to prevent data races.
  • For SciTE on GTK+ fix thread object leaks. Display the version of GTK+ compiled against in the about box.
  • For SciTE on GTK+ 3.10, fix the size of the tab bar's content and use freedesktop.org standard icon names where possible.
  • For SciTE on Windows, fix bug where invoking help resubmitted the running program. Bug #272.
  • SciTE's highlight current word feature no longer matches the selection when it contains space.
  • For building SciTE in Visual C++, the win\SciTE.vcxproj project file should be used. The boundscheck directory and its project and solution files have been removed.

Release 3.4.1

  • Released 1 April 2014.
  • Display Unicode line ends as [LS], [PS], and [NEL] blobs.
  • Bug fixed where cursor down failed on wrapped lines. Bug #1585.
  • Caret positioning changed a little to appear inside characters less often by rounding the caret position to the pixel grid instead of truncating. Bug #1588.
  • Bug fixed where automatic indentation wrong when caret in virtual space. Bug #1586.
  • Bug fixed on Windows where WM_LBUTTONDBLCLK was no longer sent to window. Bug #1587.
  • Bug fixed with SciTE on Windows XP where black stripes appeared inside the find and replace strips.
  • Crash fixed in SciTE with recursive properties files. Bug #1507.
  • Bug fixed with SciTE where Ctrl+E before an unmatched end brace jumps to file start. Bug #315.
  • Fixed scrolling on Cocoa to avoid display glitches and be smoother.
  • Fixed crash on Cocoa when character composition used when autocompletion list active.

Release 3.4.0

  • Released 22 March 2014.
  • The Unicode line ends and substyles features added as provisional in 3.2.5 are now finalized. There are now no provisional features.
  • Added wrap mode SC_WRAP_WHITESPACE which only wraps on whitespace, not on style changes.
  • SciTE find and replace strips can perform incremental searching and temporary highlighting of all matches with the find.strip.incremental, replace.strip.incremental, and find.indicator.incremental settings.
  • SciTE default settings changed to use strips for find and replace and to draw with Direct2D and DirectWrite on Windows.
  • SciTE on Windows scales image buttons on the find and replace strips to match the current system scale factor.
  • Additional assembler lexer variant As(SCLEX_AS) for Unix assembly code which uses '#' for comments and ';' to separate statements.
  • Fix Coffeescript lexer for keyword style extending past end of word. Also fixes styling 0...myArray.length all as a number. Bug #1583.
  • Fix crashes and other bugs in Fortran folder by removing folding of do-label constructs.
  • Deleting a whole line deletes the annotations on that line instead of the annotations on the next line. Bug #1577.
  • Changed position of tall calltips to prefer lower half of screen to cut off end instead of start.
  • Fix Qt bug where double click treated as triple click. Bug #1575.
  • On Qt, selecting an item in an autocompletion list that is not currently visible positions it at the top.
  • Fix bug on Windows when resizing autocompletion list with only short strings caused the list to move.
  • On Cocoa reduce scrollable height by one line to fix bugs with moving caret up or down.
  • On Cocoa fix calltips which did not appear when they were created in an off-screen position.

Release 3.3.9

  • Released 31 January 2014.
  • Fix 3.3.8 bug where external lexers became inaccessible. Bug #1574.

Release 3.3.8

  • Released 28 January 2014.
  • DropSelectionN API added to drop a selection from a multiple selection.
  • CallTipSetPosStart API added to change the position at which backspacing removes the calltip.
  • SC_MARK_BOOKMARK marker symbol added which looks like bookmark ribbons used in book reading applications.
  • Basic lexer highlights hex, octal, and binary numbers in FreeBASIC which use the prefixes &h, &o and &b respectively. Feature #1041.
  • C++ lexer fixes bug where keyword followed immediately by quoted string continued keyword style. Bug #1564.
  • Matlab lexer treats '!' differently for Matlab and Octave languages. Bug #1571.
  • Rust lexer improved with nested comments, more compliant doc-comment detection, octal literals, NUL characters treated as valid, and highlighting of raw string literals and float literals fixed. Feature #1038. Bug #1570.
  • On Qt expose the EOLMode on the document object.
  • Fix hotspot clicking where area was off by half a character width. Bug #1562.
  • Tweaked scroll positioning by either 2 pixels or 1 pixel when caret is at left or right of view to ensure caret is inside visible area.
  • Send SCN_UPDATEUI with SC_UPDATE_SELECTION for Shift+Tab inside text.
  • On Windows update the system caret position when scrolling to help screen readers see the scroll quickly.
  • On Cocoa, GTK+, and Windows/Direct2D draw circles more accurately so that circular folding margin markers appear circular, of consistent size, and centred. Make SC_MARK_ARROWS drawing more even. Fix corners of SC_MARK_ROUNDRECT with Direct2D to be similar to other platforms.
  • SciTE uses a bookmark ribbon symbol for bookmarks as it scales better to higher resolutions than the previous blue gem bitmap.
  • SciTE will change the width of margins while running when the margin.width and fold.margin.width properties are changed.
  • SciTE on Windows can display a larger tool bar with the toolbar.large property.
  • SciTE displays a warning message when asked to open a directory. Bug #1568.

Release 3.3.7

  • Released 12 December 2013.
  • Lexer added for DMAP language. Feature #1026.
  • Basic lexer supports multiline comments in FreeBASIC. Feature #1023.
  • Bash lexer allows '#' inside words.. Bug #1553.
  • C++ lexer recognizes C++11 user-defined literals and applies lexical class SCE_C_USERLITERAL.
  • C++ lexer allows single quote characters as digit separators in numeric literals like 123'456 as this is included in C++14.
  • C++ lexer fixes bug with #include statements without " or > terminating filename. Bug #1538.
  • C++ lexer fixes split of Doxygen keywords @code{.fileExtension} and @param[in,out]. Bug #1551.
  • C++ lexer styles Doxygen keywords at end of document.
  • Cmake lexer fixes bug with empty comments. Bug #1550.
  • Fortran folder improved. Treats "else" as fold header. Feature #962.
  • Fix bug with adjacent instances of the same indicator with different values where only the first was drawn. Bug #1560.
  • For DirectWrite, use the GDI ClearType gamma value for SC_EFF_QUALITY_LCD_OPTIMIZED as this results in text that is similar in colour intensity to GDI. For the duller default DirectWrite ClearType text appearance, use SC_EFF_QUALITY_DEFAULT. Feature #887.
  • Fix another problem with drawing on Windows with Direct2D when returning from lock screen. The whole window is redrawn as just redrawing the initially required area left other areas black.
  • When scroll width is tracked, take width of annotation lines into account.
  • For Cocoa on OS X 10.9, responsive scrolling is supported.
  • On Cocoa, apply font quality setting to line numbers. Bug #1544.
  • On Cocoa, clicking in margin now sets focus. Bug #1542.
  • On Cocoa, correct cursor displayed in margin after showing dialog.
  • On Cocoa, multipaste mode now works. Bug #1541.
  • On GTK+, chain up to superclass finalize so that all finalization is performed. Bug #1549.
  • On GTK+, fix horizontal scroll bar range to not be double the needed width. Bug #1546.
  • On OS X GTK+, report control key as SCI_META for mouse down events.
  • On Qt, bug fixed with drawing of scrollbars, where previous contents were not drawn over with some themes.
  • On Qt, bug fixed with finding monitor rectangle which could lead to autocomplete showing at wrong location.
  • SciTE fix for multiple message boxes when failing to save a file with save.on.deactivate. Bug #1540.
  • SciTE on GTK+ fixes SIGCHLD handling so that Lua scripts can determine the exit status of processes they start. Bug #1557.
  • SciTE on Windows XP fixes bad display of find and replace values when using strips.

Release 3.3.6

  • Released 15 October 2013.
  • Added functions to help convert between substyles and base styles and between secondary and primary styles. SCI_GETSTYLEFROMSUBSTYLE finds the base style of substyles. Can be used to treat all substyles of a style equivalent to that style. SCI_GETPRIMARYSTYLEFROMSTYLE finds the primary style of secondary styles. StyleFromSubStyle and PrimaryStyleFromStyle methods were added to ILexerWithSubStyles so each lexer can implement these.
  • Lexer added for Rust language. Feature #1024.
  • Avoid false matches in errorlist lexer which is used for the SciTE output pane by stricter checking of ctags lines.
  • Perl lexer fixes bugs with multi-byte characters, including in HEREDOCs and PODs. Bug #1528.
  • SQL folder folds 'create view' statements. Feature #1020.
  • Visual Prolog lexer updated with better support for string literals and Unicode. Feature #1025.
  • For SCI_SETIDENTIFIERS, \t, \r, and \n are allowed as well as space between identifiers. Bug #1521.
  • Gaining and losing focus is now reported as a notification with the code set to SCN_FOCUSIN or SCN_FOCUSOUT. This allows clients to uniformly use notifications instead of commands. Since there is no longer a need for commands they will be deprecated in a future version. Clients should switch any code that currently uses SCEN_SETFOCUS or SCEN_KILLFOCUS.
  • On Cocoa, clients should use the delegate mechanism or subclass ScintillaView in preference to registerNotifyCallback: which will be deprecated in the future.
  • On Cocoa, the ScintillaView.h header hides internal implementation details from Platform.h and ScintillaCocoa.h. InnerView was renamed to SCIContentView and MarginView was renamed to SCIMarginView. dealloc removed from @interface.
  • On Cocoa, clients may customize SCIContentView by subclassing both SCIContentView and ScintillaView and implementing the contentViewClass class method on the ScintillaView subclass to return the class of the SCIContentView subclass.
  • On Cocoa, fixed appearance of alpha rectangles to use specified alpha and colour for outline as well as corner size. This makes INDIC_STRAIGHTBOX and INDIC_ROUNDBOX look correct.
  • On Cocoa, memory leak fixed for MarginView.
  • On Cocoa, make drag and drop work when destination view is empty. Bug #1534.
  • On Cocoa, drag image fixed when view scrolled.
  • On Cocoa, SCI_POSITIONFROMPOINTCLOSE fixed when view scrolled. Feature #1021.
  • On Cocoa, don't send selection change notification when scrolling. Bug #1522.
  • On Qt, turn off idle events on destruction to prevent repeatedly calling idle.
  • Qt bindings in ScintillaEdit changed to use signed first parameter.
  • Compilation errors fixed on Windows and GTK+ with SCI_NAMESPACE.
  • On Windows, building with gcc will check if Direct2D headers are available and enable Direct2D if they are.
  • Avoid attempts to redraw empty areas when lexing beyond the currently visible lines.
  • Control more attributes of indicators in SciTE with find.mark.indicator and highlight.current.word.indicator properties.
  • Fix SciTE bug with buffers becoming read-only. Bug #1525.
  • Fix linking SciTE on non-Linux Unix systems with GNU toolchain by linking to libdl. Bug #1523.
  • On Windows, SciTE's Incremental Search displays match failures by changing the background colour instead of not adding the character that caused failure.
  • Fix SciTE on GTK+ 3.x incremental search to change foreground colour when no match as changing background colour is difficult.

Release 3.3.5

  • Released 31 August 2013.
  • Characters may be represented by strings. In Unicode mode C1 control characters are represented by their mnemonics.
  • Added SCI_POSITIONRELATIVE to optimize navigation by character.
  • Option to allow mouse selection to switch to rectangular by pressing Alt after start of gesture. Feature #1007.
  • Lexer added for KVIrc script. Feature #1008.
  • Bash lexer fixed quoted HereDoc delimiters. Bug #1500.
  • MS SQL lexer fixed ';' to appear as an operator. Bug #1509.
  • Structured Text lexer fixed styling of enumeration members. Bug #1508.
  • Fixed bug with horizontal caret position when margin changed. Bug #1512.
  • Fixed bug on Cocoa where coordinates were relative to text subview instead of whole view.
  • Ensure selection redrawn correctly in two cases. When switching from stream to rectangular selection with Alt+Shift+Up. When reducing the range of an additional selection by moving mouse up. Feature #1007.
  • Copy and paste of rectangular selections compatible with Borland Delphi IDE on Windows. Feature #1002. Bug #1513.
  • Initialize extended styles to the default style.
  • On Windows, fix painting on an explicit HDC when first paint attempt abandoned.
  • Qt bindings in ScintillaEdit made to work on 64-bit Unix systems.
  • Easier access to printing on Qt with formatRange method.
  • Fixed SciTE failure to save initial buffer in single buffer mode. Bug #1339.
  • Fixed compilation problem with Visual C++ in non-English locales. Bug #1506.
  • Disable Direct2D when compiling with MinGW gcc on Windows because of changes in the recent MinGW release.
  • SciTE crash fixed for negative line.margin.width. Bug #1504.
  • SciTE fix for infinite dialog boxes when failing to automatically save a file. Bug #1503.
  • SciTE settings buffered.draw, two.phase.draw, and technology are applied to the output pane as well as the edit pane.

Release 3.3.4

  • Released 19 July 2013.
  • Handling of UTF-8 and DBCS text in lexers improved with methods ForwardBytes and GetRelativeCharacter added to StyleContext. Bug #1483.
  • For Unicode text, case-insensitive searching and making text upper or lower case is now compliant with Unicode standards on all platforms and is much faster for non-ASCII characters.
  • A CategoriseCharacter function was added to return the Unicode general category of a character which can be useful in lexers.
  • On Cocoa, the LCD Optimized font quality level turns font smoothing on.
  • SciTE 'immediate' subsystem added to allow scripts that work while tools are executed.
  • Font quality exposed in SciTE as font.quality setting.
  • On Cocoa, message:... methods simplify direct access to Scintilla and avoid call layers..
  • A68K lexer updated.
  • CoffeeScript lexer fixes a bug with comment blocks. Bug #1495
  • ECL lexer regular expression code fixed. Bug #1491.
  • errorlist lexer only recognizes Perl diagnostics when there is a filename between "at" and "line". Had been triggering for MSVC errors containing "at line".
  • Haskell lexer fixed to avoid unnecessary full redraws. Don't highlight CPP inside comments when styling.within.preprocessor is on. Bug #1459.
  • Lua lexer fixes bug in labels with UTF-8 text. Bug #1483.
  • Perl lexer fixes bug in string interpolation with UTF-8 text. Bug #1483.
  • Fixed bugs with case conversion when the result was longer or shorter than the original text. Could access past end of string potentially crashing. Selection now updated to result length.
  • Fixed bug where data being inserted and removed was not being reported in notification messages. Bug was introduced in 3.3.2.
  • Word wrap bug fixed where the last line could be shown twice.
  • Word wrap bug fixed for lines wrapping too short on Windows and GTK+.
  • Word wrap performance improved.
  • Minor memory leak fixed. Bug #1487.
  • On Cocoa, fixed insertText: method which was broken when implementing a newer protocol.
  • On Cocoa, fixed a crash when performing string folding for bytes that do not represent a character in the current encoding.
  • On Qt, fixed layout problem when QApplication construction delayed.
  • On Qt, find_text reports failure with -1 as first element of return value.
  • Fixed SciTE on GTK+ bug where a tool command could be performed using the keyboard while one was already running leading to confusion and crashes. Bug #1486.
  • Fixed SciTE bug in Copy as RTF which was limited to first 32 styles. Bug #1011.
  • Fixed SciTE on Windows user strip height when the system text scaling factor is 125% or 150%.
  • Compile time checks for Digital Mars C++ removed.
  • Visual C++ 2013 supported. Bug #1492.
  • Python scripts used for building and maintenance improved and moved into scripts directory.
  • Testing scripts now work on Linux using Qt and PySide.
  • Tk platform defined. Implementation for Tk will be available separately from main Scintilla distribution.

Release 3.3.3

  • Released 2 June 2013.
  • Lexer and folder added for Structured Text language. Feature #959.
  • Out of bounds access fixed for GTK+. Bug #1480.
  • Crash fixed for GTK+ on Windows paste.
  • Bug fixed with incorrect event copying on GTK+ 3.x. Bug #1481.
  • Bug fixed with right to left locales, like Hebrew, on GTK+. Bug #1477.
  • Bug fixed with undo grouping of tab and backtab commands. Bug #1478.

Release 3.3.2

  • Released 22 May 2013.
  • Basic implementations of common folding methods added to Scintilla to make it easier for containers to implement folding.
  • Add indicator INDIC_COMPOSITIONTHICK, a thick low underline, to mimic an appearance used for Asian language input composition.
  • On Cocoa, implement font quality setting. Feature #988.
  • On Cocoa, implement automatic enabling of commands and added clear command. Feature #987.
  • C++ lexer adds style for preprocessor doc comment. Feature #990.
  • Haskell lexer and folder improved. Separate mode for literate Haskell "literatehaskell" SCLEX_LITERATEHASKELL. Bug #1459 .
  • LaTeX lexer bug fixed for Unicode character following '\'. Bug #1468 .
  • PowerShell lexer recognizes here strings and doccomment keywords. #region folding added. Feature #985.
  • Fix multi-typing when two carets are located in virtual space on one line so that spaces are preserved.
  • Fixes to input composition on Cocoa and implementation of accented character input through press and hold. Set selection correctly so that changes to pieces of composition text are easier to perform. Restore undo collection after a sequence of composition actions. Composition popups appear near input.
  • Fix lexer problem where no line end was seen at end of document.
  • Fix crash on Cocoa when view deallocated. Bug #1466.
  • Fix Qt window positioning to not assume the top right of a monitor is at 0, 0.
  • Fix Qt to not track mouse when widget is hidden.
  • Qt now supports Qt 5.0. Bug #1448.
  • Fix drawing on Windows with Direct2D when returning from lock screen. The render target had to be recreated and an area would be black since the drawing was not retried.
  • Fix display of DBCS documents on Windows Direct2D/DirectWrite with default character set.
  • For SciTE on Windows, fixed most-recently-used menu when files opened through check.if.already.opened.
  • In SciTE, do not call OnSave twice when files saved asynchronously.
  • Scintilla no longer builds with Visual C++ 6.0.

Release 3.3.1

  • Released 11 April 2013.
  • Autocompletion lists can now appear in priority order or be sorted by Scintilla. Feature #981.
  • Most lexers now lex an extra NUL byte at the end of the document which makes it more likely they will classify keywords at document end correctly. Bug #574, Bug #588.
  • Haskell lexer improved in several ways. Bug #1459.
  • Matlab/Octave lexer recognizes block comments and ... comments. Bug #1414.
  • Ruby lexer crash fixed with keyword at start of document.
  • The PLAT_NCURSES platform now called PLAT_CURSES as may work on other implementations.
  • Bug on Cocoa fixed where input composition with multiple selection or virtual space selection could make undo stop working.
  • Direct2D/DirectWrite mode on Windows now displays documents in non-Latin1 8-bit encodings correctly.
  • Character positioning corrected in Direct2D/DirectWrite mode on Windows to avoid text moving and cutting off lower parts of characters.
  • Position of calltip and autocompletion lists fixed on Cocoa.
  • While regular expression search in DBCS text is still not working, matching partial characters is now avoided by moving end of match to end of character.

Release 3.3.0

  • Released 30 March 2013.
  • Overlay scrollers and kinetic scrolling implemented on Cocoa.
  • To improve display smoothness, styling and UI Update notifications will, when possible, be performed in a high-priority idle task on Cocoa instead of during painting. Performing these jobs inside painting can cause paints to be abandoned and a new paint scheduled. On GTK+, the high-priority idle task is used in more cases.
  • SCI_SCROLLRANGE added to scroll the view to display a range of text. If the whole range can not be displayed, priority is given to one end.
  • C++ lexer no longer recognizes raw (R"") strings when the first character after " is invalid. Bug #1454.
  • HTML lexer recognizes JavaScript RegEx literals in more contexts. Bug #1412.
  • Fixed automatic display of folded text when return pressed at end of fold header and first folded line was blank. Bug #1455.
  • SCI_VISIBLEFROMDOCLINE fixed to never return a line beyond the document end.
  • SCI_LINESCROLL fixed for a negative column offset. Bug #1450.
  • On GTK+, fix tab markers so visible if indent markers are visible. Bug #1453.

Release 3.2.5

  • Released 26 February 2013.
  • To allow cooperation between different uses of extended (beyond 255) styles they should be allocated using SCI_ALLOCATEEXTENDEDSTYLES.
  • For Unicode documents, lexers that use StyleContext will retrieve whole characters instead of bytes. LexAccessor provides a LineEnd method which can be a more efficient way to handle line ends and can enable Unicode line ends.
  • The C++ lexer understands the #undef directive when determining preprocessor definitions. Feature #978.
  • The errorlist lexer recognizes gcc include path diagnostics that appear before an error.
  • Folding implemented for GetText (PO) translation language. Bug #1437.
  • HTML lexer does not interrupt comment style for processing instructions. Bug #1447.
  • Fix SciTE forgetting caret x-position when switching documents. Bug #1442.
  • Fixed bug where vertical scrollbar thumb appeared at beginning of document when scrollbar shown. Bug #1446.
  • Fixed brace-highlighting bug on OS X 10.8 where matching brace is on a different line.
  • Provisional features are new features that may change or be removed if they cause problems but should become permanent if they work well. For this release Unicode line ends and substyles are provisional features.

Release 3.2.4

  • Released 17 January 2013.
  • Caret line highlight can optionally remain visible when window does not have focus. Feature #964.
  • Delegate mechanism for notifications added on Cocoa.
  • NUL characters in selection are copied to clipboard as spaces to avoid truncating at the NUL. Bug #1289.
  • C++ lexer fixes problem with showing inactive sections when preprocessor lines contain trailing comment. Bug #1413.
  • C++ lexer fixes problem with JavaScript regular expressions with '/' in character ranges. Bug #1415.
  • LaTeX folder added. Feature #970.
  • LaTeX lexer improves styling of math environments. Feature #970.
  • MySQL lexer implements hidden commands.
  • Only produce a single undo step when autocompleting a single word. Bug #1421.
  • Fixed crash when printing lines longer than 8000 characters. Bug #1430.
  • Fixed problem in character movement extends selection mode where reversing direction collapsed the selection.
  • Memory issues fixed on Cocoa, involving object ownership, lifetime of timers, and images held by the info bar. Bug #1436.
  • Cocoa key binding for Alt+Delete changed to delete previous word to be more compatible with platform standards.
  • Fixed crash on Cocoa with scrollbar when there is no scrolling possible. Bug #1416.
  • On Cocoa with retina display fixed positioning of autocompletion lists.
  • Fixed SciTE on Windows failure to run a batch file with a name containing a space by quoting the path in the properties file. Bug #1423.
  • Fixed scaling bug when printing on GTK+. Bug #1427.
  • SciTE on GTK toolbar.detachable feature removed.
  • Fixed some background saving bugs in SciTE. Bug #1366. Bug #1339.

Release 3.2.3

  • Released 21 October 2012.
  • Improve speed when performing multiple searches.
  • SciTE adds definition of PLAT_UNIX for both PLAT_GTK and PLAT_MAC to allow consolidation of settings valid on all Unix variants.
  • Signal autoCompleteCancelled added on Qt.
  • Bash lexer supports nested delimiter pairs. Feature #3569352. Bug #1515556. Bug #3008483. Bug #3512208. Bug #3515392.
  • For C/C++, recognize exponent in floating point hexadecimal literals. Bug #3576454.
  • For C #include statements, do not treat // in the path as a comment. Bug #3519260.
  • Lexer for GetText translations (PO) improved with additional styles and single instance limitation fixed.
  • Ruby for loop folding fixed. Bug #3240902. Bug #3567391.
  • Ruby recognition of here-doc after class or instance variable fixed. Bug #3567809.
  • SQL folding of loop and case fixed. Bug #3567905.
  • SQL folding of case with assignment fixed. Bug #3571820.
  • Fix hang when removing all characters from indicator at end of document.
  • Fix failure of \xhh in regular expression search for values greater than 0x79.
  • On Cocoa on OS X 10.8, fix inverted drawing of find indicator.
  • On Cocoa, fix double drawing when horizontal scroll range small and user swipes horizontally.
  • On Cocoa, remove incorrect setting of save point when reading information through 'string' and 'selectedString'.
  • On Cocoa, fix incorrect memory management of infoBar.
  • On GTK+ 3 Ubuntu, fix crash when drawing margin.
  • On ncurses, fix excessive spacing with italics line end.
  • On Windows, search for D2D1.DLL and DWRITE.DLL in system directory to avoid loading from earlier in path where could be planted by malware.

Release 3.2.2

  • Released 31 August 2012.
  • Retina display support for Cocoa. Text size fixed. Scale factor for images implemented so they can be displayed in high definition.
  • Implement INDIC_SQUIGGLEPIXMAP as a faster version of INDIC_SQUIGGLE. Avoid poor drawing at right of INDIC_SQUIGGLE. Align INDIC_DOTBOX to pixel grid for full intensity.
  • Implement SCI_GETSELECTIONEMPTY API. Bug #3543121.
  • Added SCI_VCHOMEDISPLAY and SCI_VCHOMEDISPLAYEXTEND key commands. Feature #3561433.
  • Allow specifying SciTE Find in Files directory with find.in.directory property. Feature #3558594.
  • Override SciTE global strip.trailing.spaces with strip.trailing.spaces by pattern files. Feature #3556320.
  • Fix long XML script tag handling in XML lexer. Bug #3534190.
  • Fix rectangular selection range after backspace. Bug #3543097.
  • Send SCN_UPDATEUI with SC_UPDATE_SELECTION for backspace in virtual space. Bug #3543121.
  • Avoid problems when calltip highlight range is negative. Bug #3545938.
  • On Cocoa, fix image drawing code so that image is not accessed after being freed and is drawn in the correct location.
  • On Cocoa, limit horizontal touch scrolling to existing established width.
  • On Cocoa, decrease sensitivity of pinch-zoom.
  • Fix Cocoa drawing where style changes were not immediately visible.
  • Fix Cocoa memory leak due to reference cycle.
  • Fix Cocoa bug where notifications were sent after Scintilla was freed.
  • SciTE on OS X user shortcuts treats "Ctrl+D" as equivalent to "Ctrl+d".
  • On Windows, saving SciTE's Lua startup script causes it to run.
  • Limit time allowed to highlight current word in SciTE to 0.25 seconds to remain responsive.
  • Fixed SciTE read-only mode to stick with buffer.
  • For SciTE on Windows, enable Ctrl+Z, Ctrl+X, and Ctrl+C (Undo, Cut, and Copy) in the editable fields of find and replace strips
  • Remove limit on logical line length in SciTE .properties files. Bug #3544312.
  • Improve performance of SciTE Save As command.
  • Fix SciTE crash with empty .properties files. Bug #3545938. Bug #3555308.
  • Fix repeated letter in SciTE calltips. Bug #3545938.
  • Refine build time checking for Direct2D and DirectWrite.
  • Avoid potential build problems on Windows with MultiMon.h by explicitly checking for multi-monitor APIs.
  • Automatically disable themed drawing in SciTE when building on Windows 2000. Reenable building for Windows NT 4 on NT 4 .
  • Added ncurses platform definitions. Implementation is maintained separately as Scinterm.

Release 3.2.1

  • Released 14 July 2012.
  • In Scintilla.iface, specify features as properties instead of functions where possible and fix some enumerations.
  • In SciTE Lua scripts, string properties in Scintilla API can be retrieved as well as set using property notation.
  • Added character class APIs: SCI_SETPUNCTUATIONCHARS, SCI_GETWORDCHARS, SCI_GETWHITESPACECHARS, and SCI_GETPUNCTUATIONCHARS. Feature #3529805.
  • Less/Hss support added to CSS lexer. Feature #3532413.
  • C++ lexer style SCE_C_PREPROCESSORCOMMENT added for stream comments in preprocessor. Bug #3487406.
  • Fix incorrect styling of inactive code in C++ lexer. Bug #3533036.
  • Fix incorrect styling by C++ lexer after empty lines in preprocessor style.
  • C++ lexer option "lexer.cpp.allow.dollars" fixed so can be turned off after being on. Bug #3541461.
  • Fortran fixed format lexer fixed to style comments from column 73. Bug #3540486.
  • Fortran folder folds CRITICAL .. END CRITICAL. Bug #3540486.
  • Fortran lexer fixes styling after comment line ending with '&'. Bug #3087226.
  • Fortran lexer styles preprocessor lines so they do not trigger incorrect folding. Bug #2906275.
  • Fortran folder fixes folding of nested ifs. Bug #2809176.
  • HTML folder fixes folding of CDATA when fold.html.preprocessor=0. Bug #3540491.
  • On Cocoa, fix autocompletion font lifetime issue and row height computation.
  • In 'choose single' mode, autocompletion will close an existing list if asked to display a single entry list.
  • Fixed SCI_MARKERDELETE to only delete one marker per call. Bug #3535806.
  • Properly position caret after undoing coalesced delete operations. Bug #3523326.
  • Ensure margin is redrawn when SCI_MARGINSETSTYLE called.
  • Fix clicks in first pixel of margins to send SCN_MARGINCLICK.
  • Fix infinite loop when drawing block caret for a zero width space character at document start.
  • Crash fixed for deleting negative range.
  • For characters that overlap the beginning of their space such as italics descenders and bold serifs, allow start of text to draw 1 pixel into margin. Bug #699587. Bug #3537799.
  • Fixed problems compiling Scintilla for Qt with GCC 4.7.1 x64.
  • Fixed problem with determining GTK+ sub-platform caused when adding Qt support in 3.2.0.
  • Fix incorrect measurement of untitled file in SciTE on Linux leading to message "File ...' is 2147483647 bytes long". Bug #3537764.
  • In SciTE, fix open of selected filename with line number to go to that line.
  • Fix problem with last visible buffer closing in SciTE causing invisible buffers to be active.
  • Avoid blinking of SciTE's current word highlight when output pane changes.
  • SciTE properties files can be longer than 60K.

Release 3.2.0

  • Released 1 June 2012.
  • Platform layer added for the Qt open-source cross-platform application and user interface framework for development in C++ or in Python with the PySide bindings for Qt.
  • Direct access provided to the document bytes for ranges within Scintilla. This is similar to the existing SCI_GETCHARACTERPOINTER API but allows for better performance.
  • Ctrl+Double Click and Ctrl+Triple Click add the word or line to the set of selections. Feature #3520037.
  • A SCI_DELETERANGE API was added for deleting a range of text.
  • Line wrap markers may now be drawn in the line number margin. Feature #3518198.
  • SciTE on OS X adds option to hide hidden files in the open dialog box.
  • Lexer added for OScript language. Feature #3523197.
  • Lexer added for Visual Prolog language. Feature #3523018.
  • UTF-8 validity is checked more stringently and consistently. All 66 non-characters are now treated as invalid.
  • HTML lexer bug fixed with inconsistent highlighting for PHP when attribute on separate line from tag. Bug #3520027.
  • HTML lexer bug fixed for JavaScript block comments. Bug #3520032.
  • Annotation drawing bug fixed when box displayed with different colours on different lines. Bug #3519872.
  • On Windows with Direct2D, fix drawing with 125% and 150% DPI system settings.
  • Virtual space selection bug fixed for rectangular selections. Bug #3519246.
  • Replacing multiple selection with newline changed to only affect main selection. Bug #3522251.
  • Replacing selection with newline changed to group deletion and insertion as a single undo action. Bug #3522250.
  • Auto-completion lists on GTK+ 3 set height correctly instead of showing too few lines.
  • Mouse wheel scrolling changed to avoid GTK+ bug in recent distributions.
  • IME bug on Windows fixed for horizontal jump. Bug #3529728.
  • SciTE case-insensitive autocompletion filters equal identifiers better. Calltip arrows work with bare word identifiers. Bug #3517810.
  • SciTE bug fixed where shbang lines not setting file type when switching to file loaded in background.
  • SciTE on GTK+ shows open and save dialogs with the directory of the current file displayed.

Release 3.1.0

  • Released 20 April 2012.
  • Animated find indicator added on Cocoa.
  • Buttons can be made default in SciTE user strips.
  • SciTE allows find and replace histories to be saved in session.
  • Option added to allow case-insensitive selection in auto-completion lists. Bug #3516538.
  • Replace \0 by complete found text in regular expressions. Feature #3510979.
  • Fixed single quoted strings in bash lexer. Bug #3512208.
  • Incorrect highlighting fixed in C++ lexer for continued lines. Bug #3509317.
  • Hang fixed in diff lexer. Bug #3508602.
  • Folding improved for SQL CASE/MERGE statement. Bug #3503277.
  • Fix extra drawing of selection inside word wrap indentation. Bug #3515555.
  • Fix problem with determining the last line that needs styling when drawing. Bug #3514882.
  • Fix problems with drawing in margins. Bug #3514882.
  • Fix printing crash when using Direct2D to display on-screen. Bug #3513946.
  • Fix SciTE bug where background.*.size disabled restoration of bookmarks and positions from session. Bug #3514885.
  • Fixed the Move Selected Lines command when last line does not end with a line end character. Bug #3511023.
  • Fix word wrap indentation printing to use printer settings instead of screen settings. Bug #3512961.
  • Fix SciTE bug where executing an empty command prevented executing further commands Bug #3512976.
  • Fix SciTE bugs with focus in user strips and made strips more robust with invalid definitions.
  • Suppress SciTE regular expression option when searching with find next selection. Bug #3510985.
  • SciTE Find in Files command matches empty pattern to all files. Feature #3495918.
  • Fix scroll with mouse wheel on GTK+. Bug #3501321.
  • Fix column finding method so that tab is counted correctly. Bug #3483713.

Release 3.0.4

  • Released 8 March 2012.
  • SciTE scripts can create user interfaces as strips.
  • SciTE can save files automatically in the background.
  • Pinch zoom implemented on Cocoa.
  • ECL lexer added. Feature #3488209.
  • CPP lexer fixes styling after document comment keywords. Bug #3495445.
  • Pascal folder improves handling of some constructs. Feature #3486385.
  • XML lexer avoids entering a bad mode due to complex preprocessor instructions. Bug #3488060.
  • Duplicate command is always remembered as a distinct command for undo. Bug #3495836.
  • SciTE xml.auto.close.tags no longer closes with PHP code similar to <a $this-> Bug #3488067.
  • Fix bug where setting an indicator for the whole document would fail. Bug #3487440.
  • Crash fixed for SCI_MOVESELECTEDLINESDOWN with empty vertical selection. Bug #3496403.
  • Differences between buffered and unbuffered mode on Direct2D eliminated. Bug #3495791.
  • Font leading implemented for Direct2D to improve display of character blobs. Bug #3494744.
  • Fractional widths used for line numbers, character markers and other situations. Bug #3494492.
  • Translucent rectangles drawn using Direct2D with sharper corners. Bug #3494492.
  • RGBA markers drawn sharper when centred using Direct2D. Bug #3494202.
  • RGBA markers are drawn centred when taller than line. Bug #3494184.
  • Image marker drawing problem fixed for markers taller than line. Bug #3493503.
  • Markers are drawn horizontally off-centre based on margin type instead of dimensions. Bug #3488696.
  • Fold tail markers drawn vertically centred. Feature #3488289.
  • On Windows, Scintilla is more responsive in wrap mode. Bug #3487397.
  • Unimportant "Gdk-CRITICAL" messages are no longer displayed. Bug #3488481.
  • SciTE on Windows Find in Files sets focus to dialog when already created; allows opening dialog when a job is running. Bug #3480635. Bug #3486657.
  • Fixed problems with multiple clicks in margin and with mouse actions combined with virtual space. Bug #3484370.
  • Fixed bug with using page up and down and not returning to original line. Bug #3485669.
  • Down arrow with wrapped text no longer skips lines. Bug #1776560.
  • Fix problem with dwell ending immediately due to word wrap. Bug #3484416.
  • Wrapped lines are rewrapped more consistently while resizing window. Bug #3484179.
  • Selected line ends are highlighted more consistently. Bug #3484330.
  • Fix grey background on files that use shbang to choose language. Bug #3482777.
  • Fix failure messages from empty commands in SciTE. Bug #3480645.
  • Redrawing reduced for some marker calls. Feature #3493530.
  • Match brace and select brace commands work in SciTE output pane. Feature #3486598.
  • Performing SciTE "Show Calltip" command when a calltip is already visible shows the next calltip. Feature #3487017.
  • SciTE allows saving file even when file unchanged. Feature #3486654.
  • SciTE allows optional use of character escapes in calltips. Feature #3495239.
  • SciTE can open file:// URLs with Ctrl+Shift+O. Feature #3495389.
  • Key modifiers updated for GTK+ on OS X to match upstream changes.
  • SciTE hang when marking all occurrences of regular expressions fixed.

Release 3.0.3

  • Released 28 January 2012.
  • Printing works on GTK+ version 2.x as well as 3.x.
  • Lexer added for the AviSynth language. Feature #3475611.
  • Lexer added for the Take Command / TCC scripting language. Feature #3462462.
  • CSS lexer gains support for SCSS. Feature #3268017.
  • CPP lexer fixes problems in the preprocessor structure caused by continuation lines. Bug #3458508.
  • Errorlist lexer handles column numbers for GCC format diagnostics. In SciTE, Next Message goes to column where this can be decoded from GCC format diagnostics. Feature #3453075.
  • HTML folder fixes spurious folds on some tags. Bug #3459262.
  • Ruby lexer fixes bug where '=' at start of file caused whole file to appear as a comment. Bug #3452488.
  • SQL folder folds blocks of single line comments. Feature #3467425.
  • On Windows using Direct2D, defer invalidation of render target until completion of painting to avoid failures.
  • Further support of fractional positioning. Spaces, tabs, and single character tokens can take fractional space and wrapped lines are positioned taking fractional positions into account. Bug #3471998.
  • On Windows using Direct2D, fix extra carets appearing. Bug #3471998.
  • For autocompletion lists Page Up and Down move by the list height instead of by 5 lines. Bug #3455493.
  • For SCI_LINESCROLLDOWN/UP don't select into virtual space. Bug #3451681.
  • Fix fold highlight not being fully drawn. Bug #3469936.
  • Fix selection margin appearing black when starting in wrap mode.
  • Fix crash when changing end of document after adding an annotation. Bug #3476637.
  • Fix problems with building to make RPMs. Bug #3476149.
  • Fix problem with building on GTK+ where recent distributions could not find gmodule. Bug #3469056.
  • Fix problem with installing SciTE on GTK+ due to icon definition in .desktop file including an extension. Bug #3476117.
  • Fix SciTE bug where new buffers inherited some properties from previously opened file. Bug #3457060.
  • Fix focus when closing tab in SciTE with middle click. Focus moves to edit pane instead of staying on tab bar. Bug #3440142.
  • For SciTE on Windows fix bug where Open Selected Filename for URL would append a file extension. Feature #3459185.
  • For SciTE on Windows fix key handling of control characters in Parameters dialog so normal editing (Ctrl+C, ...) works. Bug #3459345.
  • Fix SciTE bug where files became read-only after saving. Drop the "*" dirty marker after save completes. Bug #3467432.
  • For SciTE handling of diffs with "+++" and "---" lines, also handle case where not followed by tab. Go to correct line for diff "+++" message. Bug #3467143. Bug #3467178.
  • SciTE on GTK+ now performs threaded actions even on GTK+ versions before 2.12.

Release 3.0.2

  • Released 9 December 2011.
  • SciTE saves files in the background without blocking the user interface.
  • Printing implemented in SciTE on GTK+ 3.x.
  • ILoader interface for background loading finalized and documented.
  • CoffeeScript lexer added.
  • C++ lexer fixes crash with "#if defined( XXX 1".
  • Crash with Direct2D on Windows fixed.
  • Backspace removing protected range fixed. Bug #3445911.
  • Cursor setting failure on Windows when screen saver on fixed. Bug #3438780.
  • SciTE on GTK+ hang fixed with -open:file option. Bug #3441980.
  • Failure to evaluate shbang fixed in SciTE. Bug #3441801.
  • SciTE failure to treat files starting with "<?xml" as XML fixed. Bug #3440718.
  • Made untitled tab saveable when created by closing all files. Bug #3440244.
  • SciTE crash fixed when using Scintillua.
  • SciTE revert command fixed so that undo works on individual actions instead of undoing to revert point.
  • Focus loss in SciTE when opening a recent file fixed. Bug #3440142.
  • Fixed SciTE SelLength property to measure characters instead of bytes. Bug #3283519.

Release 3.0.1

  • Released 15 November 2011.
  • SciTE on Windows now runs Lua scripts directly on the main thread instead of starting them on a secondary thread and then moving back to the main thread.
  • Highlight "else" as a keyword for TCL in the same way as other languages. Bug #1836954.
  • Fix problems with setting fonts for autocompletion lists on Windows where font handles were copied and later deleted causing a system default font to be used.
  • Fix font size used on Windows for Asian language input methods which sometimes led to IME not being visible. Bug #3436753.
  • Fixed polygon drawing on Windows so fold symbols are visible again. Bug #3433558.
  • Changed background drawing on GTK+ to allow for fractional character positioning as occurs on OS X as this avoids faint lines at lexeme boundaries.
  • Ensure pixmaps allocated before painting as there was a crash when Scintilla drew without common initialization calls. Bug #3432354.
  • Fixed SciTE on Windows bug causing wrong caret position after indenting a selection. Bug #3433433.
  • Fixed SciTE session saving to store buffer position matching buffer. Bug #3434372.
  • Fixed leak of document objects in SciTE.
  • Recognize URL characters '?' and '%' for Open Selected command in SciTE. Bug #3429409.

Release 3.0.0

  • Released 1 November 2011.
  • Carbon platform support removed. OS X applications should switch to Cocoa.
  • On Windows Vista or newer, drawing may be performed with Direct2D and DirectWrite instead of GDI.
  • Cairo is now used for all drawing on GTK+. GDK drawing was removed.
  • Paletted display support removed.
  • Fractional font sizes can be specified.
  • Different weights of text supported on some platforms instead of just normal and bold.
  • Sub-pixel character positioning supported.
  • SciTE loads files in the background without blocking the user interface.
  • SciTE can display diagnostic messages interleaved with the text of files immediately after the line referred to by the diagnostic.
  • New API to see if all lines are visible which can be used to optimize processing fold structure notifications.
  • Scrolling optimized by avoiding invalidation of fold margin when redrawing whole window.
  • Optimized SCI_MARKERNEXT.
  • C++ lexer supports Pike hash quoted strings when turned on with lexer.cpp.hashquoted.strings.
  • Fixed incorrect line height with annotations in wrapped mode when there are multiple views. Bug #3388159.
  • Calltips may be displayed above the text as well as below. Bug #3410830.
  • For huge files SciTE only examines the first megabyte for newline discovery.
  • SciTE on GTK+ removes the fileselector.show.hidden property and check box as this was buggy and GTK+ now supports an equivalent feature. Bug #3413630.
  • SciTE on GTK+ supports mnemonics in dynamic menus.
  • SciTE on GTK+ displays the user's home directory as '~' in menus to make them shorter.

Release 2.29

  • Released 16 September 2011.
  • To automatically discover the encoding of a file when opening it, SciTE can run a program set with command.discover.properties. Feature #3324341.
  • Cairo always used for drawing on GTK+.
  • The set of properties files imported by SciTE can be controlled with the properties imports.include and imports.exclude. The import statement has been extended to allow "import *". The properties files for some languages are no longer automatically loaded by default. The properties files affected are avenue, baan, escript, lot, metapost, and mmixal.
  • C++ lexer fixed a bug with raw strings being recognized too easily. Bug #3388122.
  • LaTeX lexer improved with more states and fixes to most outstanding bugs. Bug #1493111. Bug #1856356. Bug #3081692.
  • Lua lexer updates for Lua 5.2 beta with goto labels and "\z" string escape. Feature #3386330.
  • Perl string styling highlights interpolated variables. Feature #3394258. Bug #3076629.
  • Perl lexer updated for Perl 5.14.0 with 0X and 0B numeric literal prefixes, break keyword and "+" supported in subroutine prototypes. Feature #3388802.
  • Perl bug fixed with CRLF line endings.
  • Markdown lexer fixed to not change state with "_" in middle of word. Bug #3398184.
  • Cocoa restores compatibility with OS X 10.5.
  • Mouse pointer changes over selection to an arrow near start when scrolled horizontally. Bug #3389055.
  • Indicators that finish at the end of the document no longer expand when text is appended. Bug #3378718.
  • SparseState merge fixed to check if other range is empty. Bug #3387053.
  • On Windows, autocompletion lists will scroll instead of document when mouse wheel spun. Feature #3403600.
  • SciTE performs more rapid polling for command completion so will return faster and report more accurate times.
  • SciTE resizes panes proportionally when switched between horizontal and vertical layout. Feature #3376784.
  • SciTE on GTK+ opens multiple files into a single instance more reliably. Bug #3363754.

Release 2.28

  • Released 1 August 2011.
  • GTK+ Cairo support works back to GTK+ version 2.8. Requires changing Scintilla source code to enable before GTK+ 2.22. Bug #3322351.
  • Translucent images in RGBA format can be used for margin markers and in autocompletion lists.
  • INDIC_DOTBOX added as a translucent dotted rectangular indicator.
  • Asian text input using IME works for GTK+ 3.x and GTK+ 2.x with Cairo.
  • On GTK+, IME works for Ctrl+Shift+U Unicode input in Scintilla. For SciTE, Ctrl+Shift+U is still Make Selection Uppercase.
  • Key bindings for GTK+ on OS X made compatible with Cocoa port and platform conventions.
  • Cocoa port supports different character encodings, improves scrolling performance and drag image appearance. The control ID is included in WM_COMMAND notifications. Text may be deleted by dragging to the trash. ScrollToStart and ScrollToEnd key commands added to simplify implementation of standard OS X Home and End behaviour.
  • SciTE on GTK+ uses a paned widget to contain the edit and output panes instead of custom code. This allows the divider to be moved easily on GTK+ 3 and its appearance follows GTK+ conventions more closely.
  • SciTE builds and installs on BSD. Bug #3324644.
  • Cobol supports fixed format comments. Bug #3014850.
  • Mako template language block syntax extended and ## comments recognized. Feature #3325178. Bug #3318818.
  • Folding of Mako template language within HTML fixed. Bug #3324563.
  • Python lexer has lexer.python.keywords2.no.sub.identifiers option to avoid highlighting second set of keywords following '.'. Bug #3325333.
  • Python folder fixes bug where fold would not extend to final line. Bug #3349157.
  • SciTE treats LPEG lexers the same as script lexers by setting all 8 style bits.
  • For Cocoa, crashes with unsupported font variants and memory leaks for colour objects fixed.
  • Shift-JIS lead byte ranges modified to match Windows.
  • Mouse pointer changes over selection to an arrow more consistently. Bug #3315756.
  • Bug fixed with annotations beyond end of document. Bug #3347268.
  • Incorrect drawing fixed for combination of background colour change and translucent selection. Bug #3377116.
  • Lexers initialized correctly when started at position other than start of line. Bug #3377148.
  • Fold highlight drawing fixed for some situations. Bug #3323015. Bug #3323805.
  • Case insensitive search fixed for cases where folded character uses fewer bytes than base character. Bug #3362038.
  • SciTE bookmark.alpha setting fixed. Bug #3373907.

Release 2.27

  • Released 20 June 2011.
  • On recent GTK+ 2.x versions when using Cairo, bug fixed where wrong colours were drawn.
  • SciTE on GTK+ slow performance in menu maintenance fixed. Bug #3315233.
  • Cocoa platform supports 64-bit builds and uses only non-deprecated APIs. Asian Input Method Editors are supported. Autocompletion lists and calltips implemented. Control identifier used in notifications.
  • On Cocoa, rectangular selection now uses Option/Alt key to be compatible with Apple Human Interface Guidelines and other applications. The Control key is reported with an SCMOD_META modifier bit.
  • API added for setting and retrieving the identifier number used in notifications.
  • SCI_SETEMPTYSELECTION added to set selection without scrolling or redrawing more than needed. Feature #3314877.
  • Added new indicators. INDIC_DASH and INDIC_DOTS are variants of underlines. INDIC_SQUIGGLELOW indicator added as shorter alternative to INDIC_SQUIGGLE for small fonts. Bug #3314591
  • Margin line selection can be changed to select display lines instead of document lines. Bug #3312763.
  • On Windows, SciTE can perform reverse searches by pressing Shift+Enter in the Find or Replace strips or dialogs.
  • Matlab lexer does not special case '\' in single quoted strings. Bug #948757 Bug #1755950 Bug #1888738 Bug #3316852.
  • Verilog lexer supports SystemVerilog folding and keywords.
  • Font leak fixed. Bug #3306156.
  • Automatic scrolling works for long wrapped lines. Bug #3312763.
  • Multiple typing works for cases where selections collapse together. Bug #3309906.
  • Fold expanded when needed in word wrap mode. Bug #3291579.
  • Bug fixed with edge drawn in wrong place on wrapped lines. Bug #3314807.
  • Bug fixed with unnecessary scrolling for SCI_GOTOLINE. Bug #3303406.
  • Bug fixed where extra step needed to undo SCI_CLEAR in virtual space. Bug #3159691.
  • Regular expression search fixed for \$ on last line of search range. Bug #3313746.
  • SciTE performance improved when switching to a tab with a very large file. Bug #3311421.
  • On Windows, SciTE advanced search remembers the "Search only in this style" setting. Bug #3313344.
  • On GTK+, SciTE opens help using "xdg-open" instead of "netscape" as "netscape" no longer commonly installed. Bug #3314377.
  • SciTE script lexers can use 256 styles.
  • SciTE word highlight works for words containing DBCS characters. Bug #3315173.
  • Compilation fixed for wxWidgets. Bug #3306156.

Release 2.26

  • Released 25 May 2011.
  • Folding margin symbols can be highlighted for the current folding block. Feature #3147069.
  • Selected lines can be moved up or down together. Feature #3304850.
  • SciTE can highlight all occurrences of the current word or selected text. Feature #3291636.
  • Experimental GTK+ 3.0 support: build with "make GTK3=1".
  • INDIC_STRAIGHTBOX added. Is similar to INDIC_ROUNDBOX but without rounded corners. Bug #3290435.
  • Can show brace matching and mismatching with indicators instead of text style. Translucency of outline can be altered for INDIC_ROUNDBOX and INDIC_STRAIGHTBOX. Feature #3290434.
  • SciTE can automatically indent python by examining previous line for scope-starting ':' with indent.python.colon.
  • Batch file lexer allows braces '(' or ')' inside variable names.
  • The cpp lexer only recognizes Vala triple quoted strings when lexer.cpp.triplequoted.strings property is set. Bug #3239234.
  • Make file lexer treats a variable with a nested variable like $(f$(qx)b) as one variable. Bug #3298223.
  • Folding bug fixed for JavaScript with nested PHP. Bug #3193530.
  • HTML lexer styles Django's {# #} comments. Bug #3013798.
  • HTML lexer styles JavaScript regular expression correctly for /abc/i.test('abc');. Bug #3209108.
  • Inno Setup Script lexer now works properly when it restarts from middle of [CODE] section. Bug #3283880. Bug #3129044.
  • Lua lexer updated for Lua 5.2 with hexadecimal floating-point numbers and '\*' whitespace escaping in strings. Feature #3243811.
  • Perl folding folds "here doc"s and adds options fold.perl.at.else and fold.perl.comment.explicit. Fold structure for Perl fixed. Feature #3112671. Bug #3265401.
  • Python lexer supports cpdef keyword for Cython. Bug #3279728.
  • SQL folding option lexer.sql.fold.at.else renamed to fold.sql.at.else. Bug #3271474.
  • SQL lexer no longer treats ';' as terminating a comment. Bug #3196071.
  • Text drawing and measurement segmented into smaller runs to avoid platform bugs. Bug #3277449. Bug #3165743.
  • SciTE on Windows adds temp.files.sync.load property to open dropped temporary files synchronously as they may be removed before they can be opened asynchronously. Bug #3072009.
  • Bug fixed with indentation guides ignoring first line in SC_IV_LOOKBOTH mode. Bug #3291317.
  • Bugs fixed in backward regex search. Bug #3292659.
  • Bugs with display of folding structure fixed for wrapped lines and where there is a fold header but no body. Bug #3291579. Bug #3265401.
  • SciTE on Windows cursor changes to an arrow now when over horizontal splitter near top of window. Bug #3286620.
  • Fixed default widget size problem on GTK+. Bug #3267892.
  • Fixed font size when using Cairo on GTK+. Bug #3272662.
  • Fixed primary selection and cursor issues on GTK+ when unrealized then realized. Bug #3256153.
  • Right click now cancels selection on GTK+ like on Windows. Bug #3235190.
  • SciTE on GTK+ implements z-order buffer switching like on Windows. Bug #3228384.
  • Improve selection position after SciTE Insert Abbreviation command when abbreviation expansion includes '|'.

Release 2.25

  • Released 21 March 2011.
  • SparseState class makes it easier to write lexers which have to remember complex state between lines.
  • Visual Studio project (.dsp) files removed. The make files should be used instead as described in the README.
  • Modula 3 lexer added along with SciTE support. Feature #3173374.
  • Asm, Basic, and D lexers add extra folding properties.
  • Raw string literals for C++0x supported in C++ lexer.
  • Triple-quoted strings used in Vala language supported in C++ lexer. Feature #3177601.
  • The errorlist lexer used in SciTE's output pane colours lines that start with '<' as diff deletions. Feature #3172878.
  • The Fortran lexer correctly folds type-bound procedures from Fortran 2003.
  • LPeg lexer support‎ improved in SciTE.
  • SciTE on Windows-64 fixes for menu localization and Lua scripts. Bug #3204502.
  • SciTE on Windows avoids locking folders when using the open or save dialogs. Bug #1795484.
  • Diff lexer fixes problem where diffs of diffs producing lines that start with "----". Bug #3197952.
  • Bug fixed when searching upwards in Chinese code page 936. Bug #3176271.
  • On Cocoa, translucent drawing performed as on other platforms instead of 2.5 times less translucent.
  • Performance issue and potential bug fixed on GTK+ with caret line for long lines.

Release 2.24

  • Released 3 February 2011.
  • Fixed memory leak in GTK+ Cairo code. Feature #3157655.
  • Insert Abbreviation dialog added to SciTE on GTK+.
  • SCN_UPDATEUI notifications received when window scrolled. An 'updated' bit mask indicates which types of update have occurred from SC_UPDATE_SELECTION, SC_UPDATE_CONTENT, SC_UPDATE_H_SCROLL or SC_UPDATE_V_SCROLL. Feature #3125977.
  • On Windows, to ensure reverse arrow cursor matches platform default, it is now generated by reflecting the platform arrow cursor. Feature #3143968.
  • Can choose mouse cursor used in margins. Feature #3161326.
  • On GTK+, SciTE sets a mime type of text/plain in its .desktop file so that it will appear in the shell context menu. Feature #3137126.
  • Bash folder handles here docs. Feature #3118223.
  • C++ folder adds fold.cpp.syntax.based, fold.cpp.comment.multiline, fold.cpp.explicit.start, fold.cpp.explicit.end, and fold.cpp.explicit.anywhere properties to allow more control over folding and choice of explicit fold markers.
  • C++ lexer fixed to always handle single quote strings continued past a line end. Bug #3150522.
  • Ruby folder handles here docs. Feature #3118224.
  • SQL lexer allows '.' to be part of words. Feature #3103129.
  • SQL folder handles case statements in more situations. Feature #3135027.
  • SQL folder adds fold points inside expressions based on bracket structure. Feature #3165488.
  • SQL folder drops fold.sql.exists property as 'exists' is handled automatically. Bug #3164194.
  • SciTE only forwards properties to lexers when they have been explicitly set so the defaults set by lexers are used rather than 0.
  • Mouse double click word selection chooses the word around the character under the mouse rather than the inter-character position under the mouse. This makes double clicking select what the user is pointing at and avoids selecting adjacent non-word characters. Bug #3111174.
  • Fixed mouse double click to always perform word select, not line select. Bug #3143635.
  • Right click cancels autocompletion. Bug #3144531.
  • Fixed multiPaste to work when additionalSelectionTyping off. Bug #3126221.
  • Fixed virtual space problems when text modified at caret. Bug #3154986.
  • Fixed memory leak in lexer object code. Bug #3133672.
  • Fixed SciTE on GTK+ search failure when using regular expression. Bug #3156217.
  • Avoid unnecessary full window redraw for SCI_GOTOPOS. Feature #3146650.
  • Avoid unnecessary redraw when indicator fill range makes no real change.

Release 2.23

  • Released 7 December 2010.
  • On GTK+ version 2.22 and later, drawing is performed with Cairo rather than GDK. This is in preparation for GTK+ 3.0 which will no longer support GDK drawing. The appearance of some elements will be different with Cairo as it is anti-aliased and uses sub-pixel positioning. Cairo may be turned on for GTK+ versions before 2.22 by defining USE_CAIRO although this has not been extensively tested.
  • New lexer a68k for Motorola 68000 assembler. Feature #3101598.
  • Borland C++ is no longer supported for building Scintilla or SciTE on Windows.
  • Performance improved when creating large rectangular selections.
  • PHP folder recognizes #region and #endregion comments. Feature #3101624.
  • SQL lexer has a lexer.sql.numbersign.comment option to turn off use of '#' comments as these are a non-standard feature only available in some implementations. Feature #3098071.
  • SQL folder recognizes case statements and understands the fold.at.else property. Bug #3104091. Bug #3107362.
  • SQL folder fixes bugs with end statements when fold.sql.only.begin=1. Bug #3104091.
  • SciTE on Windows bug fixed with multi-line tab bar not adjusting correctly when maximizing and demaximizing. Bug #3097517.
  • Crash fixed on GTK+ when Scintilla widget destroyed while it still has an outstanding style idle pending.
  • Bug fixed where searching backwards in DBCS text (code page 936 or similar) failed to find occurrences at the start of the line. Bug #3103936.
  • SciTE on Windows supports Unicode file names when executing help applications with winhelp and htmlhelp subsystems.

Release 2.22

  • Released 27 October 2010.
  • SciTE includes support for integrating with Scintillua which allows lexers to be implemented in Lua as a Parsing Expression Grammar (PEG).
  • Regular expressions allow use of '?' for non-greedy matches or to match 0 or 1 instances of an item.
  • SCI_CONTRACTEDFOLDNEXT added to allow rapid retrieval of folding state.
  • SCN_HOTSPOTRELEASECLICK notification added which is similar to SCN_HOTSPOTCLICK but occurs when the mouse is released. Feature #3082409.
  • Command added for centring current line in window. Feature #3064696.
  • SciTE performance improved by not examining document for line ends when switching buffers and not storing folds when folding turned off.
  • Bug fixed where scrolling to ensure the caret is visible did not take into account all pixels of the line. Bug #3081721.
  • Bug fixed for autocompletion list overlapping text when WS_EX_CLIENTEDGE used. Bug #3079778.
  • After autocompletion, the caret's X is updated. Bug #3079114.
  • On Windows, default to the system caret blink time. Feature #3079784.
  • PgUp/PgDn fixed to allow virtual space. Bug #3077452.
  • Crash fixed when AddMark and AddMarkSet called with negative argument. Bug #3075074.
  • Dwell notifications fixed so that they do not occur when the mouse is outside Scintilla. Bug #3073481.
  • Bash lexer bug fixed for here docs starting with <<-. Bug #3063822.
  • C++ lexer bug fixed for // comments that are continued onto a second line by a \. Bug #3066031.
  • C++ lexer fixes wrong highlighting for float literals containing +/-. Bug #3058924.
  • JavaScript lexer recognize regexes following return keyword.‎ Bug #3062287.
  • Ruby lexer handles % quoting better and treats range dots as operators in 1..2 and 1...2. Ruby folder handles "if" keyword used as a modifier even when it is separated from the modified statement by an escaped new line. Bug #2093767. Bug #3058496.
  • Bug fixed where upwards search failed with DBCS code pages. Bug #3065912.
  • SciTE has a default Lua startup script name distributed in SciTEGlobal.properties. No error message is displayed if this file does not exist.
  • SciTE on Windows tab control height is calculated better. Bug #2635702.
  • SciTE on Windows uses better themed check buttons in find and replace strips.
  • SciTE on Windows fixes bug with Find strip appearing along with Incremental Find strip.
  • SciTE setting find.close.on.find added to allow preventing the Find dialog from closing.
  • SciTE on Windows attempts to rerun commands that fail by prepending them with "cmd.exe /c". This allows commands built in to the command processor like "dir" to run.

Release 2.21

  • Released 1 September 2010.
  • Asian Double Byte Character Set (DBCS) support improved. Case insensitive search works and other operations are much faster. Bug #2999125, Bug #2774616, Bug #2991942, Bug #3005688.
  • Scintilla on GTK+ uses only non-deprecated APIs (for GTK+ 2.20) except for GdkFont and GdkFont use can be disabled with the preprocessor symbol DISABLE_GDK_FONT.
  • IDocument interface used by lexers adds BufferPointer and GetLineIndentation methods.
  • On Windows, clicking sets focus before processing the click or sending notifications.
  • Bug on OS X (macosx platform) fixed where drag/drop overwrote clipboard. Bug #3039732.
  • GTK+ drawing bug when the view was horizontally scrolled more than 32000 pixels fixed.
  • SciTE bug fixed with invoking Complete Symbol from output pane. Bug #3050957.
  • Bug fixed where it was not possible to disable folding. Bug #3040649.
  • Bug fixed with pressing Enter on a folded fold header line not opening the fold. Bug #3043419.
  • SciTE 'Match case' option in find and replace user interfaces changed to 'Case sensitive' to allow use of 'v' rather than 'c' as the mnemonic.
  • SciTE displays stack trace for Lua when error occurs.. Bug #3051397.
  • SciTE on Windows fixes bug where double clicking on error message left focus in output pane. Bug #1264835.
  • SciTE on Windows uses SetDllDirectory to avoid a security problem.
  • C++ lexer crash fixed with preprocessor expression that looked like division by 0. Bug #3056825.
  • Haskell lexer improved. Feature #3039490.
  • HTML lexing fixed around Django {% %} tags. Bug #3034853.
  • HTML JavaScript lexing fixed when line end escaped. Bug #3038381.
  • HTML lexer stores line state produced by a line on that line rather than on the next line.
  • Markdown lexer fixes infinite loop. Bug #3045386.
  • MySQL folding bugs with END statements fixed. Bug #3031742.
  • PowerShell lexer allows '_' as a word character. Feature #3042228.
  • SciTE on GTK+ abandons processing of subsequent commands if a command.go.needs command fails.
  • When SciTE is closed, all buffers now receive an OnClose call. Bug #3033857.

Release 2.20

  • Released 30 July 2010.
  • Lexers are implemented as objects so that they may retain extra state. The interfaces defined for this are tentative and may change before the next release. Compatibility classes allow current lexers compiled into Scintilla to run with few changes. The interface to external lexers has changed and existing external lexers will need to have changes made and be recompiled. A single lexer object is attached to a document whereas previously lexers were attached to views which could lead to different lexers being used for split views with confusing results.
  • C++ lexer understands the preprocessor enough to grey-out inactive code due to conditional compilation.
  • SciTE can use strips within the main window for find and replace rather than dialogs. On Windows SciTE always uses a strip for incremental search.
  • Lexer added for Txt2Tags language. Feature #3018736.
  • Sticky caret feature enhanced with additional SC_CARETSTICKY_WHITESPACE mode . Feature #3027559.
  • Bash lexer implements basic parsing of compound commands and constructs. Feature #3033135.
  • C++ folder allows disabling explicit fold comments.
  • Perl folder works for array blocks, adjacent package statements, nested PODs, and terminates package folding at __DATA__, ^D and ^Z. Feature #3030887.
  • PowerShell lexer supports multiline <# .. #> comments and adds 2 keyword classes. Feature #3015176.
  • Lexing performed incrementally when needed by wrapping to make user interface more responsive.
  • SciTE setting replaceselection:yes works on GTK+.
  • SciTE Lua scripts calling io.open or io.popen on Windows have arguments treated as UTF-8 and converted to Unicode so that non-ASCII file paths will work. Lua files with non-ASCII paths run. Bug #3016951.
  • Crash fixed when searching for empty string. Bug #3017572.
  • Bugs fixed with folding and lexing when Enter pressed at start of line. Bug #3032652.
  • Bug fixed with line selection mode not affecting selection range. Bug #3021480.
  • Bug fixed where indicator alpha was limited to 100 rather than 255. Bug #3021473.
  • Bug fixed where changing annotation did not cause automatic redraw.
  • Regular expression bug fixed when a character range included non-ASCII characters.
  • Compilation failure with recent compilers fixed on GTK+. Bug #3022027.
  • Bug fixed on Windows with multiple monitors where autocomplete pop up would appear off-screen or straddling monitors. Bug #3017512.
  • SciTE on Windows bug fixed where changing directory to a Unicode path failed. Bug #3011987.
  • SciTE on Windows bug fixed where combo boxes were not allowing Unicode characters. Bug #3012986.
  • SciTE on GTK+ bug fixed when dragging files into SciTE on KDE. Bug #3026555.
  • SciTE bug fixed where closing untitled file could lose data if attempt to name file same as another buffer. Bug #3011680.
  • COBOL number masks now correctly highlighted. Bug #3012164.
  • PHP comments can include <?PHP without triggering state change. Bug #2854183.
  • VHDL lexer styles unclosed string correctly. Bug #3029627.
  • Memory leak fixed in list boxes on GTK+. Bug #3007669.

Release 2.12

  • Released 1 June 2010.
  • Drawing optimizations improve speed and fix some visible flashing when scrolling.
  • Copy Path command added to File menu in SciTE. Feature #2986745.
  • Optional warning displayed by SciTE when saving a file which has been modified by another process. Feature #2975041.
  • Flagship lexer for xBase languages updated to follow the language much more closely. Feature #2992689.
  • HTML lexer highlights Django templates in more regions. Feature #3002874.
  • Dropping files on SciTE on Windows, releases the drag object earlier and opens the files asynchronously, leading to smoother user experience. Feature #2986724.
  • SciTE HTML exports take the Use Monospaced Font setting into account.
  • SciTE window title "[n of m]" localized.
  • When new line inserted at start of line, markers are moved down. Bug #2986727.
  • On Windows, dropped text has its line ends converted, similar to pasting. Bug #3005328.
  • Fixed bug with middle-click paste in block select mode where text was pasted next to selection rather than at cursor. Bug #2984460.
  • Fixed SciTE crash where a style had a size parameter without a value. Bug #3003834.
  • Debug assertions in multiple lexers fixed. Bug #3000566.
  • CSS lexer fixed bug where @font-face displayed incorrectly Bug #2994224.
  • CSS lexer fixed bug where open comment caused highlighting error. Bug #1683672.
  • Shell file lexer fixed highlight glitch with here docs where the first line is a comment. Bug #2830239.
  • Bug fixed in SciTE openpath property that caused Open Selected File to fail to open the selected file.
  • Bug fixed in SciTE FileExt property when file name with no extension evaluated to whole path.
  • Fixed SciTE on Windows printing bug where the $(CurrentTime), $(CurrentPage) variables were not expanded. Bug #2994612.
  • SciTE compiles for 64-bit Windows and runs without crashing. Bug #2986312.
  • Full Screen mode in Windows Vista/7 improved to hide Start button and size borders a little better. Bug #3002813.

Release 2.11

  • Released 9 April 2010.
  • Fixes compatibility of Scintilla.h with the C language.
  • With a rectangular selection SCI_GETSELECTIONSTART and SCI_GETSELECTIONEND return limits of the rectangular selection rather than the limits of the main selection.
  • When SciTE on Windows is minimized to tray, only takes a single click to restore rather than a double click. Feature #981917.

Release 2.10

  • Released 4 April 2010.
  • Version 1.x of GTK+ is no longer supported.
  • SciTE is no longer supported on Windows 95, 98 or ME.
  • Case-insensitive search works for non-ASCII characters in UTF-8 and 8-bit encodings. Non-regex search in DBCS encodings is always case-sensitive.
  • Non-ASCII characters may be changed to upper and lower case.
  • SciTE on Windows can access all files including those with names outside the user's preferred character encoding.
  • SciTE may be extended with lexers written in Lua.
  • When there are multiple selections, the paste command can go either to the main selection or to each selection. This is controlled with SCI_SETMULTIPASTE.
  • More forms of bad UTF-8 are detected including overlong sequences, surrogates, and characters outside the valid range. Bad UTF-8 bytes are now displayed as 2 hex digits preceded by 'x'.
  • SCI_GETTAG retrieves the value of captured expressions within regular expression searches.
  • Django template highlighting added to the HTML lexer. Feature #2974889.
  • Verilog line comments can be folded.
  • SciTE on Windows allows specifying a filter for the Save As dialog. Feature #2943445.
  • Bug fixed when multiple selection disabled where rectangular selections could be expanded into multiple selections. Bug #2948260.
  • Bug fixed when document horizontally scrolled and up/down-arrow did not return to the same column after horizontal scroll occurred. Bug #2950799.
  • Bug fixed to remove hotspot highlight when mouse is moved out of the document. Windows only fix. Bug #2951353.
  • R lexer now performs case-sensitive check for keywords. Bug #2956543.
  • Bug fixed on GTK+ where text disappeared when a wrap occurred. Bug #2958043.
  • Bug fixed where regular expression replace cannot escape the '\' character by using '\\'. Bug #2959876.
  • Bug fixed on GTK+ when virtual space disabled, middle-click could still paste text beyond end of line. Bug #2971618.
  • SciTE crash fixed when double clicking on a malformed error message in the output pane. Bug #2976551.
  • Improved performance on GTK+ when changing parameters associated with scroll bars to the same value. Bug #2964357.
  • Fixed bug with pressing Shift+Tab with a rectangular selection so that it performs an un-indent similar to how Tab performs an indent.

Release 2.03

  • Released 14 February 2010.
  • Added SCI_SETFIRSTVISIBLELINE to match SCI_GETFIRSTVISIBLELINE.
  • Erlang lexer extended set of numeric bases recognized; separate style for module:function_name; detects built-in functions, known module attributes, and known preprocessor instructions; recognizes EDoc and EDoc macros; separates types of comments. Bug #2942448.
  • Python lexer extended with lexer.python.strings.over.newline option that allows non-triple-quoted strings to extend past line ends. This allows use of the Ren'Py language. Feature #2945550.
  • Fixed bugs with cursor movement after deleting a rectangular selection. Bug #2942131.
  • Fixed bug where calling SCI_SETSEL when there is a rectangular selection left the additional selections selected. Bug #2947064.
  • Fixed macro recording bug where not all bytes in multi-byte character insertions were reported through SCI_REPLACESEL.
  • Fixed SciTE bug where using Ctrl+Enter followed by Ctrl+Space produced an autocompletion list with only a single line containing all the identifiers.
  • Fixed SciTE on GTK+ bug where running a tool made the user interface completely unresponsive.
  • Fixed SciTE on Windows Copy to RTF bug. Bug #2108574.

Release 2.02

  • Released on 25 January 2010.
  • Markdown lexer added. Feature #2844081.
  • On GTK+, include code that understands the ranges of lead bytes for code pages 932, 936, and 950 so that most Chinese and Japanese text can be used on systems that are not set to the corresponding locale.
  • Allow changing the size of dots in visible whitespace using SCI_SETWHITESPACESIZE. Feature #2839427.
  • Additional carets can be hidden with SCI_SETADDITIONALCARETSVISIBLE.
  • Can choose anti-aliased, non-anti-aliased or lcd-optimized text using SCI_SETFONTQUALITY.
  • Retrieve the current selected text in the autocompletion list with SCI_AUTOCGETCURRENTTEXT.
  • Retrieve the name of the current lexer with SCI_GETLEXERLANGUAGE.
  • Progress 4GL lexer improves handling of comments in preprocessor declaration. Feature #2902206.
  • HTML lexer extended to handle Mako template language.
  • SQL folder extended for SQL Anywhere "EXISTS" and "ENDIF" keywords. Feature #2887524.
  • SciTE adds APIPath and AbbrevPath variables.
  • SciTE on GTK+ uses pipes instead of temporary files for running tools. This should be more secure.
  • Fixed crash when calling SCI_STYLEGETFONT for a style which does not have a font set. Bug #2857425.
  • Fixed crash caused by not having sufficient styles allocated after choosing a lexer. Bug #2881279.
  • Fixed crash in SciTE using autocomplete word when word characters includes space. Bug #2840141.
  • Fixed bug with handling upper-case file extensions SciTE on GTK+.
  • Fixed SciTE loading files from sessions with folded folds where it would not be scrolled to the correct location. Bug #2882775.
  • Fixed SciTE loading files from sessions when file no longer exists. Bug #2883437.
  • Fixed SciTE export to HTML using the wrong background colour.
  • Fixed crash when adding an annotation and then adding a new line after the annotation. Bug #2929708.
  • Fixed crash in SciTE setting a property to nil from Lua.
  • SCI_GETSELTEXT fixed to return correct length. Bug #2929441.
  • Fixed text positioning problems with selection in some circumstances.
  • Fixed text positioning problems with ligatures on GTK+.
  • Fixed problem pasting into rectangular selection with caret at bottom caused text to go from the caret down rather than replacing the selection.
  • Fixed problem replacing in a rectangular selection where only the final line was changed.
  • Fixed inability to select a rectangular area using Alt+Shift+Click at both corners. Bug #2899746.
  • Fixed problem moving to start/end of a rectangular selection with left/right key. Bug #2871358.
  • Fixed problem with Select All when there's a rectangular selection. Bug #2930488.
  • Fixed SCI_LINEDUPLICATE on a rectangular selection to not produce multiple discontinuous selections.
  • Virtual space removed when performing delete word left or delete line left. Virtual space converted to real space for delete word right. Preserve virtual space when pressing Delete key. Bug #2882566.
  • Fixed problem where Shift+Alt+Down did not move through wrapped lines. Bug #2871749.
  • Fixed incorrect background colour when using coloured lines with virtual space. Bug #2914691.
  • Fixed failure to display wrap symbol for SC_WRAPVISUALFLAGLOC_END_BY_TEXT. Bug #2936108.
  • Fixed blank background colour with EOLFilled style on last line. Bug #2890105.
  • Fixed problem in VB lexer with keyword at end of file. Bug #2901239.
  • Fixed SciTE bug where double clicking on a tab closed the file.
  • Fixed SciTE brace matching commands to only work when the caret is next to the brace, not when it is in virtual space. Bug #2885560.
  • Fixed SciTE on Windows Vista to access files in the Program Files directory rather than allow Windows to virtualize access. Bug #2916685.
  • Fixed NSIS folder to handle keywords that start with '!'. Bug #2872157.
  • Changed linkage of Scintilla_LinkLexers to "C" so that it can be used by clients written in C. Bug #2844718.

Release 2.01

  • Released on 19 August 2009.
  • Fix to positioning rectangular paste when viewing line ends.
  • Don't insert new lines and indentation for line ends at end of rectangular paste.
  • When not in additional selection typing mode, cutting a rectangular selection removes all of the selected text.
  • Rectangular selections are copied to the clipboard in document order, not in the order of selection.
  • SCI_SETCURRENTPOS and SCI_SETANCHOR work in rectangular mode.
  • On GTK+, drag and drop to a later position in the document now drops at the position.
  • Fix bug where missing property did not use default value.

Release 2.0

  • Released on 11 August 2009.
  • Multiple pieces of text can be selected simultaneously by holding control while dragging the mouse. Typing, backspace and delete may affect all selections together.
  • Virtual space allows selecting beyond the last character on a line.
  • SciTE on GTK+ path bar is now optional and defaults to off.
  • MagikSF lexer recognizes numbers correctly.
  • Folding of Python comments and blank lines improved. Bug #210240.
  • Bug fixed where background colour of last character in document leaked past that character.
  • Crash fixed when adding marker beyond last line in document. Bug #2830307.
  • Resource leak fixed in SciTE for Windows when printing fails. Bug #2816524.
  • Bug fixed on Windows where the system caret was destroyed during destruction when another window was using the system caret. Bug #2830223.
  • Bug fixed where indentation guides were drawn over text when the indentation used a style with a different space width to the default style.
  • SciTE bug fixed where box comment added a bare line feed rather than the chosen line end. Bug #2818104.
  • Reverted fix that led to wrapping whole document when displaying the first line of the document.
  • Export to LaTeX in SciTE fixed to work in more cases and not use as much space. Bug #1286548.
  • Bug fixed where EN_CHANGE notification was sent when performing a paste operation in a read-only document. Bug #2825485.
  • Refactored code so that Scintilla exposes less of its internal implementation and uses the C++ standard library for some basic collections. Projects that linked to Scintilla's SString or PropSet classes should copy this code from a previous version of Scintilla or from SciTE.

Release 1.79

  • Released on 1 July 2009.
  • Memory exhaustion and other exceptions handled by placing an error value into the status property rather than crashing. Scintilla now builds with exception handling enabled and requires exception handling to be enabled.
    This is a major change and application developers should consider how they will deal with Scintilla exhausting memory since Scintilla may not be in a stable state.
  • Deprecated APIs removed. The symbols removed are:
    • SCI_SETCARETPOLICY
    • CARET_CENTER
    • CARET_XEVEN
    • CARET_XJUMPS
    • SC_FOLDFLAG_BOX
    • SC_FOLDLEVELBOXHEADERFLAG
    • SC_FOLDLEVELBOXFOOTERFLAG
    • SC_FOLDLEVELCONTRACTED
    • SC_FOLDLEVELUNINDENT
    • SCN_POSCHANGED
    • SCN_CHECKBRACE
    • SCLEX_ASP
    • SCLEX_PHP
  • Cocoa platform added.
  • Names of struct types in Scintilla.h now start with "Sci_" to avoid possible clashes with platform definitions. Currently, the old names still work but these will be phased out.
  • When lines are wrapped, subsequent lines may be indented to match the indent of the initial line, or one more indentation level. Feature #2796119.
  • APIs added for finding the character at a point rather than an inter-character position. Feature #2646738.
  • A new marker SC_MARK_BACKGROUND_UNDERLINE is drawn in the text area as an underline the full width of the window.
  • Batch file lexer understands variables surrounded by '!'.
  • CAML lexer also supports SML.
  • D lexer handles string and numeric literals more accurately. Feature #2793782.
  • Forth lexer is now case-insensitive and better supports numbers like $hex and %binary. Feature #2804894.
  • Lisp lexer treats '[', ']', '{', and '}' as balanced delimiters which is common usage. Feature #2794989.
    It treats keyword argument names as being equivalent to symbols. Feature #2794901.
  • Pascal lexer bug fixed to prevent hang when 'interface' near beginning of file. Bug #2802863.
  • Perl lexer bug fixed where previous lexical states persisted causing "/" special case styling and subroutine prototype styling to not be correct. Bug #2809168.
  • XML lexer fixes bug where Unicode entities like '&—' were broken into fragments. Bug #2804760.
  • SciTE on GTK+ enables scrolling the tab bar on recent versions of GTK+. Feature #2061821.
  • SciTE on Windows allows tab bar tabs to be reordered by drag and drop.
  • Unit test script for Scintilla on Windows included with source code.
  • User defined menu items are now localized when there is a matching translation.
  • Width of icon column of autocompletion lists on GTK+ made more consistent.
  • Bug with slicing UTF-8 text into character fragments when there is a sequence of 100 or more 3 byte characters. Bug #2780566.
  • Folding bugs introduced in 1.78 fixed. Some of the fix was generic and there was also a specific fix for C++.
  • Bug fixed where a rectangular paste was not padding the line with sufficient spaces to align the pasted text.
  • Bug fixed with showing all text on each line of multi-line annotations when styling the whole annotation using SCI_ANNOTATIONSETSTYLE. Bug #2789430.

Release 1.78

  • Released on 28 April 2009.
  • Annotation lines may be added to each line.
  • A text margin may be defined with different text on each line.
  • Application actions may be added to the undo history.
  • Can query the symbol defined for a marker. An available symbol added for applications to indicate that plugins may allocate a marker.
  • Can increase the amount of font ascent and descent.
  • COBOL lexer added. Feature #2127406.
  • Nimrod lexer added. Feature #2642620.
  • PowerPro lexer added. Feature #2195308.
  • SML lexer added. Feature #2710950.
  • SORCUS Installation file lexer added. Feature #2343375.
  • TACL lexer added. Feature #2127406.
  • TAL lexer added. Feature #2127406.
  • Rewritten Pascal lexer with improved folding and other fixes. Feature #2190650.
  • INDIC_ROUNDBOX translucency level can be modified. Feature #2586290.
  • C++ lexer treats angle brackets in #include directives as quotes when styling.within.preprocessor. Bug #2551033.
  • Inno Setup lexer is sensitive to whether within the [Code] section and handles comments better. Bug #2552973.
  • HTML lexer does not go into script mode when script tag is self-closing.
  • HTML folder fixed where confused by comments when fold.html.preprocessor off. Bug #2532774.
  • Perl lexer fixes problem with string matching caused by line endings. Bug #2648342.
  • Progress lexer fixes problem with "last-event:function" phrase. Bug #2483619.
  • Properties file lexer extended to handle RFC2822 text when lexer.props.allow.initial.spaces on.
  • Python lexer adds options for Python 3 and Cython.
  • Shell lexer fixes heredoc problem caused by line endings. Bug #2635257.
  • TeX lexer handles comment at end of line correctly. Bug #2698766.
  • SciTE retains selection range when performing a replace selection command. Feature #2339160.
  • SciTE definition of word characters fixed to match documentation. Bug #2464531.
  • SciTE on GTK+ performing Search or Replace when dialog already shown now brings dialog to foreground. Bug #2634224.
  • Fixed encoding bug with calltips on GTK+.
  • Block caret drawn in correct place on wrapped lines. Bug #2126144.
  • Compilation for 64 bit Windows works using MinGW. Bug #2515578.
  • Incorrect memory freeing fixed on OS X. Bug #2354098, Bug #2671749.
  • SciTE on GTK+ crash fixed on startup when child process exits before initialization complete. Bug #2716987.
  • Crash fixed when AutoCompleteGetCurrent called with no active autocompletion.
  • Flickering diminished when pressing Tab. Bug #2723006.
  • Namespace compilation issues with GTK+ on OS X fixed.
  • Increased maximum length of SciTE's Language menu on GTK+ to 100 items. Bug #2528241.
  • Fixed incorrect Python lexing for multi-line continued strings. Bug #2450963.

Release 1.77

  • Released on 18 October 2008.
  • Direct temporary access to Scintilla's text buffer to allow simple efficient interfacing to libraries like regular expression libraries.
  • Scintilla on Windows can interpret keys as Unicode even when a narrow character window with SCI_SETKEYSUNICODE.
  • Notification sent when autocompletion cancelled.
  • MySQL lexer added.
  • Lexer for gettext .po files added.
  • Abaqus lexer handles program structure more correctly.
  • Assembler lexer works with non-ASCII text.
  • C++ lexer allows mixed case doc comment tags.
  • CSS lexer updated and works with non-ASCII.
  • Diff lexer adds style for changed lines, handles subversion diffs better and fixes styling and folding for lines containing chunk dividers ("---").
  • FORTRAN lexer accepts more styles of compiler directive.
  • Haskell lexer allows hexadecimal literals.
  • HTML lexer improves PHP and JavaScript folding. PHP heredocs, nowdocs, strings and comments processed more accurately. Internet Explorer's non-standard >comment< tag supported. Script recognition in XML can be controlled with lexer.xml.allow.scripts property.
  • Lua lexer styles last character correctly.
  • Perl lexer update.
  • Comment folding implemented for Ruby.
  • Better TeX folding.
  • Verilog lexer updated.
  • Windows Batch file lexer handles %~ and %*.
  • YAML lexer allows non-ASCII text.
  • SciTE on GTK+ implements "Replace in Buffers" in advanced mode.
  • The extender OnBeforeSave method can override the default file saving behaviour by retuning true.
  • Window position and recent files list may be saved into the session file.
  • Right button press outside the selection moves the caret.
  • SciTE load.on.activate works when closing a document reveals a changed document.
  • SciTE bug fixed where eol.mode not used for initial buffer.
  • SciTE bug fixed where a file could be saved as the same name as another buffer leading to confusing behaviour.
  • Fixed display bug for long lines in same style on Windows.
  • Fixed SciTE crash when finding matching preprocessor command used on some files.
  • Drawing performance improved for files with many blank lines.
  • Folding bugs fixed where changing program text produced a decrease in fold level on a fold header line.
  • Clearing document style now clears all indicators.
  • SciTE's embedded Lua updated to 5.1.4.
  • SciTE will compile with versions of GTK+ before 2.8 again.
  • SciTE on GTK+ bug fixed where multiple files not opened.
  • Bug fixed with SCI_VCHOMEWRAP and SCI_VCHOMEWRAPEXTEND on white last line.
  • Regular expression bug fixed where "^[^(]+$" matched empty lines.

Release 1.76

  • Released on 16 March 2008.
  • Support for PowerShell.
  • Lexer added for Magik.
  • Director extension working on GTK+.
  • Director extension may set focus to SciTE through "focus:" message on GTK+.
  • C++ folder handles final line better in some cases.
  • SCI_COPYALLOWLINE added which is similar to SCI_COPY except that if the selection is empty then the line holding the caret is copied. On Windows an extra clipboard format allows pasting this as a whole line before the current selection. This behaviour is compatible with Visual Studio.
  • On Windows, the horizontal scroll bar can handle wider files.
  • On Windows, a system palette leak was fixed. Should not affect many as palette mode is rarely used.
  • Install command on GTK+ no longer tries to set explicit owner.
  • Perl lexer handles defined-or operator "//".
  • Octave lexer fixes "!=" operator.
  • Optimized selection change drawing to not redraw as much when not needed.
  • SciTE on GTK+ no longer echoes Lua commands so is same as on Windows.
  • Automatic vertical scrolling limited to one line at a time so is not too fast.
  • Crash fixed when line states set beyond end of line states. This occurred when lexers did not set a line state for each line.
  • Crash in SciTE on Windows fixed when search for 513 character string fails.
  • SciTE disables translucent features on Windows 9x due to crashes reported when using translucency.
  • Bug fixed where whitespace background was not seen on wrapped lines.

Release 1.75

  • Released on 22 November 2007.
  • Some WordList and PropSet functionality moved from Scintilla to SciTE. Projects that link to Scintilla's code for these classes may need to copy code from SciTE.
  • Borland C++ can no longer build Scintilla.
  • Invalid bytes in UTF-8 mode are displayed as hex blobs. This also prevents crashes due to passing invalid UTF-8 to platform calls.
  • Indentation guides enhanced to be visible on completely empty lines when possible.
  • The horizontal scroll bar may grow to match the widest line displayed.
  • Allow autocomplete pop ups to appear outside client rectangle in some cases.
  • When line state changed, SC_MOD_CHANGELINESTATE modification notification sent and margin redrawn.
  • SciTE scripts can access the menu command values IDM_*.
  • SciTE's statement.end property has been implemented again.
  • SciTE shows paths and matches in different styles for Find In Files.
  • Incremental search in SciTE for Windows is modeless to make it easier to exit.
  • Folding performance improved.
  • SciTE for GTK+ now includes a Browse button in the Find In Files dialog.
  • On Windows versions that support Unicode well, Scintilla is a wide character window which allows input for some less common languages like Armenian, Devanagari, Tamil, and Georgian. To fully benefit, applications should use wide character calls.
  • Lua function names are exported from SciTE to allow some extension libraries to work.
  • Lexers added for Abaqus, Ansys APDL, Asymptote, and R.
  • SCI_DELWORDRIGHTEND added for closer compatibility with GTK+ entry widget.
  • The styling buffer may now use all 8 bits in each byte for lexical states with 0 bits for indicators.
  • Multiple characters may be set for SciTE's calltip.<lexer>.parameters.start property.
  • Bash lexer handles octal literals.
  • C++/JavaScript lexer recognizes regex literals in more situations.
  • Haskell lexer fixed for quoted strings.
  • HTML/XML lexer does not notice XML indicator if there is non-whitespace between the "<?" and "XML". ASP problem fixed where </ is used inside a comment.
  • Error messages from Lua 5.1 are recognized.
  • Folding implemented for Metapost.
  • Perl lexer enhanced for handling minus-prefixed barewords, underscores in numeric literals and vector/version strings, ^D and ^Z similar to __END__, subroutine prototypes as a new lexical class, formats and format blocks as new lexical classes, and '/' suffixed keywords and barewords.
  • Python lexer styles all of a decorator in the decorator style rather than just the name.
  • YAML lexer styles colons as operators.
  • Fixed SciTE bug where undo would group together multiple separate modifications.
  • Bug fixed where setting background colour of calltip failed.
  • SciTE allows wildcard suffixes for file pattern based properties.
  • SciTE on GTK+ bug fixed where user not prompted to save untitled buffer.
  • SciTE bug fixed where property values from one file were not seen by lower priority files.
  • Bug fixed when showing selection with a foreground colour change which highlighted an incorrect range in some positions.
  • Cut now invokes SCN_MODIFYATTEMPTRO notification.
  • Bug fixed where caret not shown at beginning of wrapped lines. Caret made visible in some cases after wrapping and scroll bar updated after wrapping.
  • Modern indicators now work on wrapped lines.
  • Some crashes fixed for 64-bit GTK+.
  • On GTK+ clipboard features improved for VMWare tools copy and paste. SciTE exports the clipboard more consistently on shut down.

Release 1.74

  • Released on 18 June 2007.
  • OS X support.
  • Indicators changed to be a separate data structure allowing more indicators. Storing indicators in high bits of styling bytes is deprecated and will be removed in the next version.
  • Unicode support extended to all Unicode characters not just the Basic Multilingual Plane.
  • Performance improved on wide lines by breaking long runs in a single style into shorter segments.
  • Performance improved by caching layout of short text segments.
  • SciTE includes Lua 5.1.
  • Caret may be displayed as a block.
  • Lexer added for GAP.
  • Lexer added for PL/M.
  • Lexer added for Progress.
  • SciTE session files have changed format to be like other SciTE .properties files and now use the extension .session. Bookmarks and folds may optionally be saved in session files. Session files created with previous versions of SciTE will not load into this version.
  • SciTE's extension and scripting interfaces add OnKey, OnDwellStart, and OnClose methods.
  • On GTK+, copying to the clipboard does not include the text/urilist type since this caused problems when pasting into Open Office.
  • On GTK+, Scintilla defaults caret blink rate to platform preference.
  • Dragging does not start until the mouse has been dragged a certain amount. This stops spurious drags when just clicking inside the selection.
  • Bug fixed where brace highlight not shown when caret line background set.
  • Bug fixed in Ruby lexer where out of bounds access could occur.
  • Bug fixed in XML folding where tags were not being folded because they are singletons in HTML.
  • Bug fixed when many font names used.
  • Layout bug fixed on GTK+ where fonts have ligatures available.
  • Bug fixed with SCI_LINETRANSPOSE on a blank line.
  • SciTE hang fixed when using UNC path with directory properties feature.
  • Bug on Windows fixed by examining dropped text for Unicode even in non-Unicode mode so it can work when source only provides Unicode or when using an encoding different from the system default.
  • SciTE bug on GTK+ fixed where Stop Executing did not work when more than a single process started.
  • SciTE bug on GTK+ fixed where mouse wheel was not switching between buffers.
  • Minor line end fix to PostScript lexer.

Release 1.73

  • Released on 31 March 2007.
  • SciTE adds a Directory properties file to configure behaviour for files in a directory and its subdirectories.
  • Style changes may be made during text modification events.
  • Regular expressions recognize \d, \D, \s, \S, \w, \W, and \xHH.
  • Support for cmake language added.
  • More Scintilla properties can be queried.
  • Edge line drawn under text.
  • A savesession command added to SciTE director interface.
  • SciTE File | Encoding menu item names changed to be less confusing.
  • SciTE on GTK+ dialog buttons reordered to follow guidelines.
  • SciTE on GTK+ removed GTK+ 1.x compatible file dialog code.
  • SciTE on GTK+ recognizes key names KeypadMultiply and KeypadDivide.
  • Background colour of line wrapping visual flag changed to STYLE_DEFAULT.
  • Makefile lexing enhanced for ':=' operator and when lines start with tab.
  • TADS3 lexer and folder improved.
  • SCN_DOUBLECLICK notification may set SCI_SHIFT, SCI_CTRL, and SCI_ALT flags on modifiers field.
  • Slow folding of large constructs in Python fixed.
  • MSSQL folding fixed to be case-insensitive and fold at more keywords.
  • SciTE's brace matching works better for HTML.
  • Determining API list items checks for specified parameters start character before default '('.
  • Hang fixed in HTML lexer.
  • Bug fixed in with LineTranspose command where markers could move to different line.
  • Memory released when buffer completely emptied.
  • If translucency not available on Windows, draw rectangular outline instead.
  • Bash lexer handles "-x" in "--x-includes..." better.
  • AutoIt3 lexer fixes string followed by '+'.
  • LinesJoin fixed where it stopped early due to not adjusting for inserted spaces..
  • StutteredPageDown fixed when lines wrapped.
  • FormatRange fixed to not double count line number width which could lead to a large space.
  • SciTE Export As PDF and Latex commands fixed to format floating point numbers with '.' even in locales that use ','.
  • SciTE bug fixed where File | New could produce buffer with contents of previous file when using read-only mode.
  • SciTE retains current scroll position when switching buffers and fold.on.open set.
  • SciTE crash fixed where '*' used to invoke parameters dialog.
  • SciTE bugs when writing large UCS-2 files fixed.
  • Bug fixed when scrolling inside a SCN_PAINTED event by invalidating window rather than trying to perform synchronous painting.
  • SciTE for GTK+ View | Full Screen works on recent versions of GTK+.
  • SciTE for Windows enables and disables toolbar commands correctly.

Release 1.72

  • Released on 15 January 2007.
  • Performance of per-line data improved.
  • SC_STARTACTION flag set on the first modification notification in an undo transaction to help synchronize the container's undo stack with Scintilla's.
  • On GTK+ drag and drop defaults to move rather than copy.
  • Scintilla supports extending appearance of selection to right hand margin.
  • Incremental search available on GTK+.
  • SciTE Indentation Settings dialog available on GTK+ and adds a "Convert" button.
  • Find in Files can optionally ignore binary files or directories that start with ".".
  • Lexer added for "D" language.
  • Export as HTML shows folding with underline lines and +/- symbols.
  • Ruby lexer interprets interpolated strings as expressions.
  • Lua lexer fixes some cases of numeric literals.
  • C++ folder fixes bug with "@" in doc comments.
  • NSIS folder handles !if and related commands.
  • Inno setup lexer adds styling for single and double quoted strings.
  • Matlab lexer handles backslashes in string literals correctly.
  • HTML lexer fixed to allow "?>" in comments in Basic script.
  • Added key codes for Windows key and Menu key.
  • Lua script method scite.MenuCommand(x) performs a menu command.
  • SciTE bug fixed with box comment command near start of file setting selection to end of file.
  • SciTE on GTK+, fixed loop that occurred with automatic loading for an unreadable file.
  • SciTE asks whether to save files when Windows shuts down.
  • Save Session on Windows now defaults the extension to "ses".
  • Bug fixed with single character keywords.
  • Fixed infinite loop for SCI_GETCOLUMN for position beyond end of document.
  • Fixed failure to accept typing on Solaris/GTK+ when using default ISO-8859-1 encoding.
  • Fixed warning from Lua in SciTE when creating a new buffer when already have maximum number of buffers open.
  • Crash fixed with "%%" at end of batch file.

Release 1.71

  • Released on 21 August 2006.
  • Double click notification includes line and position.
  • VB lexer bugs fixed for preprocessor directive below a comment or some other states and to use string not closed style back to the starting quote when there are internal doubled quotes.
  • C++ lexer allows identifiers to contain '$' and non-ASCII characters such as UTF-8. The '$' character can be disallowed with lexer.cpp.allow.dollars=0.
  • Perl lexer allows UTF-8 identifiers and has some other small improvements.
  • SciTE's $(CurrentWord) uses word.characters.<filepattern> to define the word rather than a hardcoded list of word characters.
  • SciTE Export as HTML adds encoding information for UTF-8 file and fixes DOCTYPE.
  • SciTE session and .recent files default to the user properties directory rather than global properties directory.
  • Left and right scroll events handled correctly on GTK+ and horizontal scroll bar has more sensible distances for page and arrow clicks.
  • SciTE on GTK+ tab bar fixed to work on recent versions of GTK+.
  • On GTK+, if the approximate character set conversion is unavailable, a second attempt is made without approximations. This may allow keyboard input and paste to work on older systems.
  • SciTE on GTK+ can redefine the Insert key.
  • SciTE scripting interface bug fixed where some string properties could not be changed.

Release 1.70

  • Released on 20 June 2006.
  • On GTK+, character set conversion is performed using an option that allows approximate conversions rather than failures when a character can not be converted. This may lead to similar characters being inserted or when no similar character is available a '?' may be inserted.
  • On GTK+, the internationalized IM (Input Method) feature is used for all typed input for all character sets.
  • Scintilla has new margin types SC_MARGIN_BACK and SC_MARGIN_FORE that use the default style's background and foreground colours (normally white and black) as the background to the margin.
  • Scintilla/GTK+ allows file drops on Windows when drop is of type DROPFILES_DND as well as text/uri-list.
  • Code page can only be set to one of the listed valid values.
  • Text wrapping fixed for cases where insertion was not wide enough to trigger wrapping before being styled but was after styling.
  • SciTE find marks are removed before printing or exporting to avoid producing incorrect styles.

Release 1.69

  • Released on 29 May 2006.
  • SciTE supports z-order based buffer switching on Ctrl+Tab.
  • Translucent support for selection and whole line markers.
  • SciTE may have per-language abbreviations files.
  • Support for Spice language.
  • On GTK+ autocompletion lists are optimized and use correct selection colours.
  • On GTK+ the URI data type is preferred in drag and drop so that applications will see files dragged from the shell rather than dragging the text of the file name into the document.
  • Increased number of margins to 5.
  • Basic lexer allows include directive $include: "file name".
  • SQL lexer no longer bases folding on indentation.
  • Line ends are transformed when copied to clipboard on Windows/GTK+2 as well as Windows/GTK+ 1.
  • Lexing code masks off the indicator bits on the start style before calling the lexer to avoid confusing the lexer when an application has used an indicator.
  • SciTE savebefore:yes only saves the file when it has been changed.
  • SciTE adds output.initial.hide setting to allow setting the size of the output pane without it showing initially.
  • SciTE on Windows Go To dialog allows line number with more digits.
  • Bug in HTML lexer fixed where a segment of PHP could switch scripting language based on earlier text on that line.
  • Memory bug fixed when freeing regions on GTK+. Other minor bugs fixed on GTK+.
  • Deprecated GTK+ calls in Scintilla replaced with current calls.
  • Fixed a SciTE bug where closing the final buffer, if read-only, left the text present in an untitled buffer.
  • Bug fixed in bash lexer that prevented folding.
  • Crash fixed in bash lexer when backslash at end of file.
  • Crash on recent releases of GTK+ 2.x avoided by changing default font from X core font to Pango font "!Sans".
  • Fix for SciTE properties files where multiline properties continued over completely blank lines.
  • Bug fixed in SciTE/GTK+ director interface where more data available than buffer size.
  • Minor visual fixes to SciTE splitter on GTK+.

Release 1.68

  • Released on 9 March 2006.
  • Translucent drawing implemented for caret line and box indicators.
  • Lexer specifically for TCL is much more accurate than reusing C++ lexer.
  • Support for Inno Setup scripts.
  • Support for Opal language.
  • Calltips may use a new style, STYLE_CALLTIP which allows choosing a different font for calltips.
  • Python lexer styles comments on decorators.
  • HTML lexer refined handling of "?>" and "%>" within server side scripts.
  • Batch file lexer improved.
  • Eiffel lexer doesn't treat '.' as a name character.
  • Lua lexer handles length operator, #, and hex literals.
  • Properties file lexer has separate style for keys.
  • PL/SQL folding improved.
  • SciTE Replace dialog always searches in forwards direction.
  • SciTE can detect language of file from initial #! line.
  • SciTE on GTK+ supports output.scroll=2 setting.
  • SciTE can perform an import a properties file from the command line.
  • Set of word characters used for regular expression \< and \>.
  • Bug fixed with SCI_COPYTEXT stopping too early.
  • Bug fixed with splitting lines so that all lines are split.
  • SciTE calls OnSwitchFile when closing one buffer causes a switch to another.
  • SciTE bug fixed where properties were being reevaluated without good reason after running a macro.
  • Crash fixed when clearing document with some lines contracted in word wrap mode.
  • Palette expands as more entries are needed.
  • SCI_POSITIONFROMPOINT returns more reasonable value when close to last text on a line.
  • On Windows, long pieces of text may be drawn in segments if they fail to draw as a whole.
  • Bug fixed with bad drawing when some visual changes made inside SCN_UPDATEUI notification.
  • SciTE bug fixed with groupundo setting.

Release 1.67

  • Released on 17 December 2005.
  • Scintilla checks the paint region more accurately when seeing if an area is being repainted. Platform layer implementations may need to change for this to take effect. This fixes some drawing and styling bugs. Also optimized some parts of marker code to only redraw the line of the marker rather than whole of the margin.
  • Quoted identifier style for SQL. SQL folding performed more simply.
  • Ruby lexer improved to better handle here documents and non-ASCII characters.
  • Lua lexer supports long string and block comment syntax from Lua 5.1.
  • Bash lexer handles here documents better.
  • JavaScript lexing recognizes regular expressions more accurately and includes flag characters in the regular expression style. This is both in JavaScript files and when JavaScript is embedded in HTML.
  • Scintilla API provided to reveal how many style bits are needed for the current lexer.
  • Selection duplicate added.
  • Scintilla API for adding a set of markers to a line.
  • DBCS encodings work on Windows 9x.
  • Convention defined for property names to be used by lexers and folders so they can be automatically discovered and forwarded from containers.
  • Default bookmark in SciTE changed to a blue sphere image.
  • SciTE stores the time of last asking for a save separately for each buffer which fixes bugs with automatic reloading.
  • On Windows, pasted text has line ends converted to current preference. GTK+ already did this.
  • Kid template language better handled by HTML lexer by finishing ASP Python mode when a ?> is found.
  • SciTE counts number of characters in a rectangular selection correctly.
  • 64-bit compatibility improved. One change that may affect user code is that the notification message header changed to include a pointer-sized id field to match the current Windows definition.
  • Empty ranges can no longer be dragged.
  • Crash fixed when calls made that use layout inside the painted notification.
  • Bug fixed where Scintilla created pixmap buffers that were too large leading to failures when many instances used.
  • SciTE sets the directory of a new file to the directory of the currently active file.
  • SciTE allows choosing a code page for the output pane.
  • SciTE HTML exporter no longer honours monospaced font setting.
  • Line layout cache in page mode caches the line of the caret. An assertion is now used to ensure that the layout reentrancy problem that caused this is easier to find.
  • Speed optimized for long lines and lines containing many control characters.
  • Bug fixed in brace matching in DBCS files where byte inside character is same as brace.
  • Indent command does not indent empty lines.
  • SciTE bug fixed for commands that operate on files with empty extensions.
  • SciTE bug fixed where monospaced option was copied for subsequently opened files.
  • SciTE on Windows bug fixed in the display of a non-ASCII search string which can not be found.
  • Bugs fixed with nested calls displaying a new calltip while one is already displayed.
  • Bug fixed when styling PHP strings.
  • Bug fixed when styling C++ continued preprocessor lines.
  • SciTE bug fixed where opening file from recently used list reset choice of language.
  • SciTE bug fixed when compiled with NO_EXTENSIONS and closing one file closes the application.
  • SciTE crash fixed for error messages that look like Lua messages but aren't in the same order.
  • Remaining fold box support deprecated. The symbols SC_FOLDLEVELBOXHEADERFLAG, SC_FOLDLEVELBOXFOOTERFLAG, SC_FOLDLEVELCONTRACTED, SC_FOLDLEVELUNINDENT, and SC_FOLDFLAG_BOX are deprecated.

Release 1.66

  • Released on 26 August 2005.
  • New, more ambitious Ruby lexer.
  • SciTE Find in Files dialog has options for matching case and whole words which are enabled when the internal find command is used.
  • SciTE output pane can display automatic completion after "$(" typed. An initial ">" on a line is ignored when Enter pressed.
  • C++ lexer recognizes keywords within line doc comments. It continues styles over line end characters more consistently so that eolfilled style can be used for preprocessor lines and line comments.
  • VB lexer improves handling of file numbers and date literals.
  • Lua folder handles repeat until, nested comments and nested strings.
  • POV lexer improves handling of comment lines.
  • AU3 lexer and folder updated. COMOBJ style added.
  • Bug fixed with text display on GTK+ with Pango 1.8.
  • Caret painting avoided when not focused.
  • SciTE on GTK+ handles file names used to reference properties as case-sensitive.
  • SciTE on GTK+ Save As and Export commands set the file name field. On GTK+ the Export commands modify the file name in the same way as on Windows.
  • Fixed SciTE problem where confirmation was not displaying when closing a file where all contents had been deleted.
  • Middle click on SciTE tab now closes correct buffer on Windows when tool bar is visible.
  • SciTE bugs fixed where files contained in directory that includes '.' character.
  • SciTE bug fixed where import in user options was reading file from directory of global options.
  • SciTE calltip bug fixed where single line calltips had arrow displayed incorrectly.
  • SciTE folding bug fixed where empty lines were shown for no reason.
  • Bug fixed where 2 byte per pixel XPM images caused crash although they are still not displayed.
  • Autocompletion list size tweaked.

Release 1.65

  • Released on 1 August 2005.
  • FreeBasic support.
  • SciTE on Windows handles command line arguments "-" (read standard input into buffer), "--" (read standard input into output pane) and "-@" (read file names from standard input and open each).
  • SciTE includes a simple implementation of Find in Files which is used if no find.command is set.
  • SciTE can close tabs with a mouse middle click.
  • SciTE includes a save.all.for.build setting.
  • Folder for MSSQL.
  • Batch file lexer understands more of the syntax and the behaviour of built in commands.
  • Perl lexer handles here docs better; disambiguates barewords, quote-like delimiters, and repetition operators; handles Pods after __END__; recognizes numbers better; and handles some typeglob special variables.
  • Lisp adds more lexical states.
  • PHP allows spaces after <<<.
  • TADS3 has a simpler set of states and recognizes identifiers.
  • Avenue elseif folds better.
  • Errorlist lexer treats lines starting with '+++' and '---' as separate styles from '+' and '-' as they indicate file names in diffs.
  • SciTE error recognizer handles file paths in extra explanatory lines from MSVC and in '+++' and '---' lines from diff.
  • Bugs fixed in SciTE and Scintilla folding behaviour when text pasted before folded text caused unnecessary unfolding and cutting text could lead to text being irretrievably hidden.
  • SciTE on Windows uses correct font for dialogs and better font for tab bar allowing better localization
  • When Windows is used with a secondary monitor before the primary monitor, autocompletion lists are not forced onto the primary monitor.
  • Scintilla calltip bug fixed where down arrow setting wrong value in notification if not in first line. SciTE bug fixed where second arrow only shown on multiple line calltip and was therefore misinterpreting the notification value.
  • Lexers will no longer be re-entered recursively during, for example, fold level setting.
  • Undo of typing in overwrite mode undoes one character at a time rather than requiring a removal and addition step for each character.
  • EM_EXSETSEL(0,-1) fixed.
  • Bug fixed where part of a rectangular selection was not shown as selected.
  • Autocomplete window size fixed.

Release 1.64

  • Released on 6 June 2005.
  • TADS3 support
  • Smalltalk support.
  • Rebol support.
  • Flagship (Clipper / XBase) support.
  • CSound support.
  • SQL enhanced to support SQL*Plus.
  • SC_MARK_FULLRECT margin marker fills the whole marker margin for marked lines with a colour.
  • Performance improved for some large undo and redo operations and modification flags added in notifications.
  • SciTE adds command equivalents for fold margin mouse actions.
  • SciTE adds OnUpdateUI to set of events that can be handled by a Lua script.
  • Properties set in Scintilla can be read.
  • GTK+ SciTE exit confirmation adds Cancel button.
  • More accurate lexing of numbers in PHP and Caml.
  • Perl can fold POD and package sections. POD verbatim section style. Globbing syntax recognized better.
  • Context menu moved slightly on GTK+ so that it will be under the mouse and will stay open if just clicked rather than held.
  • Rectangular selection paste works the same whichever direction the selection was dragged in.
  • EncodedFromUTF8 handles -1 length argument as documented.
  • Undo and redo can cause SCN_MODIFYATTEMPTRO notifications.
  • Indicators display correctly when they start at the second character on a line.
  • SciTE Export As HTML uses standards compliant CSS.
  • SciTE automatic indentation handles keywords for indentation better.
  • SciTE fold.comment.python property removed as does not work.
  • Fixed problem with character set conversion when pasting on GTK+.
  • SciTE default character set changed from ANSI_CHARSET to DEFAULT_CHARSET.
  • Fixed crash when creating empty autocompletion list.
  • Autocomplete window size made larger under some conditions to make truncation less common.
  • Bug fixed where changing case of a selection did not affect initial character of lines in multi-byte encodings.
  • Bug fixed where rectangular selection not displayed after Alt+Shift+Click.

Release 1.63

  • Released on 4 April 2005.
  • Autocompletion on Windows changed to use pop up window, be faster, allow choice of maximum width and height, and to highlight only the text of the selected item rather than both the text and icon if any.
  • Extra items can be added to the context menu in SciTE.
  • Character wrap mode in Scintilla helps East Asian languages.
  • Lexer added for Haskell.
  • Objective Caml support.
  • BlitzBasic and PureBasic support.
  • CSS support updated to handle CSS2.
  • C++ lexer is more selective about document comment keywords.
  • AutoIt 3 lexer improved.
  • Lua lexer styles end of line characters on comment and preprocessor lines so that the eolfilled style can be applied to them.
  • NSIS support updated for line continuations, box comments, SectionGroup and PageEx, and with more up-to-date properties.
  • Clarion lexer updated to perform folding and have more styles.
  • SQL lexer gains second set of keywords.
  • Errorlist lexer recognizes Borland Delphi error messages.
  • Method added for determining number of visual lines occupied by a document line due to wrapping.
  • Sticky caret mode does not modify the preferred caret x position when typing and may be useful for typing columns of text.
  • Dwell end notification sent when scroll occurs.
  • On GTK+, Scintilla requisition height is screen height rather than large fixed value.
  • Case insensitive autocompletion prefers exact case match.
  • SCI_PARADOWN and SCI_PARAUP treat lines containing only white space as empty and handle text hidden by folding.
  • Scintilla on Windows supports WM_PRINTCLIENT although there are some limitations.
  • SCN_AUTOCSELECTION notification sent when user selects from autoselection list.
  • SciTE's standard properties file sets buffers to 10, uses Pango fonts on GTK+ and has dropped several languages to make the menu fit on screen.
  • SciTE's encoding cookie detection loosened so that common XML files will load in UTF-8 if that is their declared encoding.
  • SciTE on GTK+ changes menus and toolbars to not be detachable unless turned on with a property. Menus no longer tear off. The toolbar may be set to use the default theme icons rather than SciTE's set. Changed key for View | End of Line because of a conflict. Language menu can contain more items.
  • SciTE on GTK+ 2.x allows the height and width of the file open file chooser to be set, for the show hidden files check box to be set from an option and for it to be opened in the directory of the current file explicitly. Enter key works in save chooser.
  • Scintilla lexers should no longer see bits in style bytes that are outside the set they modify so should be able to correctly lex documents where the container has used indicators.
  • SciTE no longer asks to save before performing a revert.
  • SciTE director interface adds a reloadproperties command to reload properties from files.
  • Allow build on CYGWIN platform.
  • Allow use from LccWin compiler.
  • SCI_COLOURISE for SCLEX_CONTAINER causes a SCN_STYLENEEDED notification.
  • Bugs fixed in lexing of HTML/ASP/JScript.
  • Fix for folding becoming confused.
  • On Windows, fixes for Japanese Input Method Editor and for 8 bit Katakana characters.
  • Fixed buffer size bug avoided when typing long words by making buffer bigger.
  • Undo after automatic indentation more sensible.
  • SciTE menus on GTK+ uses Shift and Ctrl rather than old style abbreviations.
  • SciTE full screen mode on Windows calculates size more correctly.
  • SciTE on Windows menus work better with skinning applications.
  • Searching bugs fixed.
  • Colours reallocated when changing image using SCI_REGISTERIMAGE.
  • Caret stays visible when Enter held down.
  • Undo of automatic indentation more reasonable.
  • High processor usage fixed in background wrapping under some circumstances.
  • Crashing bug fixed on AMD64.
  • SciTE crashing bug fixed when position.height or position.width not set.
  • Crashing bug on GTK+ fixed when setting cursor and window is NULL.
  • Crashing bug on GTK+ preedit window fixed.
  • SciTE crashing bug fixed in incremental search on Windows ME.
  • SciTE on Windows has an optional find and replace dialogs that can search through all buffers and search within a particular style number.

Release 1.62

  • Released on 31 October 2004.
  • Lexer added for ASN.1.
  • Lexer added for VHDL.
  • On Windows, an invisible system caret is used to allow screen readers to determine where the caret is. The visible caret is still drawn by the painting code.
  • On GTK+, Scintilla has methods to read the target as UTF-8 and to convert a string from UTF-8 to the document encoding. This eases integration with containers that use the UTF-8 encoding which is the API encoding for GTK+ 2.
  • SciTE on GTK+2 and Windows NT/2000/XP allows search and replace of Unicode text.
  • SciTE calltips allow setting the characters used to start and end parameter lists and to separate parameters.
  • FindColumn method converts a line and column into a position, taking into account tabs and multi-byte characters.
  • On Windows, when Scintilla copies text to the clipboard as Unicode, it avoids adding an ANSI copy as the system will automatically convert as required in a context-sensitive manner.
  • SciTE indent.auto setting automatically determines indent.size and use.tabs from document contents.
  • SciTE defines a CurrentMessage property that holds the most recently selected output pane message.
  • SciTE Lua scripting enhanced with
    • A Lua table called 'buffer' is associated with each buffer and can be used to maintain buffer-specific state.
    • A 'scite' object allows interaction with the application such as opening files from script.
    • Dynamic properties can be reset by assigning nil to a given key in the props table.
    • An 'OnClear' event fires whenever properties and extension scripts are about to be reloaded.
    • On Windows, loadlib is enabled and can be used to access Lua binary modules / DLLs.
  • SciTE Find in Files on Windows can be used in a modeless way and gains a '..' button to move up to the parent directory. It is also wider so that longer paths can be seen.
  • Close buttons added to dialogs in SciTE on Windows.
  • SciTE on GTK+ 2 has a "hidden files" check box in file open dialog.
  • SciTE use.monospaced setting removed. More information in the FAQ.
  • APDL lexer updated with more lexical classes
  • AutoIt3 lexer updated.
  • Ada lexer fixed to support non-ASCII text.
  • Cpp lexer now only matches exactly three slashes as starting a doc-comment so that lines of slashes are seen as a normal comment. Line ending characters are appear in default style on preprocessor and single line comment lines.
  • CSS lexer updated to support CSS2 including second set of keywords.
  • Errorlist lexer now understands Java stack trace lines.
  • SciTE's handling of HTML Tidy messages jumps to column as well as line indicated.
  • Lisp lexer allows multiline strings.
  • Lua lexer treats .. as an operator when between identifiers.
  • PHP lexer handles 'e' in numerical literals.
  • PowerBasic lexer updated for macros and optimized.
  • Properties file folder changed to leave lines before a header at the base level and thus avoid a vertical line when using connected folding symbols.
  • GTK+ on Windows version uses Alt for rectangular selection to be compatible with platform convention.
  • SciTE abbreviations file moved from system directory to user directory so each user can have separate abbreviations.
  • SciTE on GTK+ has improved .desktop file and make install support that may lead to better integration with system shell.
  • Disabling of themed background drawing on GTK+ extended to all cases.
  • SciTE date formatting on Windows performed with the user setting rather than the system setting.
  • GTK+ 2 redraw while scrolling fixed.
  • Recursive property definitions are safer, avoiding expansion when detected.
  • SciTE thread synchronization for scripts no longer uses HWND_MESSAGE so is compatible with older versions of Windows. Other Lua scripting bugs fixed.
  • SciTE on Windows localization of menu accelerators changed to be compatible with alternative UI themes.
  • SciTE on Windows full screen mode now fits better when menu different height to title bar height.
  • SC_MARK_EMPTY marker is now invisible and does not change the background colour.
  • Bug fixed in HTML lexer to allow use of <?xml in strings in scripts without triggering xml mode.
  • Bug fixed in SciTE abbreviation expansion that could break indentation or crash.
  • Bug fixed when searching for a whole word string that ends one character before end of document.
  • Drawing bug fixed when indicators drawn on wrapped lines.
  • Bug fixed when double clicking a hotspot.
  • Bug fixed where autocompletion would remove typed text if no match found.
  • Bug fixed where display does not scroll when inserting in long wrapped line.
  • Bug fixed where SCI_MARKERDELETEALL would only remove one of the markers on a line that contained multiple markers with the same number.
  • Bug fixed where markers would move when converting line endings.
  • Bug fixed where SCI_LINEENDWRAP would move too far when line ends are visible.
  • Bugs fixed where calltips with unicode or other non-ASCII text would display incorrectly.
  • Bug fixed in determining if at save point after undoing from save point and then performing changes.
  • Bug fixed on GTK+ using unsupported code pages where extraneous text could be drawn.
  • Bug fixed in drag and drop code on Windows where dragging from SciTE to Firefox could hang both applications.
  • Crashing bug fixed on GTK+ when no font allocation succeeds.
  • Crashing bug fixed when autocompleting word longer than 1000 characters.
  • SciTE crashing bug fixed when both Find and Replace dialogs shown by disallowing this situation.

Release 1.61

  • Released on 29 May 2004.
  • Improvements to selection handling on GTK+.
  • SciTE on GTK+ 2.4 uses the improved file chooser which allows file extension filters, multiple selection, and remembers favourite directories.
  • SciTE Load Session and Save Session commands available on GTK+.
  • SciTE lists Lua Startup Script in Options menu when loaded.
  • In SciTE, OnUserListSelection can be implemented in Lua.
  • SciTE on Windows has a context menu on the file tabs.
  • SQL lexer allows '#' comments and optionally '\' quoting inside strings.
  • Mssql lexer improved.
  • AutoIt3 lexer updated.
  • Perl lexer recognizes regular expression use better.
  • Errorlist lexer understands Lua tracebacks and copes with findstr output for file names that end with digits.
  • Drawing of lines on GTK+ improved and made more like Windows without final point.
  • SciTE on GTK+ uses a high resolution window icon.
  • SciTE can be set to warn before loading files larger than a particular size.
  • SciTE Lua scripting bugs fixed included a crashing bug when using an undefined function name that would go before first actual name.
  • SciTE bug fixed where a modified buffer was not saved if it was the last buffer and was not current when the New command used.
  • SciTE monofont mode no longer affects line numbers.
  • Crashing bug in SciTE avoided by not allowing both the Find and Replace dialogs to be visible at one time.
  • Crashing bug in SciTE fixed when Lua scripts were being run concurrently.
  • Bug fixed that caused incorrect line number width in SciTE.
  • PHP folding bug fixed.
  • Regression fixed when setting word characters to not include some of the standard word characters.

Release 1.60

  • Released on 1 May 2004.
  • SciTE can be scripted using the Lua programming language.
  • command.mode is a better way to specify tool command options in SciTE.
  • Continuation markers can be displayed so that you can see which lines are wrapped.
  • Lexer for Gui4Cli language.
  • Lexer for Kix language.
  • Lexer for Specman E language.
  • Lexer for AutoIt3 language.
  • Lexer for APDL language.
  • Lexer for Bash language. Also reasonable for other Unix shells.
  • SciTE can load lexers implemented in external shared libraries.
  • Perl treats "." not as part of an identifier and interprets '/' and '->' correctly in more circumstances.
  • PHP recognizes variables within strings.
  • NSIS has properties "nsis.uservars" and "nsis.ignorecase".
  • MSSQL lexer adds keyword list for operators and stored procedures, defines '(', ')', and ',' as operators and changes some other details.
  • Input method preedit window on GTK+ 2 may support some Asian languages.
  • Platform interface adds an extra platform-specific flag to Font::Create. Used on wxWidgets to choose antialiased text display but may be used for any task that a platform needs.
  • OnBeforeSave method added to Extension interface.
  • Scintilla methods that return strings can be called with a NULL pointer to find out how long the string should be.
  • Visual Studio .NET project file now in VS .NET 2003 format so can not be used directly in VS .NET 2002.
  • Scintilla can be built with GTK+ 2 on Windows.
  • Updated RPM spec for SciTE on GTK+.
  • GTK+ makefile for SciTE allows selection of destination directory, creates destination directories and sets file modes and owners better.
  • Tab indents now go to next tab multiple rather than add tab size.
  • SciTE abbreviations now use the longest possible match rather than the shortest.
  • Autocompletion does not remove prefix when actioned with no choice selected.
  • Autocompletion cancels when moving beyond the start position, not at the start position.
  • SciTE now shows only calltips for functions that match exactly, not those that match as a prefix.
  • SciTE can repair box comment sections where some lines were added without the box comment middle line prefix.
  • Alt+ works in user.shortcuts on Windows.
  • SciTE on GTK+ enables replace in selection for rectangular selections.
  • Key bindings for command.shortcut implemented in a way that doesn't break when the menus are localized.
  • Drawing of background on GTK+ faster as theme drawing disabled.
  • On GTK+, calltips are moved back onto the screen if they extend beyond the screen bounds.
  • On Windows, the Scintilla object is destroyed on WM_NCDESTROY rather than WM_DESTROY which arrives earlier. This fixes some problems when Scintilla was subclassed.
  • The zorder switching feature removed due to number of crashing bugs.
  • Code for XPM images made more robust.
  • Bug fixed with primary selection on GTK+.
  • On GTK+ 2, copied or cut text can still be pasted after the Scintilla widget is destroyed.
  • Styling change not visible problem fixed when line was cached.
  • Bug in SciTE on Windows fixed where clipboard commands stopped working.
  • Crashing bugs in display fixed in line layout cache.
  • Crashing bug may be fixed on AMD64 processor on GTK+.
  • Rare hanging crash fixed in Python lexer.
  • Display bugs fixed with DBCS characters on GTK+.
  • Autocompletion lists on GTK+ 2 are not sorted by the ListModel as the contents are sorted correctly by Scintilla.
  • SciTE fixed to not open extra untitled buffers with check.if.already.open.
  • Sizing bug fixed on GTK+ when window resized while unmapped.
  • Text drawing crashing bug fixed on GTK+ with non-Pango fonts and long strings.
  • Fixed some issues if characters are unsigned.
  • Fixes in NSIS support.

Release 1.59

  • Released on 19 February 2004.
  • SciTE Options and Language menus reduced in length by commenting out some languages. Languages can be enabled by editing the global properties file.
  • Verilog language supported.
  • Lexer for Microsoft dialect of SQL. SciTE properties file available from extras page.
  • Perl lexer disambiguates '/' better.
  • NSIS lexer improved with a lexical class for numbers, option for ignoring case of keywords, and folds only occurring when folding keyword first on line.
  • PowerBasic lexer improved with styles for constants and assembler and folding improvements.
  • On GTK+, input method support only invoked for Asian languages and not European languages as the old European keyboard code works better.
  • Scintilla can be requested to allocate a certain amount and so avoid repeated reallocations and memory inefficiencies. SciTE uses this and so should require less memory.
  • SciTE's "toggle current fold" works when invoked on child line as well as fold header.
  • SciTE output pane scrolling can be set to not scroll back to start after completion of command.
  • SciTE has a $(SessionPath) property.
  • SciTE on Windows can use VK_* codes for keys in user.shortcuts.
  • Stack overwrite bug fixed in SciTE's command to move to the end of a preprocessor conditional.
  • Bug fixed where vertical selection appeared to select a different set of characters then would be used by, for example, a copy.
  • SciTE memory leak fixed in fold state remembering.
  • Bug fixed where changing the style of some text outside the standard StyleNeeded notification would not be visible.
  • On GTK+ 2 g_iconv is used in preference to iconv, as it is provided by GTK+ so should avoid problems finding the iconv library.
  • On GTK+ fixed a style reference count bug.
  • Memory corruption bug fixed with GetSelText.
  • On Windows Scintilla deletes memory on WM_NCDESTROY rather than the earlier WM_DESTROY to avoid problems when the window is subclassed.

Release 1.58

  • Released on 11 January 2004.
  • Method to discover the currently highlighted element in an autocompletion list.
  • On GTK+, the lexers are now included in the scintilla.a library file. This will require changes to the make files of dependent projects.
  • Octave support added alongside related Matlab language and Matlab support improved.
  • VB lexer gains an unterminated string state and 4 sets of keywords.
  • Ruby lexer handles $' correctly.
  • Error line handling improved for FORTRAN compilers from Absoft and Intel.
  • International input enabled on GTK+ 2 although there is no way to choose an input method.
  • MultiplexExtension in SciTE allows multiple extensions to be used at once.
  • Regular expression replace interprets backslash expressions \a, \b, \f, \n, \r, \t, and \v in the replacement value.
  • SciTE Replace dialog displays number of replacements made when Replace All or Replace in Selection performed.
  • Localization files may contain a translation.encoding setting which is used on GTK+ 2 to automatically reencode the translation to UTF-8 so it will be the localized text will be displayed correctly.
  • SciTE on GTK+ implements check.if.already.open.
  • Make files for Mac OS X made more robust.
  • Performance improved in SciTE when switching buffers when there is a rectangular selection.
  • Fixed failure to display some text when wrapped.
  • SciTE crashes from Ctrl+Tab buffer cycling fixed. May still be some rare bugs here.
  • Crash fixed when decoding an error message that appears similar to a Borland error message.
  • Fix to auto-scrolling allows containers to implement enhanced double click selection.
  • Hang fixed in idle word wrap.
  • Crash fixed in hotspot display code..
  • SciTE on Windows Incremental Search no longer moves caret back.
  • SciTE hang fixed when performing a replace with a find string that matched zero length strings such as ".*".
  • SciTE no longer styles the whole file when saving buffer fold state as that was slow.

Release 1.57

  • Released on 27 November 2003.
  • SciTE remembers folding of each buffer.
  • Lexer for Erlang language.
  • Scintilla allows setting the set of white space characters.
  • Scintilla has 'stuttered' page movement commands to first move to top or bottom within current visible lines before scrolling.
  • Scintilla commands for moving to end of words.
  • Incremental line wrap enabled on Windows.
  • SciTE PDF exporter produces output that is more compliant with reader applications, is smaller and allows more configuration. HTML exporter optimizes size of output files.
  • SciTE defines properties PLAT_WINNT and PLAT_WIN95 on the corresponding platforms.
  • SciTE can adjust the line margin width to fit the largest line number. The line.numbers property is split between line.margin.visible and line.margin.width.
  • SciTE on GTK+ allows user defined menu accelerators. Alt can be included in user.shortcuts.
  • SciTE Language menu can have items commented out.
  • SciTE on Windows Go to dialog allows choosing a column number as well as a line number.
  • SciTE on GTK+ make file uses prefix setting more consistently.
  • Bug fixed that caused word wrapping to fail to display all text.
  • Crashing bug fixed in GTK+ version of Scintilla when using GDK fonts and opening autocompletion.
  • Bug fixed in Scintilla SCI_GETSELTEXT where an extra NUL was included at end of returned string
  • Crashing bug fixed in SciTE z-order switching implementation.
  • Hanging bug fixed in Perl lexer.
  • SciTE crashing bug fixed for using 'case' without argument in style definition.

Release 1.56

  • Released on 25 October 2003.
  • Rectangular selection can be performed using the keyboard. Greater programmatic control over rectangular selection. This has caused several changes to key bindings.
  • SciTE Replace In Selection works on rectangular selections.
  • Improved lexer for TeX, new lexer for Metapost and other support for these languages.
  • Lexer for PowerBasic.
  • Lexer for Forth.
  • YAML lexer improved to include error styling.
  • Perl lexer improved to correctly handle more cases.
  • Assembler lexer updated to support single-quote strings and fix some problems.
  • SciTE on Windows can switch between buffers in order of use (z-order) rather than static order.
  • SciTE supports adding an extension for "Open Selected Filename". The openpath setting works on GTK+.
  • SciTE can Export as XML.
  • SciTE $(SelHeight) variable gives a more natural result for empty and whole line selections.
  • Fixes to wrapping problems, such as only first display line being visible in some cases.
  • Fixes to hotspot to only highlight when over the hotspot, only use background colour when set and option to limit hotspots to a single line.
  • Small fixes to FORTRAN lexing and folding.
  • SQL lexer treats single quote strings as a separate class to double quote strings..
  • Scintilla made compatible with expectations of container widget in GTK+ 2.3.
  • Fix to strip out pixmap ID when automatically choosing from an autocompletion list with only one element.
  • SciTE bug fixed where UTF-8 files longer than 128K were gaining more than one BOM.
  • Crashing bug fixed in SciTE on GTK+ where using "Stop Executing" twice leads to all applications exiting.
  • Bug fixed in autocompletion scrolling on GTK+ 2 with a case sensitive list. The ListBox::Sort method is no longer needed or available so platform maintainers should remove it.
  • SciTE check.if.already.open setting removed from GTK+ version as unmaintained.

Release 1.55

  • Released on 25 September 2003.
  • Fix a crashing bug in indicator display in Scintilla.
  • GTK+ version now defaults to building for GTK+ 2 rather than 1.
  • Mingw make file detects compiler version and avoids options that are cause problems for some versions.
  • Large performance improvement on GTK+ 2 for long lines.
  • Incremental line wrap on GTK+.
  • International text entry works much better on GTK+ with particular improvements for Baltic languages and languages that use 'dead' accents. NUL key events such as those generated by some function keys, ignored.
  • Unicode clipboard support on GTK+.
  • Indicator type INDIC_BOX draws a rectangle around the text.
  • Clarion language support.
  • YAML language support.
  • MPT LOG language support.
  • On Windows, SciTE can switch buffers based on activation order rather than buffer number.
  • SciTE save.on.deactivate saves all buffers rather than just the current buffer.
  • Lua lexer handles non-ASCII characters correctly.
  • Error lexer understands Borland errors with pathnames that contain space.
  • On GTK+ 2, autocompletion uses TreeView rather than deprecated CList.
  • SciTE autocompletion removed when expand abbreviation command used.
  • SciTE calltips support overloaded functions.
  • When Save fails in SciTE, choice offered to Save As.
  • SciTE message boxes on Windows may be moved to front when needed.
  • Indicators drawn correctly on wrapped lines.
  • Regular expression search no longer matches characters with high bit set to characters without high bit set.
  • Hang fixed in backwards search in multi byte character documents.
  • Hang fixed in SciTE Mark All command when wrap around turned off.
  • SciTE Incremental Search no longer uses hot keys on Windows.
  • Calltips draw non-ASCII characters correctly rather than as arrows.
  • SciTE crash fixed when going to an error message with empty file name.
  • Bugs fixed in XPM image handling code.

Release 1.54

  • Released on 12 August 2003.
  • SciTE on GTK+ 2.x can display a tab bar.
  • SciTE on Windows provides incremental search.
  • Lexer for PostScript.
  • Lexer for the NSIS scripting language.
  • New lexer for POV-Ray Scene Description Language replaces previous implementation.
  • Lexer for the MMIX Assembler language.
  • Lexer for the Scriptol language.
  • Incompatibility: SQL keywords are specified in lower case rather than upper case. SQL lexer allows double quoted strings.
  • Pascal lexer: character constants that start with '#' understood, '@' only allowed within assembler blocks, '$' can be the start of a number, initial '.' in 0..constant not treated as part of a number, and assembler blocks made more distinctive.
  • Lua lexer allows '.' in keywords. Multi-line strings and comments can be folded.
  • CSS lexer handles multiple psuedoclasses.
  • Properties file folder works for INI file format.
  • Hidden indicator style allows the container to mark text within Scintilla without there being any visual effect.
  • SciTE does not prompt to save changes when the buffer is empty and untitled.
  • Modification notifications caused by SCI_INSERTSTYLEDSTRING now include the contents of the insertion.
  • SCI_MARKERDELETEALL deletes all the markers on a line rather than just the first match.
  • Better handling of 'dead' accents on GTK+ 2 for languages that use accented characters.
  • SciTE now uses value of output.vertical.size property.
  • Crash fixed in SciTE autocompletion on long lines.
  • Crash fixed in SciTE comment command on long lines.
  • Bug fixed with backwards regular expression search skipping every second match.
  • Hang fixed with regular expression replace where both target and replacement were empty.

Release 1.53

  • Released on 16 May 2003.
  • On GTK+ 2, encodings other than ASCII, Latin1, and Unicode are supported for both display and input using iconv.
  • External lexers supported on GTK+/Linux. External lexers must now be explicitly loaded with SCI_LOADLEXERLIBRARY rather than relying upon a naming convention and automatic loading.
  • Support of Lout typesetting language.
  • Support of E-Scripts language used in the POL Ultima Online Emulator.
  • Scrolling and drawing performance on GTK+ enhanced, particularly for GTK+ 2.x with an extra window for the text area avoiding conflicts with the scroll bars.
  • CopyText and CopyRange methods in Scintilla allow container to easily copy to the system clipboard.
  • Line Copy command implemented and bound to Ctrl+Shift+T.
  • Scintilla APIs PositionBefore and PositionAfter can be used to iterate through a document taking into account the encoding and multi-byte characters.
  • C++ folder can fold on the "} else {" line of an if statement by setting fold.at.else property to 1.
  • C++ lexer allows an extra set of keywords.
  • Property names and thus abbreviations may be non-ASCII.
  • Removed attempt to load a file when setting properties that was part of an old scripting experiment.
  • SciTE no longer warns about a file not existing when opening properties files from the Options menu as there is a good chance the user wants to create one.
  • Bug fixed with brace recognition in multi-byte encoded files where a partial character matched a brace byte.
  • More protection against infinite loops or recursion with recursive property definitions.
  • On Windows, cursor will no longer disappear over margins in custom builds when cursor resource not present. The Windows default cursor is displayed instead.
  • load.on.activate fixed in SciTE as was broken in 1.52.

Release 1.52

  • Released on 17 April 2003.
  • Pango font support on GTK+ 2. Unicode input improved on GTK+ 2.
  • Hotspot style implemented in Scintilla.
  • Small up and down arrows can be displayed in calltips and the container is notified when the mouse is clicked on a calltip. Normal and selected calltip text colours can be set.
  • POSIX compatibility flag in Scintilla regular expression search interprets bare ( and ) as tagged sections.
  • Error message lexer tightened to yield fewer false matches. Recognition of Lahey and Intel FORTRAN error formats.
  • Scintilla keyboard commands for moving to start and end of screen lines rather than document lines, unless already there where these keys move to the start or end of the document line.
  • Line joining command.
  • Lexer for POV-Ray.
  • Calltips on Windows are no longer clipped by the parent window.
  • Autocompletion lists are cancelled when focus leaves their parent window.
  • Move to next/previous empty line delimited paragraph key commands.
  • SciTE hang fixed with recursive property definitions by placing limit on number of substitutions performed.
  • SciTE Export as PDF reenabled and works.
  • Added loadsession: command line command to SciTE.
  • SciTE option to quit application when last document closed.
  • SciTE option to ask user if it is OK to reload a file that has been modified outside SciTE.
  • SciTE option to automatically save before running particular command tools or to ask user or to not save.
  • SciTE on Windows 9x will write a Ctrl+Z to the process input pipe before closing the pipe when running tool commands that take input.
  • Added a manifest resource to SciTE on Windows to enable Windows XP themed UI.
  • SciTE calltips handle nested calls and other situations better.
  • CSS lexer improved.
  • Interface to platform layer changed - Surface initialization now requires a WindowID parameter.
  • Bug fixed with drawing or measuring long pieces of text on Windows 9x by truncating the pieces.
  • Bug fixed with SciTE on GTK+ where a user shortcut for a visible character inserted the character as well as executing the command.
  • Bug fixed where primary selection on GTK+ was reset by Scintilla during creation.
  • Bug fixed where SciTE would close immediately on startup when using save.session.
  • Crash fixed when entering '\' in LaTeX file.
  • Hang fixed when '#' last character in VB file.
  • Crash fixed in error message lexer.
  • Crash fixed when searching for long regular expressions.
  • Pressing return when nothing selected in user list sends notification with empty text rather than random text.
  • Mouse debouncing disabled on Windows as it interfered with some mouse utilities.
  • Bug fixed where overstrike mode inserted before rather than replaced last character in document.
  • Bug fixed with syntax highlighting of Japanese text.
  • Bug fixed in split lines function.
  • Cosmetic fix to SciTE tab bar on Windows when window resized. Focus sticks to either pane more consistently.

Release 1.51

  • Released on 16 February 2003.
  • Two phase drawing avoids cutting off text that overlaps runs by drawing all the backgrounds of a line then drawing all the text transparently. Single phase drawing is an option.
  • Scintilla method to split lines at a particular width by adding new line characters.
  • The character used in autocompletion lists to separate the text from the image number can be changed.
  • The scrollbar range will automatically expand when the caret is moved beyond the current range. The scroll bar is updated when SCI_SETXOFFSET is called.
  • Mouse cursors on GTK+ improved to be consistent with other applications and the Windows version.
  • Horizontal scrollbar on GTK+ now disappears in wrapped mode.
  • Scintilla on GTK+ 2: mouse wheel scrolling, cursor over scrollbars, focus, and syntax highlighting now work. gtk_selection_notify avoided for compatibility with GTK+ 2.2.
  • Fold margin colours can now be set.
  • SciTE can be built for GTK+ 2.
  • SciTE can optionally preserve the undo history over an automatic file reload.
  • Tags can optionally be case insensitive in XML and HTML.
  • SciTE on Windows handles input to tool commands in a way that should avoid deadlock. Output from tools can be used to replace the selection.
  • SciTE on GTK+ automatically substitutes '|' for '/' in menu items as '/' is used to define the menu hierarchy.
  • Optional buffer number in SciTE title bar.
  • Crash fixed in SciTE brace matching.
  • Bug fixed where automatic scrolling past end of document flipped back to the beginning.
  • Bug fixed where wrapping caused text to disappear.
  • Bug fixed on Windows where images in autocompletion lists were shown on the wrong item.
  • Crash fixed due to memory bug in autocompletion lists on Windows.
  • Crash fixed when double clicking some error messages.
  • Bug fixed in word part movement where sometimes no movement would occur.
  • Bug fixed on Windows NT where long text runs were truncated by treating NT differently to 9x where there is a limitation.
  • Text in not-changeable style works better but there remain some cases where it is still possible to delete text protected this way.

Release 1.50

  • Released on 24 January 2003.
  • Autocompletion lists may have a per-item pixmap.
  • Autocompletion lists allow Unicode text on Windows.
  • Scintilla documentation rewritten.
  • Additional DBCS encoding support in Scintilla on GTK+ primarily aimed at Japanese EUC encoding.
  • CSS (Cascading Style Sheets) lexer added.
  • diff lexer understands some more formats.
  • Fold box feature is an alternative way to show the structure of code.
  • Avenue lexer supports multiple keyword lists.
  • The caret may now be made invisible by setting the caret width to 0.
  • Python folder attaches comments before blocks to the next block rather than the previous block.
  • SciTE openpath property on Windows searches a path for files that are the subject of the Open Selected Filename command.
  • The localization file name can be changed with the locale.properties property.
  • On Windows, SciTE can pipe the result of a string expression into a command line tool.
  • On Windows, SciTE's Find dialog has a Mark All button.
  • On Windows, there is an Insert Abbreviation command that allows a choice from the defined abbreviations and inserts the selection into the abbreviation at the position of a '|'.
  • Minor fixes to Fortran lexer.
  • fold.html.preprocessor decides whether to fold <? and ?>. Minor improvements to PHP folding.
  • Maximum number of keyword lists allowed increased from 6 to 9.
  • Duplicate line command added with default assignment to Ctrl+D.
  • SciTE sets $(Replacements) to the number of replacements made by the Replace All command. $(CurrentWord) is set to the word before the caret if the caret is at the end of a word.
  • Opening a SciTE session now loads files in remembered order, sets the current file as remembered, and moves the caret to the remembered line.
  • Bugs fixed with printing on Windows where line wrapping was causing some text to not print.
  • Bug fixed with Korean Input Method Editor on Windows.
  • Bugs fixed with line wrap which would sometimes choose different break positions after switching focus away and back.
  • Bug fixed where wheel scrolling had no effect on GTK+ after opening a fold.
  • Bug fixed with file paths containing non-ASCII characters on Windows.
  • Crash fixed with printing on Windows after defining pixmap marker.
  • Crash fixed in makefile lexer when first character on line was '='.
  • Bug fixed where local properties were not always being applied.
  • Ctrl+Keypad* fold command works on GTK+.
  • Hangs fixed in SciTE's Replace All command when replacing regular expressions '^' or '$'.
  • SciTE monospace setting behaves more sensibly.

Release 1.49

  • Released on 1 November 2002.
  • Unicode supported on GTK+. To perform well, this added a font cache to GTK+ and to make that safe, a mutex is used. The mutex requires the application to link in the threading library by evaluating `glib-config --libs gthread`. A Unicode locale should also be set up by a call like setlocale(LC_CTYPE, "en_US.UTF-8"). scintilla_release_resources function added to release mutex.
  • FORTRAN and assembler lexers added along with other support for these languages in SciTE.
  • Ada lexer improved handling of based numbers, identifier validity and attributes distinguished from character literals.
  • Lua lexer handles block comments and a deep level of nesting for literal strings and block comments.
  • Errorlist lexer recognizes PHP error messages.
  • Variant of the C++ lexer with case insensitive keywords called cppnocase. Whitespace in preprocessor text handled more correctly.
  • Folder added for Perl.
  • Compilation with GCC 3.2 supported.
  • Markers can be pixmaps.
  • Lines are wrapped when printing. Bug fixed which printed line numbers in different styles.
  • Text can be appended to end with AppendText method.
  • ChooseCaretX method added.
  • Vertical scroll bar can be turned off with SetVScrollBar method.
  • SciTE Save All command saves all buffers.
  • SciTE localization compares keys case insensitively to make translations more flexible.
  • SciTE detects a utf-8 coding cookie "coding: utf-8" in first two lines and goes into Unicode mode.
  • SciTE key bindings are definable.
  • SciTE Find in Files dialog can display directory browser to choose directory to search.
  • SciTE enabling of undo and redo toolbar buttons improved.
  • SciTE on Windows file type filters in open dialog sorted.
  • Fixed crashing bug when using automatic tag closing in XML or HTML.
  • Fixed bug on Windows causing very long (>64K) lines to not display.
  • Fixed bug in backwards regular expression searching.
  • Fixed bug in calltips where wrong argument was highlighted.
  • Fixed bug in tab timmy feature when file has line feed line endings.
  • Fixed bug in compiling without INCLUDE_DEPRECATED_FEATURES defined.

Release 1.48

  • Released on 9 September 2002.
  • Improved Pascal lexer with context sensitive keywords and separate folder which handles //{ and //} folding comments and {$region} and {$end} folding directives. The "case" statement now folds correctly.
  • C++ lexer correctly handles comments on preprocessor lines.
  • New commands for moving to beginning and end of display lines when in line wrap mode. Key bindings added for these commands.
  • New marker symbols that look like ">>>" and "..." which can be used for interactive shell prompts for Python.
  • The foreground and background colours of visible whitespace can be chosen independent of the colours chosen for the lexical class of that whitespace.
  • Per line data optimized by using an exponential allocation scheme.
  • SciTE API file loading optimized.
  • SciTE for GTK+ subsystem 2 documented. The exit status of commands is decoded into more understandable fields.
  • SciTE find dialog remembers previous find string when there is no selection. Find in Selection button disabled when selection is rectangular as command did not work.
  • Shift+Enter made equivalent to Enter to avoid users having to let go of the shift key when typing. Avoids the possibility of entering single carriage returns in a file that contains CR+LF line ends.
  • Autocompletion does not immediately disappear when the length parameter to SCI_AUTOCSHOW is 0.
  • SciTE focuses on the editor pane when File | New executed and when the output pane is closed with F8. Double clicking on a non-highlighted output pane line selects the word under the cursor rather than seeking the next highlighted line.
  • SciTE director interface implements an "askproperty" command.
  • SciTE's Export as LaTeX output improved.
  • Better choice of autocompletion displaying above the caret rather than below when that is more sensible.
  • Bug fixed where context menu would not be completely visible if invoked when cursor near bottom or left of screen.
  • Crashing bug fixed when displaying long strings on GTK+ caused failure of X server by displaying long text in segments.
  • Crashing bug fixed on GTK+ when a Scintilla window was removed from its parent but was still the selection owner.
  • Bug fixed on Windows in Unicode mode where not all characters on a line were displayed when that line contained some characters not in ASCII.
  • Crashing bug fixed in SciTE on Windows with clearing output while running command.
  • Bug fixed in SciTE for GTK+ with command completion not detected when no output was produced by the command.
  • Bug fixed in SciTE for Windows where menus were not shown translated.
  • Bug fixed where words failed to display in line wrapping mode with visible line ends.
  • Bug fixed in SciTE where files opened from a session file were not closed.
  • Cosmetic flicker fixed when using Ctrl+Up and Ctrl+Down with some caret policies.

Release 1.47

  • Released on 1 August 2002.
  • Support for GTK+ 2 in Scintilla. International input methods not supported on GTK+2.
  • Line wrapping performance improved greatly.
  • New caret policy implementation that treats horizontal and vertical positioning equivalently and independently. Old caret policy methods deprecated and not all options work correctly with old methods.
  • Extra fold points for C, C++, Java, ... for fold comments //{ .. //} and #if / #ifdef .. #endif and the #region .. #endregion feature of C#.
  • Scintilla method to find the height in pixels of a line. Currently returns the same result for every line as all lines are same height.
  • Separate make file, scintilla_vc6.mak, for Scintilla to use Visual C++ version 6 since main makefile now assumes VS .NET. VS .NET project files available for combined Scintilla and SciTE in scite/boundscheck.
  • SciTE automatically recognizes Unicode files based on their Byte Order Marks and switches to Unicode mode. On Windows, where SciTE supports Unicode display, this allows display of non European characters. The file is saved back into the same character encoding unless the user decides to switch using the File | Encoding menu.
  • Handling of character input changed so that a fillup character, typically '(' displays a calltip when an autocompletion list was being displayed.
  • Multiline strings lexed better for C++ and Lua.
  • Regular expressions in JavaScript within hypertext files are lexed better.
  • On Windows, Scintilla exports a function called Scintilla_DirectFunction that can be used the same as the function returned by GetDirectFunction.
  • Scintilla converts line endings of text obtained from the clipboard to the current default line endings.
  • New SciTE property ensure.final.line.end can ensure that saved files always end with a new line as this is required by some tools. The ensure.consistent.line.ends property ensures all line ends are the current default when saving files. The strip.trailing.spaces property now works on the buffer so the buffer in memory and the file on disk are the same after a save is performed.
  • The SciTE expand abbreviation command again allows '|' characters in expansions to be quoted by using '||'.
  • SciTE on Windows can send data to the find tool through standard input rather than using a command line argument to avoid problems with quoting command line arguments.
  • The Stop Executing command in SciTE on Windows improved to send a Ctrl+Z character to the tool. Better messages when stopping a tool.
  • Autocompletion can automatically "fill up" when one of a set of characters is type with the autocomplete.<lexer>.fillups property.
  • New predefined properties in SciTE, SelectionStartColumn, SelectionStartLine, SelectionEndColumn, SelectionEndLine can be used to integrate with other applications.
  • Environment variables are available as properties in SciTE.
  • SciTE on Windows keeps status line more current.
  • Abbreviations work in SciTE on Linux when first opened.
  • File saving fixed in SciTE to ensure files are not closed when they can not be saved because of file permissions. Also fixed a problem with buffers that caused files to not be saved.
  • SciTE bug fixed where monospace mode not remembered when saving files. Some searching options now remembered when switching files.
  • SciTE on Linux now waits on child termination when it shuts a child down to avoid zombies.
  • SciTE on Linux has a Print menu command that defaults to invoking a2ps.
  • Fixed incorrect highlighting of indentation guides in SciTE for Python.
  • Crash fixed in Scintilla when calling GetText for 0 characters.
  • Exporting as LaTeX improved when processing backslashes and tabs and setting up font.
  • Crash fixed in SciTE when exporting or copying as RTF.
  • SciTE session loading fixed to handle more than 10 files in session.

Release 1.46

  • Released on 10 May 2002.
  • Set of lexers compiled into Scintilla can now be changed by adding and removing lexer source files from scintilla/src and running LexGen.py.
  • SCN_ZOOM notification provided by Scintilla when user changes zoom level. Method to determine width of strings in pixels so that elements can be sized relative to text size. SciTE changed to keep line number column displaying a given number of characters.
  • The logical width of the document used to determine scroll bar range can be set.
  • Setting to allow vertical scrolling to display last line at top rather than bottom of window.
  • Read-only mode improved to avoid changing the selection in most cases when a modification is attempted. Drag and drop cursors display correctly for read-only in some cases.
  • Visual C++ options in make files changed to suit Visual Studio .NET.
  • Scintilla.iface includes feature types for enumerations and lexers.
  • Lua lexer improves handling of literal strings and copes with nested literal strings.
  • Diff lexer changed to treat lines starting with "***" similarly to "---". Symbolic names defined for lexical classes.
  • nncrontab lexer improved.
  • Turkish fonts (iso8859-9) supported on GTK+.
  • Automatic close tag feature for XML and HTML in SciTE.
  • Automatic indentation in SciTE improved.
  • Maximum number of buffers available in SciTE increased. May be up to 100 although other restrictions on menu length limit the real maximum.
  • Save a Copy command added to SciTE.
  • Export as TeX command added to SciTE.
  • Export as HTML command in SciTE respects Use Monospaced Font and background colour settings.
  • Compilation problem on Solaris fixed.
  • Order of files displayed for SciTE's previous and next menu and key commands are now consistent.
  • Saving of MRU in recent file changed so files open when SciTE quit are remembered.
  • More variants of ctags tags handled by Open Selected Filename in SciTE.
  • JavaScript embedded in XML highlighted again.
  • SciTE status bar updated after changing parameters in case they are being displayed in status bar.
  • Crash fixed when handling some multi-byte languages.
  • Crash fixed when replacing end of line characters.
  • Bug in SciTE fixed in multiple buffer mode where automatic loading turned on could lead to losing file contents.
  • Bug in SciTE on GTK+ fixed where dismissing dialogs with close box led to those dialogs never being shown again.
  • Bug in SciTE on Windows fixed where position.tile with default positions led to SciTE being positioned off-screen.
  • Bug fixed in read-only mode, clearing all deletes contraction state data leading to it not being synchronized with text.
  • Crash fixed in SciTE on Windows when tab bar displayed.

Release 1.45

  • Released on 15 March 2002.
  • Line layout cache implemented to improve performance by maintaining the positioning of characters on lines. Can be set to cache nothing, the line with the caret, the visible page or the whole document.
  • Support, including a new lexer, added for Matlab programs.
  • Lua folder supports folding {} ranges and compact mode. Lua lexer styles floating point numbers in number style instead of setting the '.' in operator style. Up to 6 sets of keywords. Better support for [[ although only works well when all on one line.
  • Python lexer improved to handle floating point numbers that contain negative exponents and that start with '.'.
  • When performing a rectangular paste, the caret now remains at the insertion point.
  • On Windows with a wheel mouse, page-at-a-time mode is recognized.
  • Read-only mode added to SciTE with a property to initialize it and another property, $(ReadOnly) available to show this mode in the status bar.
  • SciTE status bar can show the number of lines in the selection with the $(SelHeight) property.
  • SciTE's "Export as HTML" command uses the current character set to produce correct output for non-Western-European character sets, such as Russian.
  • SciTE's "Export as RTF" fixed to produce correct output when file contains '\'.
  • SciTE goto command accepts a column as well as a line. If given a column, it selects the word at that column.
  • SciTE's Build, Compile and Go commands are now disabled if no action has been assigned to them.
  • The Refresh button in the status bar has been removed from SciTE on Windows.
  • Bug fixed in line wrap mode where cursor up or down command did not work.
  • Some styling bugs fixed that were due to a compilation problem with gcc and inline functions with same name but different code.
  • The way that lexers loop over text was changed to avoid accessing beyond the end or setting beyond the end. May fix some bugs and make the code safer but may also cause new bugs.
  • Bug fixed in HTML lexer's handling of SGML.
  • Bug fixed on GTK+/X where lines wider than 32767 pixels did not display.
  • SciTE bug fixed with file name generation for standard property files.
  • SciTE bug fixed with Open Selected Filename command when used with file name and line number combination.
  • In SciTE, indentation and tab settings stored with buffers so maintained correctly as buffers selected. The properties used to initialize these settings can now be set separately for different file patterns.
  • Thread safety improved on Windows with a critical section protecting the font cache and initialization of globals performed within Scintilla_RegisterClasses. New Scintilla_ReleaseResources call provided to allow explicit freeing of resources when statically bound into another application. Resources automatically freed in DLL version. The window classes are now unregistered as part of resource freeing which fixes bugs that occurred in some containers such as Internet Explorer.
  • 'make install' fixed on Solaris.
  • Bug fixed that could lead to a file being opened twice in SciTE.

Release 1.44

  • Released on 4 February 2002.
  • Crashing bug fixed in Editor::Paint.
  • Lua lexer no longer treats '.' as a word character and handles 6 keyword sets.
  • WordStartPosition and WordEndPosition take an onlyWordCharacters argument.
  • SciTE option for simplified automatic indentation which repeats the indentation of the previous line.
  • Compilation fix on Alpha because of 64 bit.
  • Compilation fix for static linking.
  • Limited maximum line length handled to 8000 characters as previous value of 16000 was causing stack exhaustion crashes for some.
  • When whole document line selected, only the last display line gets the extra selected rectangle at the right hand side rather than every display line.
  • Caret disappearing bug fixed for the case that the caret was not on the first display line of a document line.
  • SciTE bug fixed where untitled buffer containing text was sometimes deleted without chance to save.
  • SciTE bug fixed where use.monospaced not working with multiple buffers.

Release 1.43

  • Released on 19 January 2002.
  • Line wrapping robustness and performance improved in Scintilla.
  • Line wrapping option added to SciTE for both edit and output panes.
  • Static linking on Windows handles cursor resource better. Documentation of static linking improved.
  • Autocompletion has an option to delete any word characters after the caret upon selecting an item.
  • FOX version identified by PLAT_FOX in Platform.h.
  • Calltips in SciTE use the calltip.<lexer>.word.characters setting to correctly find calltips for functions that include characters like '$' which is not normally considered a word character.
  • SciTE has a command to show help on itself which gets hooked up to displaying SciTEDoc.html.
  • SciTE option calltip.<lexer>.end.definition to display help text on a second line of calltip.
  • Fixed the handling of the Buffers menu on GTK+ to ensure current buffer indicated and no warnings occur. Changed some menu items on GTK+ version to be same as Windows version.
  • use.monospaced property for SciTE determines initial state of Use Monospaced Font setting.
  • The SciTE Complete Symbol command now works when there are no word characters before the caret, even though it is slow to display the whole set of symbols.
  • Function names removed from SciTE's list of PHP keywords. The full list of predefined functions is available from another web site mentioned on the Extras page.
  • Crashing bug at startup on GTK+ for some configurations fixed.
  • Crashing bug on GTK+ on 64 bit platforms fixed.
  • Compilation problem with some compilers fixed in GTK+.
  • Japanese text entry improved on Windows 9x.
  • SciTE recent files directory problem on Windows when HOME and SciTE_HOME environment variables not set is now the directory of the executable.
  • Session files no longer include untitled buffers.

Release 1.42

  • Released on 24 December 2001.
  • Better localization support including context menus and most messages. Translations of the SciTE user interface available for Bulgarian, French, German, Italian, Russian, and Turkish.
  • Can specify a character to use to indicate control characters rather than having them displayed as mnemonics.
  • Scintilla key command for backspace that will not delete line end characters.
  • Scintilla method to find start and end of words.
  • SciTE on GTK+ now supports the load.on.activate and save.on.deactivate properties in an equivalent way to the Windows version.
  • The output pane of SciTE on Windows is now interactive so command line utilities that prompt for input or confirmation can be used.
  • SciTE on Windows can choose directory for a "Find in Files" command like the GTK+ version could.
  • SciTE can now load a set of API files rather than just one file.
  • ElapsedTime class added to Platform for accurate measurement of durations. Used for debugging and for showing the user how long commands take in SciTE.
  • Baan lexer added.
  • In C++ lexer, document comment keywords no longer have to be at the start of the line.
  • PHP lexer changed to match keywords case insensitively.
  • More shell keywords added.
  • SciTE support for VoiceXML added to xml.properties.
  • In SciTE the selection is not copied to the find field of the Search and Replace dialogs if it contains end of line characters.
  • SciTE on Windows has a menu item to decide whether to respond to other instances which are performing their check.if.already.open check.
  • SciTE accelerator key for Box Comment command changed to avoid problems in non-English locales.
  • SciTE context menu includes Close command for the editor pane and Hide command for the output pane.
  • output: command added to SciTE director interface to add text to the output pane. The director interface can execute commands (such as tool commands with subsystem set to 3) by sending a macro:run message.
  • SciTE on GTK+ will defer to the Window Manager for position if position.left or position.top not set and for size if position.width or position.height not set.
  • SciTE on Windows has a position.tile property to place a second instance to the right of the first.
  • Scintilla on Windows again supports EM_GETSEL and EM_SETSEL.
  • Problem fixed in Scintilla on Windows where control ID is no longer cached as it could be changed by external code.
  • Problems fixed in SciTE on Windows when finding any other open instances at start up when check.if.already.open is true.
  • Bugs fixed in SciTE where command strings were not always having variables evaluated.
  • Bugs fixed with displaying partial double-byte and Unicode characters in rectangular selections and at the edge when edge mode is EDGE_BACKGROUND. Column numbers reported by GetColumn treat multiple byte characters as one column rather than counting bytes.
  • Bug fixed with caret movement over folded lines.
  • Another bug fixed with tracking selection in secondary views when performing modifications.
  • Horizontal scrolling and display of long lines optimized.
  • Cursor setting in Scintilla on GTK+ optimized.
  • Experimental changeable style attribute. Set to false to make text read-only. Currently only stops caret from being within not-changeable text and does not yet stop deleting a range that contains not-changeable text. Can be used from SciTE by adding notchangeable to style entries.
  • Experimental line wrapping. Currently has performance and appearance problems.

Release 1.41

  • Released on 6 November 2001.
  • Changed Platform.h to not include platform headers. This lessens likelihood and impact of name clashes from system headers and also speeds up compilation. Renamed DrawText to DrawTextNoClip to avoid name clash.
  • Changed way word functions work to treat a sequence of punctuation as a word. This is more sensible and also more compatible with other editors.
  • Cursor changes over the margins and selection on GTK+ platform.
  • SC_MARK_BACKGROUND is a marker that only changes the line's background colour.
  • Enhanced Visual Basic lexer handles character date and octal literals, and bracketed keywords for VB.NET. There are two VB lexers, vb and vbscript with type indication characters like ! and $ allowed at the end of identifiers in vb but not vbscript. Lexer states now separate from those used for C++ and names start with SCE_B.
  • Lexer added for Bullant language.
  • The horizontal scroll position, xOffset, is now exposed through the API.
  • The SCN_POSCHANGED notification is deprecated as it was causing confusion. Use SCN_UPDATEUI instead.
  • Compilation problems fixed for some versions of gcc.
  • Support for WM_GETTEXT restored on Windows.
  • Double clicking on an autocompletion list entry works on GTK+.
  • Bug fixed with case insensitive sorts for autocompletion lists.
  • Bug fixed with tracking selection in secondary views when performing modifications.
  • SciTE's abbreviation expansion feature will now indent expansions to the current indentation level if indent.automatic is on.
  • SciTE allows setting up of parameters to commands from a dialog and can also show this dialog automatically to prompt for arguments when running a command.
  • SciTE's Language menu (formerly Options | Use Lexer) is now defined by the menu.language property rather than being hardcoded.
  • The user interface of SciTE can be localized to a particular language by editing a locale.properties file.
  • On Windows, SciTE will try to move to the front when opening a new file from the shell and using check.if.already.open.
  • SciTE can display the file name and directory in the title bar in the form "file @ directory" when title.full.path=2.
  • The SciTE time.commands property reports the time taken by a command as well as its status when completed.
  • The SciTE find.files property is now a list separated by '|' characters and this list is added into the Files pull down of the Find in Files dialog.

Release 1.40

  • Released on 23 September 2001.
  • Removal of emulation of Win32 RichEdit control in core of Scintilla. This change may be incompatible with existing client code. Some emulation still done in Windows platform layer.
  • SGML support in the HTML/XML lexer.
  • SciTE's "Stop Executing" command will terminate GUI programs on Windows NT and Windows 2000.
  • StyleContext class helps construct lexers that are simple and accurate. Used in the C++, Eiffel, and Python lexers.
  • Clipboard operations in GTK+ version convert between platform '\n' line endings and currently chosen line endings.
  • Any character in range 0..255 can be used as a marker. This can be used to support numbered bookmarks, for example.
  • The default scripting language for ASP can be set.
  • New lexer and other support for crontab files used with the nncron scheduler.
  • Folding of Python improved.
  • The ` character is treated as a Python operator.
  • Line continuations ("\" at end of line) handled inside Python strings.
  • More consistent handling of line continuation ('\' at end of line) in C++ lexer. This fixes macro definitions that span more than one line.
  • C++ lexer can understand Doxygen keywords in doc comments.
  • SciTE on Windows allows choosing to open the "open" dialog on the directory of the current file rather than in the default directory.
  • SciTE on Windows handles command line arguments in "check.if.already.open" correctly when the current directory of the new instance is different to the already open instance of SciTE.
  • "cwd" command (change working directory) defined for SciTE director interface.
  • SciTE "Export As HTML" produces better, more compliant, and shorter files.
  • SciTE on Windows allows several options for determining default file name for exported files.
  • Automatic indentation of Python in SciTE fixed.
  • Exported HTML can support folding.
  • Bug fixed in SCI_GETTEXT macro command of director interface.
  • Cursor leak fixed on GTK+.
  • During SciTE shutdown, "identity" messages are no longer sent over the director interface.

Release 1.39

  • Released on 22 August 2001.
  • Windows version requires msvcrt.dll to be available so will not work on original Windows 95 version 1. The msvcrt.dll file is installed by almost everything including Internet Explorer so should be available.
  • Flattened tree control style folding margin. The SciTE fold.plus option is now fold.symbols and has more values for the new styles.
  • Mouse dwell events are generated when the user holds the mouse steady over Scintilla.
  • PositionFromPointClose is like PositionFromPoint but returns INVALID_POSITION when point outside window or after end of line.
  • Input of Hungarian and Russian characters in GTK+ version works by truncating input to 8 bits if in the range of normal characters.
  • Better choices for font descriptors on GTK+ for most character sets.
  • GTK+ Scintilla is destroyed upon receiving destroy signal rather than destroy_event signal.
  • Style setting that force upper or lower case text.
  • Case-insensitive autocompletion lists work correctly.
  • Keywords can be prefix based so ^GTK_ will treat all words that start with GTK_ as keywords.
  • Horizontal scrolling can be jumpy rather than gradual.
  • GetSelText places a '\0' in the buffer if the selection is empty..
  • EnsureVisible split into two methods EnsureVisible which will not scroll to show the line and EnsureVisibleEnforcePolicy which may scroll.
  • Python folder has options to fold multi-line comments and triple quoted strings.
  • C++ lexer handles keywords before '.' like "this.x" in Java as keywords. Compact folding mode option chooses whether blank lines after a structure are folded with that structure. Second set of keywords with separate style supported.
  • Ruby lexer handles multi-line comments.
  • VB has folder.
  • PHP lexer has an operator style, handles "<?" and "?>" inside strings and some comments.
  • TCL lexer which is just an alias for the C++ lexer so does not really understand TCL syntax.
  • Error lines lexer has styles for Lua error messages and .NET stack traces.
  • Makefile lexer has a target style.
  • Lua lexer handles some [[]] string literals.
  • HTML and XML lexer have a SCE_H_SGML state for tags that start with "<!".
  • Fixed Scintilla bugs with folding. When modifications were performed near folded regions sometimes no unfolding occurred when it should have. Deleting a fold causing character sometimes failed to update fold information correctly.
  • Better support for Scintilla on GTK+ for Win32 including separate PLAT_GTK_WIN32 definition and correct handling of rectangular selection with clipboard operations.
  • SciTE has a Tools | Switch Pane (Ctrl+F6) command to switch focus between edit and output panes.
  • SciTE option output.scroll allows automatic scrolling of output pane to be turned off.
  • Commands can be typed into the SciTE output pane similar to a shell window.
  • SciTE properties magnification and output magnification set initial zoom levels.
  • Option for SciTE comment block command to place comments at start of line.
  • SciTE for Win32 has an option to minimize to the tray rather than the task bar.
  • Close button on SciTE tool bar for Win32.
  • SciTE compiles with GCC 3.0.
  • SciTE's automatic indentation of C++ handles braces without preceding keyword correctly.
  • Bug fixed with GetLine method writing past the end of where it should.
  • Bug fixed with mouse drag automatic scrolling when some lines were folded.
  • Bug fixed because caret XEven setting was inverted.
  • Bug fixed where caret was initially visible even though window was not focussed.
  • Bug fixed where some file names could end with "\\" which caused slow downs on Windows 9x.
  • On Win32, SciTE Replace dialog starts with focus on replacement text.
  • SciTE Go to dialog displays correct current line.
  • Fixed bug with SciTE opening multiple files at once.
  • Fixed bug with Unicode key values reported to container truncated.
  • Fixed bug with unnecessary save point notifications.
  • Fixed bugs with indenting and unindenting at start of line.
  • Monospace Font setting behaves more consistently.

Release 1.38

  • Released on 23 May 2001.
  • Loadable lexer plugins on Windows.
  • Ruby lexer and support.
  • Lisp lexer and support.
  • Eiffel lexer and support.
  • Modes for better handling of Tab and BackSpace keys within indentation. Mode to avoid autocompletion list cancelling when there are no viable matches.
  • ReplaceTarget replaced with two calls ReplaceTarget (which is incompatible with previous ReplaceTarget) and ReplaceTargetRE. Both of these calls have a count first parameter which allows using strings containing nulls. SearchInTarget and SetSearchFlags functions allow specifying a search in several simple steps which helps some clients which can not create structs or pointers easily.
  • Asian language input through an Input Method Editor works on Windows 2000.
  • On Windows, control characters can be entered through use of the numeric keypad in conjunction with the Alt key.
  • Document memory allocation changed to grow exponentially which reduced time to load a 30 Megabyte file from 1000 seconds to 25. Change means more memory may be used.
  • Word part movement keys now handled in Scintilla rather than SciTE.
  • Regular expression '^' and '$' work more often allowing insertion of text at start or end of line with a replace command. Backslash quoted control characters \a, \b, \f, \t, and \v recognized within sets.
  • Session files for SciTE.
  • Export as PDF command hidden in SciTE as it often failed. Code still present so can be turned on by those willing to cope.
  • Bug fixed in HTML lexer handling % before > as end ASP even when no start ASP encountered. Bug fixed when scripts ended with a quoted string and end tag was not seen.
  • Bug fixed on Windows where context menu key caused menu to appear in corner of screen rather than within window.
  • Bug fixed in SciTE's Replace All command not processing whole file when replace string longer than search string.
  • Bug fixed in SciTE's MRU list repeating entries if Ctrl+Tab used when all entries filled.
  • ConvertEOLs call documentation fixed.

Release 1.37

  • Released on 17 April 2001.
  • Bug fixed with scroll bars being invisible on GTK+ 1.2.9.
  • Scintilla and SciTE support find and replace using simple regular expressions with tagged expressions. SciTE supports C '\' escapes in the Find and Replace dialogs. Replace in Selection available in SciTE.
  • Scintilla has a 'target' feature for replacing code rapidly without causing display updates.
  • Scintilla and SciTE on GTK+ support file dropping from file managers such as Nautilus and gmc. Files or other URIs dropped on Scintilla result in a URIDropped notification.
  • Lexers may have separate Lex and Fold functions.
  • Lexer infrastructure improved to allow for plug in lexers and for referring to lexers by name rather than by ID.
  • Ada lexer and support added.
  • Option in both Scintilla and SciTE to treat both left and right margin as equally important when repositioning visible area in response to caret movement. Default is to prefer visible area positioning which minimizes the horizontal scroll position thus favouring the left margin.
  • Caret line highlighting.
  • Commands to delete from the caret to the end of line and from the caret to the beginning of line.
  • SciTE has commands for inserting and removing block comments and for inserting stream comments.
  • SciTE Director interface uses C++ '\' escapes to send control characters.
  • SciTE Director interface adds more commands including support for macros.
  • SciTE has menu options for recording and playing macros which are visible when used with a companion program that supports these features.
  • SciTE has an Expand Abbreviation command. Abbreviations are stored in a global abbrev.properties file.
  • SciTE has a Full Screen command to switch between a normal window size and using the full screen. On Windows, the menu bar can be turned off when in full screen mode.
  • SciTE has a Use monospaced font command to switch between the normal set of fonts and one size of a particular fixed width font.
  • SciTE's use of tabs can be controlled for particular file names as well as globally.
  • The contents of SciTE's status bar can be defined by a property and include variables. On Windows, several status bar definitions can be active with a click on the status bar cycling through them.
  • Copy as RTF command in SciTE on Windows to allow pasting styled text into word processors.
  • SciTE can allow the use of non-alphabetic characters in Complete Symbol lists and can automatically display this autocompletion list when a trigger character such as '.' is typed. Complete word can be set to pop up when the user is typing a word and there is only one matching word in the document.
  • SciTE lists the imported properties files on a menu to allow rapid access to them.
  • SciTE on GTK+ improvements to handling accelerator keys and focus in dialogs. Message boxes respond to key presses without the Alt key as they have no text entries to accept normal keystrokes.
  • SciTE on GTK+ sets the application icon.
  • SciTE allows setting the colours used to indicate the current error line.
  • Variables within PHP strings have own style. Keyword list updated.
  • Keyword list for Lua updated for Lua 4.0.
  • Bug fixed in rectangular selection where rectangle still appeared selected after using cursor keys to move caret.
  • Bug fixed in C++ lexer when deleting a '{' controlling a folded range led to that range becoming permanently invisible.
  • Bug fixed in Batch lexer where comments were not recognized.
  • Bug fixed with undo actions coalescing into steps incorrectly.
  • Bug fixed with Scintilla on GTK+ positioning scroll bars 1 pixel over the Scintilla window leading to their sides being chopped off.
  • Bugs fixed in SciTE when doing some actions led to the start or end of the file being displayed rather than the current location.
  • Appearance of calltips fixed to look like document text including any zoom factor. Positioned to be outside current line even when multiple fonts and sizes used.
  • Bug fixed in Scintilla macro support where typing Enter caused both a newline command and newline character insertion to be recorded.
  • Bug fixed in SciTE on GTK+ where focus was moving between widgets incorrectly.
  • Bug fixed with fold symbols sometimes not updating when the text changed.
  • Bugs fixed in SciTE's handling of folding commands.
  • Deprecated undo collection enumeration removed from API.

Release 1.36

  • Released on 1 March 2001.
  • Scintilla supports GTK+ on Win32.
  • Some untested work on making Scintilla and SciTE 64 bit compatible. For users on GTK+ this requires including Scintilla.h before ScintillaWidget.h.
  • HTML lexer allows folding HTML.
  • New lexer for Avenue files which are used in the ESRI ArcView GIS.
  • DOS Batch file lexer has states for '@', external commands, variables and operators.
  • C++ lexer can fold comments of /* .. */ form.
  • Better disabling of pop up menu items in Scintilla when in read-only mode.
  • Starting to move to Doxygen compatible commenting.
  • Director interface on Windows enables another application to control SciTE.
  • Opening SciTE on Windows 9x sped up greatly for some cases.
  • The command.build.directory property allows SciTE to run the build command in a different directory to the source files.
  • SciTE on Windows allows setting foreground and background colours for printed headers and footers.
  • Bug fixed in finding calltips in SciTE which led to no calltips for some identifiers.
  • Documentation added for lexers and for the extension and director interfaces.
  • SciTE menus rearranged with new View menu taking over some of the items that were under the Options menu. Clear All Bookmarks command added.
  • Clear Output command in SciTE.
  • SciTE on Windows gains an Always On Top command.
  • Bug fixed in SciTE with attempts to define properties recursively.
  • Bug fixed in SciTE properties where only one level of substitution was done.
  • Bug fixed in SciTE properties where extensions were not being matched in a case insensitive manner.
  • Bug fixed in SciTE on Windows where the Go to dialog displays the correct line number.
  • In SciTE, if fold.on.open set then switching buffers also performs fold.
  • Bug fixed in Scintilla where ensuring a line was visible in the presence of folding operated on the document line instead of the visible line.
  • SciTE command line processing modified to operate on arguments in order and in two phases. First any arguments before the first file name are processed, then the UI is opened, then the remaining arguments are processed. Actions defined for the Director interface (currently only "open") may also be used on the command line. For example, "SciTE -open:x.txt" will start SciTE and open x.txt.
  • Numbered menu items SciTE's Buffers menu and the Most Recently Used portion of the File menu go from 1..0 rather than 0..9.
  • The tab bar in SciTE for Windows has numbers. The tab.hide.one option hides the tab bar until there is more than one buffer open.

Release 1.35

  • Released on 29 January 2001.
  • Rewritten and simplified widget code for the GTK+ version to enhance solidity and make more fully compliant with platform norms. This includes more normal handling of keystrokes so they are forwarded to containers correctly.
  • User defined lists can be shown.
  • Many fixes to the Perl lexer.
  • Pascal lexer handles comments more correctly.
  • C/C++/Java/JavaScript lexer has a state for line doc comments.
  • Error output lexer understands Sun CC messages.
  • Make file lexer has variable, preprocessor, and operator states.
  • Wider area given to an italics character that is at the end of a line to prevent it being cut off.
  • Call to move the caret inside the currently visible area.
  • Paste Rectangular will space fill on the left hand side of the pasted text as needed to ensure it is kept rectangular.
  • Cut and Paste Rectangular does nothing in read-only mode.
  • Undo batching changed so that a paste followed by typing creates two undo actions..
  • A "visibility policy" setting for Scintilla determines which range of lines are displayed when a particular line is moved to. Also exposed as a property in SciTE.
  • SciTE command line allows property settings.
  • SciTE has a View Output command to hide or show the output pane.
  • SciTE's Edit menu has been split in two with searching commands moved to a new Search menu. Find Previous and Previous Bookmark are in the Search menu.
  • SciTE on Windows has options for setting print margins, headers and footers.
  • SciTE on Windows has tooltips for toolbar.
  • SciTE on GTK+ has properties for setting size of file selector.
  • Visual and audio cues in SciTE on Windows enhanced.
  • Fixed performance problem in SciTE for GTK+ by dropping the extra 3D effect on the content windows.
  • Fixed problem in SciTE where choosing a specific lexer then meant that no lexer was chosen when files opened.
  • Default selection colour changed to be visible on low colour displays.
  • Fixed problems with automatically reloading changed documents in SciTE on Windows.
  • Fixed problem with uppercase file extensions in SciTE.
  • Fixed some problems when using characters >= 128, some of which were being incorrectly treated as spaces.
  • Fixed handling multiple line tags, non-inline scripts, and XML end tags /> in HTML/XML lexer.
  • Bookmarks in SciTE no longer disappear when switching between buffers.

Release 1.34

  • Released on 28 November 2000.
  • Pascal lexer.
  • Export as PDF in SciTE.
  • Support for the OpenVMS operating system in SciTE.
  • SciTE for GTK+ can check for another instance of SciTE editing a file and switch to it rather than open a second instance on one file.
  • Fixes to quoting and here documents in the Perl lexer.
  • SciTE on Windows can give extra visual and audio cues when a warning is shown or find restarts from beginning of file.
  • Open Selected Filename command in SciTE. Also understands some warning message formats.
  • Wider area for line numbers when printing.
  • Better scrolling performance on GTK+.
  • Fixed problem where rectangles with negative coordinates were invalidated leading to trouble with platforms that use unsigned coordinates.
  • GTK+ Scintilla uses more compliant signalling code so that keyboard events should propagate to containers.
  • Bug fixed with opening full or partial paths.
  • Improved handling of paths in error messages in SciTE.
  • Better handling of F6 in SciTE.

Release 1.33

  • Released on 6 November 2000.
  • XIM support for the GTK+ version of Scintilla ensures that more non-English characters can be typed.
  • Caret may be 1, 2, or 3 pixels wide.
  • Cursor may be switched to wait image during lengthy processing.
  • Scintilla's internal focus flag is exposed for clients where focus is handled in complex ways.
  • Error status defined for Scintilla to hold indication that an operation failed and the reason for that failure. No detection yet implemented but clients may start using the interface so as to be ready for when it does.
  • Context sensitive help in SciTE.
  • CurrentWord property available in SciTE holding the value of the word the caret is within or near.
  • Apache CONF file lexer.
  • Changes to Python lexer to allow 'as' as a context sensitive keyword and the string forms starting with u, r, and ur to be recognized.
  • SCN_POSCHANGED notification now working and SCN_PAINTED notification added.
  • Word part movement commands for cursoring between the parts of reallyLongCamelIdentifiers and other_ways_of_making_words.
  • When text on only one line is selected, Shift+Tab moves to the previous tab stop.
  • Tab control available for Windows version of SciTE listing all the buffers and making it easy to switch between them.
  • SciTE can be set to automatically determine the line ending type from the contents of a file when it is opened.
  • Dialogs in GTK+ version of SciTE made more modal and have accelerator keys.
  • Find in Files command in GTK+ version of SciTE allows choice of directory.
  • On Windows, multiple files can be opened at once.
  • SciTE source broken up into more files.
  • Scintilla headers made safe for C language, not just C++.
  • New printing modes - force background to white and force default background to white.
  • Automatic unfolding not occurring when Enter pressed at end of line bug fixed.
  • Bugs fixed in line selection.
  • Bug fixed with escapes in PHP strings in the HTML lexer.
  • Bug fixed in SciTE for GTK+ opening files when given full paths.
  • Bug fixed in autocompletion where user backspaces into existing text.
  • Bugs fixed in opening files and ensuring they are saved before running. A case bug also fixed here.

Release 1.32

  • Released on 8 September 2000.
  • Fixes bugs in complete word and related code. Protection against a bug when receiving a bad argument.

Release 1.31

  • Released on 6 September 2000.
  • Scintilla is available as a COM control from the scintillactrl module in CVS.
  • Style setting to underline text. Exposed in SciTE as "underlined".
  • Style setting to make text invisible.
  • SciTE has an extensibility interface that can be used to implement features such as a scripting language or remote control. An example use of this is the extlua module available from CVS which allows SciTE to be scripted in Lua.
  • Many minor fixes to all of the lexers.
  • New lexer for diff and patch files.
  • Error message lexer understands Perl error messages.
  • C/C++/Java lexer now supports C#, specifically verbatim strings and @ quoting of identifiers that are the same as keywords. SciTE has a set of keywords for C# and a build command set up for C#.
  • Scintilla property to see whether in overtype or insert state.
  • PosChanged notification fired when caret moved.
  • Comboboxes in dialogs in SciTE on Windows can be horizontally scrolled.
  • Autocompletion and calltips can treat the document as case sensitive or case insensitive.
  • Autocompletion can be set to automatically choose the only element in a single element list.
  • Set of characters that automatically complete an autocompletion list can be set.
  • SciTE command to display calltip - useful when dropped because of editing.
  • SciTE has a Revert command to go back to the last saved version.
  • SciTE has an Export as RTF command. Save as HTML is renamed to Export as HTML and is located on the Export sub menu.
  • SciTE command "Complete Word" searches document for any words starting with characters before caret.
  • SciTE options for changing aspects of the formatting of files exported as HTML or RTF.
  • SciTE "character.set" option for choosing the character set for all fonts.
  • SciTE has a "Toggle all folds" command.
  • The makefiles have changed. The makefile_vc and makefile_bor files in scintilla/win32 and scite/win32 have been merged into scintilla/win32/scintilla.mak and scite/win32/scite.mak. DEBUG may be defined for all make files and this will turn on assertions and for some make files will choose other debugging options.
  • To make debugging easier and allow good use of BoundsChecker there is a Visual C++ project file in scite/boundscheck that builds all of Scintilla and SciTE into one executable.
  • The size of the SciTE output window can be set with the output.horizontal.size and output.vertical.size settings.
  • SciTE status bar indicator for insert or overwrite mode.
  • Performance improvements to autocompletion and calltips.
  • A caret redraw problem when undoing is fixed.
  • Crash with long lines fixed.
  • Bug fixed with merging markers when lines merged.

Release 1.30

  • Released on 26 July 2000.
  • Much better support for PHP which is now an integral part of the HTML support.
  • Start replacement of Windows-specific APIs with cross platform APIs. In 1.30, the new APIs are introduced but the old APIs are still available. For the GTK+ version, may have to include "WinDefs.h" explicitly to use the old APIs.
  • "if" and "import" statements in SciTE properties files allows modularization into language-specific properties files and choices based upon platform. This means that SciTE is delivered with 9 language-specific properties files as well as the standard SciTEGlobal.properties file.
  • Much lower resource usage on Windows 9x.
  • "/p" option in SciTE on Windows for printing a file and then exiting.
  • Options for printing with inverted brightness (when the screen is set to use a dark background) and to force black on white printing.
  • Option for printing magnified or miniaturized from screen settings.
  • In SciTE, Ctrl+F3 and Ctrl+Shift+F3 find the selection in the forwards and backwards directions respectively.
  • Auto-completion lists may be set to cancel when the cursor goes before its start position or before the start of string being completed.
  • Auto-completion lists automatically size more sensibly.
  • SCI_CLEARDOCUMENTSTYLE zeroes all style bytes, ensures all lines are shown and deletes all folding information.
  • On Windows, auto-completion lists are visually outdented rather than indented.
  • Close all command in SciTE.
  • On Windows multiple files can be dragged into SciTE.
  • When saving a file, the SciTE option save.deletes.first deletes it before doing the save. This allows saving with a different capitalization on Windows.
  • When use tabs option is off pressing the tab key inserts spaces.
  • Bug in indicators leading to extra line drawn fixed.

Release 1.28

  • Released on 27 June 2000.
  • Fixes crash in indentation guides when indent size set to 0.
  • Fixes to installation on GTK+/Linux. User properties file on GTK+ has a dot at front of name: .SciTEUser.properties. Global properties file location configurable at compile time defaulting to $prefix/share/scite. $prefix determined from Gnome if present else its /usr/local and can be overridden by installer. Gnome menu integration performed in make install if Gnome present.

Release 1.27

  • Released on 23 June 2000.
  • Indentation guides. View whitespace mode may be set to not display whitespace in indentation.
  • Set methods have corresponding gets for UndoCollection, BufferedDraw, CodePage, UsePalette, ReadOnly, CaretFore, and ModEventMask.
  • Caret is continuously on rather than blinking while typing or holding down delete or backspace. And is now always shown if non blinking when focused on GTK+.
  • Bug fixed in SciTE with file extension comparison now done in case insensitive way.
  • Bugs fixed in SciTE's file path handling on Windows.
  • Bug fixed with preprocessor '#' last visible character causing hang.

Release 1.26

  • Released on 13 June 2000.
  • Support for the Lua language in both Scintilla and SciTE.
  • Multiple buffers may be open in SciTE.
  • Each style may have a character set configured. This may determine the characters that are displayed by the style.
  • In the C++ lexer, lexing of preprocessor source may either treat it all as being in the preprocessor class or only the initial # and preprocessor command word as being in the preprocessor class.
  • Scintilla provides SCI_CREATEDOCUMENT, SCI_ADDREFDOCUMENT, and SCI_RELEASEDOCUMENT to make it easier for a container to deal with multiple documents.
  • GTK+ specific definitions in Scintilla.h were removed to ScintillaWidget.h. All GTK+ clients will need to #include "ScintillaWidget.h".
  • For GTK+, tools can be executed in the background by setting subsystem to 2.
  • Keys in the properties files are now case sensitive. This leads to a performance increase.
  • Menu to choose which lexer to use on a file.
  • Tab size dialog on Windows.
  • File dialogs enlarged on GTK+.
  • Match Brace command bound to Ctrl+E on both platforms with Ctrl+] a synonym on Windows. Ctrl+Shift+E is select to matching brace. Brace matching tries to match to either the inside or the outside, depending on whether the cursor is inside or outside the braces initially. View End of Line bound to Ctrl+Shift+O.
  • The Home key may be bound to move the caret to either the start of the line or the start of the text on the line.
  • Visual C++ project file for SciTE.
  • Bug fixed with current x location after Tab key.
  • Bug fixed with hiding fold margin by setting fold.margin.width to 0.
  • Bugs fixed with file name confusion on Windows when long and short names used, or different capitalizations, or relative paths.

Release 1.25

  • Released on 9 May 2000.
  • Some Unicode support on Windows. Treats buffer and API as UTF-8 and displays through UCS-2 of Windows.
  • Automatic indentation. Indentation size can be different to tab size.
  • Tool bar.
  • Status bar now on Windows as well as GTK+.
  • Input fields in Find and Replace dialogs now have history on both Windows and GTK+.
  • Auto completion list items may be separated by a chosen character to allow spaces in items. The selected item may be changed through the API.
  • Horizontal scrollbar can be turned off.
  • Property to remove trailing spaces when saving file.
  • On Windows, changed font size calculation to be more compatible with other applications.
  • On GTK+, SciTE's global properties files are looked for in the directory specified in the SCITE_HOME environment variable if it is set. This allows hiding in a dot directory.
  • Keyword lists in SciTE updated for JavaScript to include those destined to be used in the future. IDL includes XPIDL keywords as well as MSIDL keywords.
  • Zoom level can be set and queried through API.
  • New notification sent before insertions and deletions.
  • LaTeX lexer.
  • Fixes to folding including when deletions and additions are performed.
  • Fix for crash with very long lines.
  • Fix to affect all of rectangular selections with deletion and case changing.
  • Removed non-working messages that had been included only for Richedit compatibility.

Release 1.24

  • Released on 29 March 2000.
  • Added lexing of IDL based on C++ lexer with extra UUID lexical class.
  • Functions and associated keys for Line Delete, Line Cut, Line Transpose, Selection Lower Case and Selection Upper Case.
  • Property setting for SciTE, eol.mode, chooses initial state of line end characters.
  • Fixed bugs in undo history with small almost-contiguous changes being incorrectly coalesced.
  • Fixed bugs with incorrect expansion of ContractionState data structures causing crash.
  • Fixed bugs relating to null fonts.
  • Fixed bugs where recolourization was not done sometimes when required.
  • Fixed compilation problems with SVector.h.
  • Fixed bad setting of fold points in Python.

Release 1.23

  • Released on 21 March 2000.
  • Directory structure to separate on basis of product (Scintilla, SciTE, DMApp) and environment (Cross-platform, Win32, GTK+).
  • Download packaging to allow download of the source or platform dependent executables.
  • Source code now available from CVS at SourceForge.
  • Very simple Windows-only demonstration application DMApp is available from cvs as dmapp.
  • Lexing functionality may optionally be included in Scintilla rather than be provided by the container.
  • Set of lexers included is determined at link time by defining which of the Lex* object files are linked in.
  • On Windows, the SciLexer.DLL extends Scintilla.DLL with the standard lexers.
  • Enhanced HTML lexer styles embedded VBScript and Python. ASP segments are styled and ASP scripts in JavaScript, VBScript and Python are styled.
  • PLSQL and PHP supported.
  • Maximum number of lexical states extended to 128.
  • Lexers may store per line parse state for multiple line features such as ASP script language choice.
  • Lexing API simplified.
  • Project file for Visual C++.
  • Can now cycle through all recent files with Ctrl+Tab in SciTE.
  • Bookmarks in SciTE.
  • Drag and drop copy works when dragging to the edge of the selection.
  • Fixed bug with value sizes in properties file.
  • Fixed bug with last line in properties file not being used.
  • Bug with multiple views of one document fixed.
  • Keypad now works on GTK+.

Release 1.22

  • Released on 27 February 2000.
  • wxWindows platform defined. Implementation for wxWindows will be available separately from main Scintilla distribution.
  • Line folding in Scintilla.
  • SciTE performs syntax directed folding for C/C++/Java/JavaScript and for Python.
  • Optional macro recording support.
  • User properties file (SciTEUser.properties) allows for customization by the user that is not overwritten with each installation of SciTE.
  • Python lexer detects and highlights inconsistent indentation.
  • Margin API made more orthogonal. SCI_SETMARGINWIDTH and SCI_SETLINENUMBERWIDTH are deprecated in favour of this new API.
  • Margins may be made sensitive to forward mouse click events to container.
  • SQL lexer and styles included.
  • Perl lexer handles regular expressions better.
  • Caret policy determines how closely caret is tracked by visible area.
  • New marker shapes: arrow pointing down, plus and minus.
  • Optionally display full path in title rather than just file name.
  • Container is notified when Scintilla gains or loses focus.
  • SciTE handles focus in a more standard way and applies the main edit commands to the focused pane.
  • Container is notified when Scintilla determines that a line needs to be made visible.
  • Document watchers receive notification when document about to be deleted.
  • Document interface allows access to list of watchers.
  • Line end determined correctly for lines ending with only a '\n'.
  • Search variant that searches form current selection and sets selection.
  • SciTE understands format of diagnostic messages from WScript.
  • SciTE remembers top line of window for each file in MRU list so switching to a recent file is more likely to show the same text as when the file was previously visible.
  • Document reference count now initialized correctly.
  • Setting a null document pointer creates an empty document.
  • WM_GETTEXT can no longer overrun buffer.
  • Polygon drawing bug fixed on GTK+.
  • Java and JavaScript lexers merged into C++ lexer.
  • C++ lexer indicates unterminated strings by colouring the end of the line rather than changing the rest of the file to string style. This is less obtrusive and helps the folding.

Release 1.21

  • Released on 2 February 2000.
  • Blank margins on left and right side of text.
  • SCN_CHECKBRACE renamed SCN_UPDATEUI and made more efficient.
  • SciTE source code refactored into platform independent and platform specific classes.
  • XML and Perl subset lexers in SciTE.
  • Large improvement to lexing speed.
  • A new subsystem, 2, allows use of ShellExec on Windows.
  • Borland compatible makefile.
  • Status bar showing caret position in GTK+ version of SciTE.
  • Bug fixes to selection drawing when part of selection outside window, mouse release over scroll bars, and scroll positioning after deletion.

Release 1.2

  • Released on 21 January 2000.
  • Multiple views of one document.
  • Rectangular selection, cut, copy, paste, drag and drop.
  • Long line indication.
  • Reverse searching
  • Line end conversion.
  • Generic autocompletion and calltips in SciTE.
  • Call tip background colour can be set.
  • SCI_MARKERPREV for moving to a previous marker.
  • Caret kept more within window where possible.

Release 1.15

  • Released on 15 December 1999.
  • Brace highlighting and badlighting (for mismatched braces).
  • Visible line ends.
  • Multiple line call tips.
  • Printing now works from SciTE on Windows.
  • SciTE has a global "*" lexer style that is used as the basis for all the lexers' styles.
  • Fixes some warnings on GTK+ 1.2.6.
  • Better handling of modal dialogs on GTK+.
  • Resize handle drawn on pane splitter in SciTE on GTK+ so it looks more like a regular GTK+ *paned widget.
  • SciTE does not place window origin offscreen if no properties file found on GTK+.
  • File open filter remembered in SciTE on Windows.
  • New mechanism using style numbers 32 to 36 standardizes the setting of styles for brace highlighting, brace badlighting, line numbers, control characters and the default style.
  • Old messages SCI_SETFORE .. SCI_SETFONT have been replaced by the default style 32. The old messages are deprecated and will disappear in a future version.

Release 1.14

  • Released on 20 November 1999.
  • Fixes a scrolling bug reported on GTK+.

Release 1.13

  • Released on 18 November 1999.
  • Fixes compilation problems with the mingw32 GCC 2.95.2 on Windows.
  • Control characters are now visible.
  • Performance has improved, particularly for scrolling.
  • Windows RichEdit emulation is more accurate. This may break client code that uses these messages: EM_GETLINE, EM_GETLINECOUNT, EM_EXGETSEL, EM_EXSETSEL, EM_EXLINEFROMCHAR, EM_LINELENGTH, EM_LINEINDEX, EM_CHARFROMPOS, EM_POSFROMCHAR, and EM_GETTEXTRANGE.
  • Menus rearranged and accelerator keys set for all static items.
  • Placement of space indicators in view whitespace mode is more accurate with some fonts.

Release 1.12

  • Released on 9 November 1999.
  • Packaging error in 1.11 meant that the compilation error was not fixed in that release. Linux/GTK+ should compile with GCC 2.95 this time.

Release 1.11

  • Released on 7 November 1999.
  • Fixed a compilation bug in ScintillaGTK.cxx.
  • Added a README file to explain how to build.
  • GTK+/Linux downloads now include documentation.
  • Binary only Sc1.EXE one file download for Windows.

Release 1.1

  • Released on 6 November 1999.
  • Major restructuring for better modularity and platform independence.
  • Inter-application drag and drop.
  • Printing support in Scintilla on Windows.
  • Styles can select colouring to end of line. This can be used when a file contains more than one language to differentiate between the areas in each language. An example is the HTML + JavaScript styling in SciTE.
  • Actions can be grouped in the undo stack, so they will be undone together. This grouping is hierarchical so higher level actions such as replace all can be undone in one go. Call to discover whether there are any actions to redo.
  • The set of characters that define words can be changed.
  • Markers now have identifiers and can be found and deleted by their identifier. The empty marker type can be used to make a marker that is invisible and which is only used to trace where a particular line moves to.
  • Double click notification.
  • HTML styling in SciTE also styles embedded JavaScript.
  • Additional tool commands can be added to SciTE.
  • SciTE option to allow reloading if changed upon application activation and saving on application deactivation. Not yet working on GTK+ version.
  • Entry fields in search dialogs remember last 10 user entries. Not working in all cases in Windows version.
  • SciTE can save a styled copy of the current file in HTML format. As SciTE does not yet support printing, this can be used to print a file by then using a browser to print the HTML file.

Release 1.02

  • Released on 1 October 1999.
  • GTK+ version compiles with GCC 2.95.
  • Properly deleting objects when window destroyed under GTK+.
  • If the selection is not empty backspace deletes the selection.
  • Some X style middle mouse button handling for copying the primary selection to and from Scintilla. Does not work in all cases.
  • HTML styling in SciTE.
  • Stopped dirty flag being set in SciTE when results pane modified.

Release 1.01

  • Released on 28 September 1999.
  • Better DBCS support on Windows including IME.
  • Wheel mouse support for scrolling and zooming on Windows. Zooming with Ctrl+KeypadPlus and Ctrl+KeypadMinus.
  • Performance improvements especially on GTK+.
  • Caret blinking and settable colour on both GTK+ and Windows.
  • Drag and drop within a Scintilla window. On Windows, files can be dragged into SciTE.

Release 1.0

  • Released on 17 May 1999.
  • Changed name of "Tide" to "SciTE" to avoid clash with a TCL based IDE. "SciTE" is a SCIntilla based Text Editor and is Latin meaning something like "understanding in a neat way" and is also an Old English version of the word "shit".
  • There is a SCI_AUTOCSTOPS message for defining a string of characters that will stop autocompletion mode. Autocompletion mode is cancelled when any cursor movement occurs apart from backspace.
  • GTK+ version now splits horizontally as well as vertically and all dialogs cancel when the escape key is pressed.

Beta release 0.93

  • Released on 12 May 1999.
  • A bit more robust than 0.92 and supports SCI_MARKERNEXT message.

Beta release 0.92

  • Released on 11 May 1999.
  • GTK+ version now contains all features of Windows version with some very small differences. Executing programs works much better now.
  • New palette code to allow more colours to be displayed in 256 colour screen modes. A line number column can be displayed to the left of the selection margin.
  • The code that maps from line numbers to text positions and back has been completely rewritten to be faster, and to allow markers to move with the text.

Beta release 0.91

  • Released on 30 April 1999, containing fixes to text measuring to make Scintilla work better with bitmap fonts. Also some small fixes to make compiling work with Visual C++.

Beta release 0.90

  • Released on 29 April 1999, containing working GTK+/Linux version.
  • The Java, C++ and Python lexers recognize operators as distinct from default allowing them to be highlighted.

Beta release 0.82

  • Released on 1 April 1999, to fix a problem with handling the Enter key in PythonWin. Also fixes some problems with cmd key mapping.

Beta release 0.81

  • Released on 30th March 1999, containing bug fixes and a few more features.
  • Static linking supported and Tidy.EXE, a statically linked version of Tide.EXE. Changes to compiler flags in the makefiles to optimize for size.
  • Scintilla supports a 'savepoint' in the undo stack which can be set by the container when the document is saved. Notifications are sent to the container when the savepoint is entered or left, allowing the container to display a dirty indicator and change its menus.
  • When Scintilla is set to read-only mode, a notification is sent to the container should the user try to edit the document. This can be used to check the document out of a version control system.
  • There is an API for setting the appearance of indicators.
  • The keyboard mapping can be redefined or removed so it can be implemented completely by the container. All of the keyboard commands are now commands which can be sent by the container.
  • A home command like Visual C++ with one hit going to the start of the text on the line and the next going to the left margin is available. I do not personally like this but my fingers have become trained to it by much repetition.
  • SCI_MARKERDELETEALL has an argument in wParam which is the number of the type marker to delete with -1 performing the old action of removing all marker types.
  • Tide now understands both the file name and line numbers in error messages in most cases.
  • Tide remembers the current lines of files in the recently used list.
  • Tide has a Find in Files command.

Beta release 0.80

  • This was the first public release on 14th March 1999, containing a mostly working Win32 Scintilla DLL and Tide EXE.

Beta releases of SciTE were called Tide

lexilla/doc/LexillaLogo2x.png0000664000175000017500000013020614647367374015141 0ustar neilneilPNG  IHDR ,_}8MIDATxg]U7ҤJ,Et>* *3ꀎ XFG;V($B% [69Y{}x]Y{u^ո|αi{Wէ)c}vff%s1W z#FLz63j_?Vxȧԛ󛙋F[|+S?TϽbng'J;R~n2iWkqQVviP[x1-=^cjKGLv\F=:3]Fk3;BjH'3Ϩ=;-ZW&T]jpMf?{{x3He~}3TcZ;9oQSZ1昷C|1K!F[ 8+)ǟ"iKkG}9{+iiznj4!I}[6Iڰv ֯Cҍ.4iҤ 4L5+ >44$i܄ɒzƌ'3flﻖ/488(韎{+WI8a_Ҹ%=v}Y?SV%iƍ>p_%M|};%]\(w^ =CC oU$-[LO CI7J%qoIJZ*I'Hyߕo@M4~ IcK;AqK]<~ 1$!uJ7-TO6ӉiIL9LӖ?7mͷd4Tcc'hrK{H 3{3~T},Ȯ{Oi{i+({ܪNԐv}!W/?] `d;+{Cx{xֆ_2D}sz{|ϝxQ/ G@wǔ;!#sҎOɽkC6@>Ru$ ZgSwkeٺqے^z6496_J^]?}9omI3Z>rٻ^T hvrۦ!IJ K[cB߼oߦ?YqSw|hѴamkIziJjZN{Θ8߾7ݏ+oq7r!]=^)ͬs9!moSݍfi{lիǔ,?+Ǹ )j4xk^T^̽r$]MݮW>Dq~ŴU]J'ӒTnRU.zx1miOL!%s|㩍5Ǵ!;q>wnZ1fCړJ>H5?k9k59Fb [^x}$|Sd~ok\ܷM]OY?13Ts1{O}&lkk^rUe_ >/濶Y7=f3bgjuWߗtϿ5k$ym`´N9Yx悽oVu}9kYo{}xw}g+˱r?nj]HcǞxWif\m!L uo"|(dc^ 3[|Z.ժZz(mkyvU~zJ;Gv15W=wdGzL=9VzI;SL5OK3s #d$j9ޙ-?u39_&azv7~#w*&3RՐc4JS}6G|EZUgkzLߥx2I'kJMruk]tRI+Nx-"\^skېI_]->䮦Gҥ% 3g&aۅ ۤﹹe-n?pIK.mO;zz$]w1{}]ۑg{OBݳ_[dHg{/ZV|QmA|dwU^Qi$ŌܴWIUgQ3z>0=UpUv&)rnH]͌WV5ï#H13XO'L51DH^fr|#3 US3=?͝SSr.mjK{hF(*!Tچr̟1j2"jrދu#Cc[nX|>ufs4lM!lsGlҭu5gaǛ[m&imCVl۬wrgHdI*ihꎤUoFIl=߶>-ǵٺ"aPڌXoM6)\Y=>SӱqoGHK$ihPA$c!i%Jںu/I?f>7gd<$7Q3o I;V^+N+;]rU]rj]dlRy;K,fo_{#Wd-P)y}KRvȽ3L+튐99ZjCd]ɽhCMus_^Fvν[)iC|Ohf-(?i| cv\i{_3+]*M`>7?ӎM^kV|c9L[J `Z9RˇY%1ջ=2n8I;/]ϵm3{MtwOݽТiZȥ+\Eƛ*nzYqe˄{3 $=PL\6|7s>Ϸ(?+Z&VikY}:^޷JzܜAl*kk(=GK.xV|pyp(=I?488( gﭽc1dwyt[k)r7]R}֬s/q'ʟp\pӗfWh{gZq~-#HTz5δmoI6^5:lrN~ͱ9^ܯow1)&>Sg'{Fo# {eo#{?Cj٫k^?I;ws<%CT d$NqWb|5JV [k' 6i̓f䳪9dl]3Wisne3cMAWqzzz4R+rɗf﬐z^Kr̳NcD4r亖c͍)/_$ѓ7?Dҍ?2Q]7ݷ.XMHlZ7vK{?iGPI_Izbb'E"ez1ݧf/>}WawNK֛rH5ߔm cwhCKb qM6m-m(TgTO3nVґɤڌ}&!#;3T9&V_%'ߵrTe&׬|#%^٦sS=#.|ʞZiߪͬ93s4s+Ĵw! V{ɺH&poK馛$mڴI3l Kg%m>S̕Y69&$3]gS@=l[=:.tΒ;!%KH8rܽTxNhrl+9RJZ]Vҭ?uȗ:f4Y]tRrnҭmmy&q^=.Ÿ#C_r|6Muwz1v@^Qc?#Ž=neǚ7 |@ƍǛ¥}R1}/2L3O!߇ݙmcqcKU||ڒ{Θ;ͬa6o˱B]!5373f|kex 7KY^7:??瘇Cj7'G֫Q{] `Zޠ^'&_ {%鋓w !Y6֗Mu6<f4Ah6]/$w >֯^Tԁ˜#/!S]=<{eOɧ_%Z3}2H '|Q2eU[RgQ_LL%Gw!սq?sdɵ;s\dw^^UԙclMqZ4mq'fYt6yΗ=\5Ǯ`ԺK{I'OĉJVi@҂#\%ջzk|ϴ43ySΗrV-¥mIby3-Rr,Y"魟ͰkٌR7ղ{ \ *oWs_OXo%*ߜ`˸f0{}ϴcWC@k3m֯okw^Q}C߼OҸ-C඘;vnT&{[vha,Vn=f+{-յB}S.m)z%\SRΣsM;''9֑W6jsgQ=V-\^gg:[V3wO굤Ӵax{kID0@rw+SdLru=ܐw/f}c~&.F[r1}{csS*R2_EZMΓoQnhylx6p<ؙ,ֵ޿i9*5s4gjuo_qK'!뮻NҶm۴}WlwO!$_wS^I 8\۟H!ǼWn4]{N9^|%ˏ˽3W>چffRRO=U3{vk~Q=1}h?R5%?y>UƘ[i33psZ>m񝛪jmgT=UwB16igzm+?\xHn'"7msL!Wt)ii3jll9&l"aE֠I,m`SQOL JY1zEM>HZ !m V|#%mW2|׻ ~|6aμkyo[HzQN3}^3G잪&/:\gmu5]8vaO((رK.} ,Y¯KG蛝bv+r}ZL]'ss '=1Wgy%zlRs]իx1)?xx 1q+ .T<6_[GjT-^1>ˇSC΍/Y<{E7_53Nc;u㿫7Θνz>լogUhuCjhr^Jۆ󵭙P sTS{sNvV!Әy8^\+mKoHKpf]nڷ~#I˒ni#5)7=߾})'\5>w#k`lǹ?Z5m뾭c~zK:s}jwا}c CUhw+]2AO?;YS|%]io3!-L"ciL|xc/4}wrvƴ'շ!gF(nU3D6cK$Ǜvn\fTsKUi]o !Go//v竘>zV|2\|o`ϑ;MO|3$V7642Eg.:k+Ns?=m9F>0ZiWmU|@1׭Wsf$&7IHRf>:׋2:}wI_wx@x:|}šh=`ˆ%{.wڒp1}oڴiڞ\"DbwԱ2Ʌns.O`9-g&iޝ9y=<ے̗uVc}3*|)ŹO3x/4>$wڶm?ԫ'6WLm};ՓM-ʥ9f1չR+RE,?Y(~ߪ^1|ڞo{ 41eig*TW?sAWZg{.Mu$Dm>gkgzs;ɵ:c?mioJ:e6u9g6̦6fo~Iw}/^>2zzW*#z)*2*⯘6#_O9m"B|򫇴^m!ԇc 9w4kVxR9▟_ҳn\ٵ݉-1a٪vn;虻b9?Hҽ>2w޷}mlN(O~p7*mnW;;sV7ys -rn313mrSg=I{ܻzs|C4;WirkU{Όmދ]-4z~xm9WOcjv \7o?7„!I?]QR `.f|cSNjا_6=.ުc$Tolo~,zOy~՚S%^6sE7M9"mȗRf$OvzVcO<R=q8dI I au:nGR29ߖܷ ~2I7|sHu3ߧֲ]ӛ T-cWאcmٙ*[V|c*|㞤.יj}rWm[|CUb>MۓSK11U6kVx9s" =zS]=\oVєvK5sT}޷# VgB4}9,}[Yԗ|ٻ^4?r~"IfM5 OD+l=UˤVs$LiWzi3f6T=/!o5'qrߙ[=f=y``@ҥK% oYڟ{$z W h3zؑr/a."I{=s}-|WZ:?ԙ}/Czq~sΟ{ٝx&ǼcN.?+adZUxȧ%skei|45afc~ŐckY3kAZsY^9sLv9ĴNȧrc[x\ު_17V-Y﬑Zd$JV҇̑柹6I&NRg9gz$$97Qا#i$-\Ps #JoцT0m͹sҖi}zlH|>\3'씪 W[k_3s3c{!qwbk:k3Z]elp}ݹtʮyW'B3s鿖lT  5^i$eܘqoވYkR͖!zO$>]bx=1O6_?irGZ;L+VmI3ޛ}N|w4ջJ!fEY9ֈ2WWiH!Vhistķ3՞R՛쟹WzW '|HFo*=O>zt'3'gl+~wm.6fhvVrU.Q;j3]_:_>MZ[M}hc!ǻ}'.<5䨳WcrViTFxO<*o줺h-*?W&G_KKPHM䞹NaGBسl%{}<_dLtRI{:nrO;)~$NzTkS]_1kIiׯTO!m;S͖p6C 'Umr{TnCWS91Ʃָ=?\3#nB!7Muff3p3"sLU[jU^2UH^ڵ>w>d$׊yHMX۞9LVf=aBI^}${}F{c׻h$r#Us'*!lYL|iuSOgN*ǜVi|ό?WUM5{U*g}u1ׂM{`ѰW6vE'uF'_)'\iɑ[91J3t=uֲk:@̻M.>Szi.Ou{F_eRRI;km.߮5YzgbRVc'Y^C;ծQ{1pQ^sLf=/=9V|s~xp׻"δXm>f~n#57֫9}E3ys(B4oGvoS~u2Ip\N|'ϖ}hع6ON߼m][s4[ҙZ> ߪŹf͒^{`FNHկ^%>9fWċ5K;7ǝz,?7~\%%I|mi[{Otr\e7&~o}z[k]컪47O7ot֯Kn4wLI{ 6f0Tfdsm 6mwPАFz3z69kyٯwrRΑ5i\vM-Gvͬ&v}HT/1V9ǘqHgrxɹjɐ;o^rf2mHFSC2Y}k7ʻ 9޼o5j~wxw,WiChDc0GfCUU[ɵ/F3~ *5j /cs=Тi[Ǭkfư_Xҹ?w90֮]+ mvMJw{ָ։{ٵ{ا0J[YeWWL˷s[ʤZߛ\;LնT9欘=j|ebTM3cRDr̨QU~zrC[Bj9mgHm94UI+^a5?7qsRҎ&9֑97W'm?E=QǼ\ROU҆M-IcN4y,IDIq$_KАI$m޸NҖM$#I[7Iں!I+nN?~CIϗ4m.߇M 9k4$RԻH0>:~H[%MHs vI[ntY_淽H5_Ҵ>C=s$mQ<_Ҹq$%]s󀤭c?*i+(͜[^[|_D{ا>rf).:'_\Ҫ!IrI3WS)kn4Wcwo^t=c]ZY;bԷYɪJ+4iIZa-[Hz_"i=sSRSIcƎ4f8I^I$ع KmzI[7t7?3s.i.I$':U'w;Z*H^&ۜ? -UX%UۓvlֻKx9d|SB䛇땏1m}7r/ӎV:sϷihX̺ꏿ#;vFv=g6?czE3{2kM\LofOZȻZ%&27&̝~o}z[[HH~|u-.gbطyi{|A15:/|ӎO&iݷIZ~ mwQѩ,ƂF7?ff B;lyw̙3%=ē%sbIʟT^[6|`IH:PW}͒tS$;>%M>]' 齗*iƍf>儫*{?E E~Y%]5g1c\oDsR3kMWhN1۸];QqW9#1;?HP1ӷ:nWw.aeR]ꘝ6sP҂'IZ>Iv eB;ز/<J듴C$M6R {z$=$:v+GOϜmZ&hޥO_\ҿs'(W])J5vůkglL,fU]2!G'w[^{תgů=9߳]ݥ׭wާpZTy63#ېj53kUf#$ Voyy=>Oү.ois)V6БH'Zc@_8%|}`vDħ\Ŀm׻Ec,OX'444ninht^_FNj.Mt"}Y6u=Ic%}iIlm)j$|I #pNjɎ6=e$~9}R۶.ew$;&͌>Ig{tott]%s[jok;> %]s*I{LmfdHˎ͔'i}4vXtsgiz뭒z!mݾTQ$ZdZv)V]ʳƋy<9m+*ؕ7weRH]1'ґksxB1w oeR/E҃kβV*gG;BիvpǪ$\_"Ilth7nt}KE6p̙Ν۵U~˔U__!svTWWOYzi1+/Ǔ9ǬU9fQ_>˱J>Ʒ*欪禝-:rUpMzC$ u䆪mKun7}ӳOy{tyn^MT.Vf[yZ67˛ne^-iC!GĚc'UEbJGN$i]$^ZҶk Qcdy25n`eƔ͕婟$^yDI}*I? U HZtoW_ 6fZ6GKrLrCy44$'gKoIju-c{~_nW%M0A]oKzx;1ug;ʎ7_f|^̊[Uuϓv_5w򐤟>}WG˹sۮ=~VV-|ɒpҫ$}w|lwD617fYv%v>W/*iϓ덿48v%[t#%rq6~mw )'^W<[j/ʷ_1Ri|[cWp-)?UWk\.^+DbjmҎ56WbHb[˱1iT6mmVhyf*2kj g5z_z/X@u]Tl/ ԲIiE`G:\Z]w I%Jzb21~]4I% 9>$IbHfV}&ܛVY.l\_ ï[m11hx;8ČfNE|n2kU}wUMfWjUt ܙ=L.'>nskOܦ=$tA&N9 Jy)gL +E?_d͟!}o~kzw5L.}Ió6Ki ԎS77WY|o2??#>rSҶm[=pYeL>'5`{{y:o'釗Oic#z1^oK4muuO3k$Tkǻnf[x"9NҼy~3?R^]$bxI&Lȣ'i$\ug $IWuqg*ISg)i$}okW2Vnp*''$iK㯞4*7 Mw<>LJkx+$౒~oٺ^Wv|)%Oo _%;dT{3 ,a{޻JZ1cRHI+SXI6WG>#wrݞŸw.}$S׊)QGIG~(iJ禟?Ǫktd);*iI+%%X(orvh_|O-ICCC鴶ZEq[G:VLOFrGgUeWJ-DBo I:茗IM] S1#uguiGw?9vkͯʄϱS^2G^Fo731\^1B0@r/xȧ!lLKֿsOIC[!s==̹ziEG-5#˪;*![y}LKR1˖-~i@ XEgk;nWI ݧF=y֭aMM aRC&J۸ޮ;";t>k=vֵ>6%ԗTmY<גb}awKڸnPuC{\'?>_wu͓hM~j:H&XE䃧͔4fΎ$uߗl%ғ ?eKzkOhɷss5vIum>jixIucEik֬4ovL$m4ӝd<.OUw=<W!gw$}>I'50ӎ10':m=پuķ"\vI<ICCRΘɞtIv%+:>[z[]v _=%ri=7F_lǖ?xU[ޯCoȎ%UˏԼ2g_mirxT-w|sɱI;krvsϖzK^=DD0@r]2sd$J+?HzҫNV6 L6iBʹdkg 6۪O=Gʕ+GҾ?U6CӴ=///i&l+l&/R7̶oN}?!vIn[ZOΫ__$鵟RVKt(?>g%mt޿?cy-R} [o_*|mعtIw:}WܶM%Xqg=m~w5f͚5x{Uw~|)!:J͈O{IuikRO}>(i{}ygʆ3~p>>]o'ퟓמUjULe;B'ns13Fa=1uV}vwy^#2ŋcwwtCҘMko[z%ek\]c _m}!$jFUKT!%sei[X i/Vs\^_ٝRˌΧ='yAiΓfRbzq$~!>sy՞tj̈́%/Mt󺶿=sUV[vM6-Ow9|6iϗ˩ IzՒ;wZ6e!7tM6?ڹїY7PW4eU[,X o4+]=E#4͕,zI$tA ߿\Ҿn`>\|wߝ,I>%m۶}$> &jW~z~u &y<zͧˤeo?I+]K[K9hvcB%]Mcc\dQ>Fҥ=iZ`dY7w`w;Colt_Q}Bzǿreן|;>A{|$蝧 'լPx;Woڙ9Zi癪%kH6|WL{ORݷ|;fiZ1Wl~J7Wn_cm~ԇz(ռjϷr_+Ƿkͯ\M[f!5 \+=׹S%bΊimڒ쳏}qHynM+'7s͑ IɔnTQ矮Tҷ0OVH&!¹\Rҽ+ޙZ~yog~hSlJYd>|ߢ+Uɗ?O<'d(yfYIcY=i#^,Iؑ+Y~}|~Z m^{Wlw.6$/)5%GbPQ-ݱ|&;,/{..I_ z{$J_^,2m|;rW]9N'}$ldը}oira7s(r*w /*_]:c_CLO5srY~*_ _XI̲ et._>&J@i3՞J} >i~4SexL?VWlIN[RO4r>Y篸c|)Kճ~;R?|Y_JMs3Asgf++it1Reuc$-^|As=;Vk;c9<&Jr\oOw|igKc^&~ժ<1N{X^5IүIMe [( )n?tپ K=!W Hξ馛Q[S\;'w$qzR6M+7>cgDwq#9vIs7cOoQn!x݋=t7"SeٮcyPȐƮv >J!ْ&7j˽6? /aNo1O$nY1=^{{N 4~l1w;Ou:ύ٧mqz<ߜrj9zfvm|?z%| `v ݩa%r-ڞeSl ͟9K O%PyI6Rmb)ۑ9Ơ-7/kpn&e{0g3|ؽ[6HxӡߧD_g{ｒV\yx6>D"C#1E꼇nNROMy}"!G^r4I}L|󶝱}%Cn˓n]Eɓ%mܸ7*7Ng>b{HHzty_%oj'}r_H'ihhHyPg#} v ]ʷCY;ӆuڙ1{KVfRjB$i>[a>v(S/6M9-oW<|3nMwZRΨ3RwGwKۺF)~!gzR{Ou!y!3Nc6 ֬HqvIK,i{gںu?>K/Y|ĎNi>(L3ebӆܿcjkfϓ|3aH^{cG4sK|m#;]=Z9O6#7Z^% ͯɩzE|JTO-j^O3+r1mK$ VS%? ^MwɜkǏ6Iz}OӾ=cj/LoZҧ=>b3ui|6,$g& tAI4iR2M>r:Io=qEH;X.W;#mOuT>Jږ5/Q))ߑv7g6>QI}7󋶶$JZ]1*nj#?GҝwyfI'fHlNsG;q'q%?Hs=%?~ا,"x$;/jR};só$ٸ ,4vX,L㚱I/GBG-75M%t#Mu]%=iR=#_YgJz7v|/;o/9۲Mn/}԰[]Iˎܿ}$횘c/pBI˖-Or^w*6U9c IH_>ąSj{:z'ۯZE5k￿}i`νne}&yuv_IoŎoTnǚ/`gyx'e}|αfMW҆Rͽ?GS$Tǫ&Tfw{j|+)jíy ~zڇ$͘Sʳlą~#vziB?'K;v]kۭwe'>ᒵ]=e|%@}#f7[仫UJETzog?߮ܘ93w)"m|-ϱo7.R3157?¯Jn^?L56ڴFL{RKg!2kU}v7Ǽ;ǹ!;I G 3)iwdYvRZ E^ KVIG~ذsI(?+PgFI]us/K2c˓D-s ѵ}-I}Nek.H(xȹڙS_yIZb\K__k?%˺{7oHK0UJ#EfG&}@/`7h?."sعi,MrIC=;o߭ SAkx{ϓtޢyc1=ɒ~H'w8}{=^o{]|SFymwIzÔ#rӺNұICCj^J_[5ߞd}E&!DXSՖdZUlH n̹mv-3ۧmsak]ys4irO㻇!+ N2]91zq|GHz챗3KY}nb-&Aڴ"Mʽz9۶_gOF6!Zgz#|GNyg4D_oͨ.=K.޻x]$}i^-S?r~Jy99fkD*l|I{z۟/{׋JS=qUlmn2Sv{I_|4IW]}x͏z׵%ݿkI:>e;Zn?geRy1=M#rYbBx|GJKXmv,Qmps :ISN UwG$tFIE굽U H_oHzj|.˥ ׻c||'of/9~TkboR|(߳+Z^OH˯5sl_gUۓvɱsH[wVu*7JՒ^Ss&g$ 9ޗSC7k}#|}fxyRT-7#$'Sf^{Y׳r.ė{~,}~ٛ$y+Ʀ2@Vއ[7*… %Z[ HzJ:dJ+=~ȿ?Ycwnw=؝@}[$}$ K#3/~ɷw Q/U3:oHʧ=Fש|}5U!bjNO_:!ןv5-DUkη63Ns̐U8RFjvuW5̑w#_˝ܝ}]9)4y|$}׵ŖvsS I{|ky}HɅ J$ kɿjاV_|g +<}/R2ةwOˤ! RHݍ|:9l\fZ?Ի9u^2_δ" 9s9o{zTyU!ͷU=+{-ԻJ̳nr=E0@rz.ĿWOs=kntM?a&.Uy"ÍCiOז'+ԫW>>^KzZd鵒=,m6^ѷM/wSv܍+gN4wH͗K+, ٠wڞy׷K}h&M$zTeOlIGVkDֻM/ǧ.[҃cg֙ve ͤw럇>YiqO;+E6E5 '5[4r)bi#!żճ|nwjs̙vᵹʟy;~|uΥb^I-mTB'$>[wÝI,4̊v| w6!I{^)~̟i;vI:~NKle*rt17_RntKIS1v7{_Xirk|+ISoOU팹H:=IuT1})dzѷݫ:Rc6zr|K¥]rZy,L"+S﹐ \[So=ՑkGKzW/4va%mVy%$9UMsu ^HҶ~IO钮oOSeHH"!WWC7Mk&I{lͣ)nOi"tܸq=P5"c˼IK iI%ujuǯޑ\IٟZI>Ӓo][2Re>ɒ6?gWu~op[kr3\vڱHz;^>#' )#^{%I(iА=GSHawJKa9XKn\=xRgxɐ㧽 Iys@aR7Ԏw;|>/=Yٳ'hꧽe>7UHٗlY_N/ˮk1Osgʐ_]w%ΖMrlSH柛Ngsl򌨭/eKʤM:yw|;V5fxIK$zBthl3dfM󥠹lm{oIt~In"iFON[nW#LD|K sisPҦhf͚0a-[He2)6)=bs,X V昇}R͜៖O v6Iގ{nS~ *9XΗNmpw%wH˟-jԟj\O|e^%-|uΥ#˧_x^>Yw~jX=SL'^z(<7Dy6v_;∝֖o-w-HDzsQ5^*שּׂCC3{[s[޷'V+C;[v-){Էy}IݝoFyJ3=!jjW 96j'G?|O!64szv'h[SBOs17.""\˯hH3UҞ]?WgyfzlQuQ/\r-/;ԙTujM}6ͦFlfv>%t9zZP%!4Y_-EFM$u{nڳ|6/P%|I{춏ޞ:`-i'T|M Oݳ\[EҶ-$m_R|ӎf&bε%o?I+#6ݦ2\vMY1s+X+~>OOu&O/{LxSZ4m[Ǭk&;G7ur4k֬U̧=͛%-[L;3P!ٜᮾ|IW|+:ïڼT?9Y}M  ]h3sٵ57مHۆpv#g?]񵥺326å걹KQ88͍>GjLv䨭d{oTƌcv461ŷ'OYVzHܫ~2kxhx vyi3NxIgf:$QZd8Lr6H,bHWG2M:V\I&J%ˏ'1l/kfӂ/A*7_Pw$ GIyعiiKz={ߓ>9.ij="7Q۝݌⬪ v<=zR M:O҉sv*m⩛^W5IW4T/wVO;%̷ӳeܕvud;#$=+׷ٲ<3ծf.ukuw9%9ǐ21mkf'SïUHGijfn3:Rr \ ̆z\%D|e$m޼YubP?|&Lеhx#|7֜#g?y#6xܼ7'4(ɫ.gӬs4}nm >InY&syOROKXxdIKrd43L[3(sۺ:pbzn},iC_S +T{z|u?~:so}×iqkvmp~^#c5L;kT7zf9vuG}1g̘!iH'ꥭaI핮bwSw4-_ ۬ܟ|jOI7 KZz_Gby{OGghl~ Iz֬O;\(& v v\dy^>{NSߕ76 wMvNRQ8+xnmiWw ܒjŷWOc.ܞ{~s3CVkm=yu9Dڱ|sox;czx>_.9= `ZͼW2۹rdl%>l_^{MزZn&ky.`Gտui> }!W i7l-ԙC񭯑4p;Ja#-_RKnjp̳Ds}5'mtߊ[w1 %]~t|kU|Đ2_{J:r;ߦrC2_NtK(GHZ?~FzN1.KƗq?ӝm~sHLJzrrg$7;yy]k}yr/|V}FƫW4TO*mɱid33sލ|=3S˱;w4ioCߞzeR]7\Tץc.~H5ZsW5bhXgsu*Lc&gHKpuL6I}6y1'4yO(mӏoaxX1s?TOZx2lԛCђ:ePw>b 'dK 6MvyZ6͛lҷ"?LQޕ~Ū)<)~r;wK0aB(<.ٵLy®&uujQgS1xp]oSe'4m*@sfMlj=1-oKk$mݺUwˎ8H,L.RjHiU믗J꩚n5u#+ړQnꮇ$p}Dr!uH}]EnN&V}vn|㒮rG;󍂴rt>K-rGM|hisU>_|/O{N$gbӞyLWXȽIKUX^ྵ>drUߗݵO56- _||Ϳ]qCyxcڙvt1TV's ns6D{HC{i[8ŨRU?~R'$J&To'O%~nMڵkdflvMIZnKKRi1G>!F;ӦGf˦Ebٳ%^㉇;7x=t^'Ӻ`m;,Ǧw⁒:J5{̢1m=rתCDI[9=ؓ_Nd2fŒww-HiבVoty άKHuS;Z-ISL~C?s'#WfNkHjO3M};:{ϋNwxI:aGjYŮZI}5vٟ;Yvq"u'}m"wU5_wu}ex{枸),ʷu}J)].׈틒ts_,WW,Kz.V[,W1Tr6ӮU6;Bʤ)-1c6nvjիZUkαsHQ9grZ1=GWQP.GK;'7?ǴRTWs?si|}8 )iҞUς `Zn=iȑs$]ovo^*rl9gV7צWZO{@Y?]>&i~X/<1܉#>m>a'is_.iqsCy8&țInֻ XÎlfL̈)3zz$ؼd_o6MߴlZش9%̉s$}辮ew,Q鎣k0xRϥ4۷++K~}njrV,Of3ؽW{r1Yv)vg\5N/-!ZV.YDࠪdlϯ:_YdׯrgN(or>I_厗5 v^;7=勒>ﴏVZ0Ӗ_1xg߆TcjUikOg0_f`W31HuVy C] vϱ"ԻVuu!T^@߷^T*3\' H%(~xϚ5K߯neEMr,t=s9j!y].۞"/P=7UUz7UPԩS%/i|9I8î[ND=_,/O󦜺r| |Hyf3^L!$36߹1 IZx:WCRWmjή;YfVI7vON-Uxlϻ'n-Vo߲_BIqFӓ 4}6ufa+#ZUeƣMi]zo>v-I{/:lQGʬg-fT;r]߹fI]lZxg&gҘq{g4Y;"|!{ ]~EI|J}Wѻ?!yG?IfgawlwzzӰWss"mZY2ܷǛK=*9;Rs̓?kcLmrt~ʩKLN{z5] o񽫙'f|5sn3)'V9ɵRK:;s&HJi jN!\nrl{gNtuAҾ3=֭O*iswϟ͉,nI燦ܕ{{$ ;n&R8hn归W49S4t2c0YF&Hz~$mPf I84[%mnXI}&L iJskp]wIZKG:r=rW=w#mi镾^3/f,$}FI 'Ӵ:&so#u>"ߴ`SN}stڲBI4|Ϣ0oC$[?>b；8[|_],gxsߧWxUZrqGHom;ֻ>p/NLieڬw|AI w~w;=B~ϷWO/~S#UX1~K*oWs=a} nw ڱpHƷZӛiFvWHն+oj1UֻΪW&|GbZ M.m`V+jtjBjZ& ^ɴUڱӒsyg洳SL!RW \NW=埖y'tܿln[EޕMr%m:]h'4t|BOc[R6i~W~;y ߼6SwtJb‚yn?t1dž̹nFʣI}7 ;+HOիsd!Tu?D1/~$ I_tOkŌ!IIg<_yAlBI+n8]=ӵn_IOt 7H:@$-W_L1?Yח^s(Q馜vlJ?==?mη7eg̢1:n!z_2|Hmwqx@m7Qö%>IwdɎܘ;jį8O}$GٴI̊9[@U/ڔ3MxY6m1^pr4n&H/[j:}k6k忐؆{/^Zi_XGz'fe:Dg.-߾}^CtY>vqv>[R$L?jk? CH>8ԝ,;Oq_t=)ԥĮH:$ I#='{S~߂#nM,LyvǹonY3L(?F]DY=$d6ͨ>:Jŋ}?Z~BlGұ9s˧Jq#I-i ސݬg78>z搤sp,t ~j<.5to?krgURgl'*8*\xIfvO$93d=Uu-c{TFyz6g6ό)J5*7K7?6[3ҞQ嘷ir_1O٬?äKio֦_Fk33sx!cvדd$ [t!UkWntIgO>ndS$gю3ZiE;Jڕ](KObFL?<$r-ɉ%WlP~IGI{V#v>&sSm ɜ}c!UIHz=-_օ{|``@҉H:g=O3/m&_֍>I㺒#G<6&3_je3l?$9^ m/O^yVI{G{g֮]+nS̎UÙ;}LsZUiKy#eIzu?ۑ[{ů?s'}pO-q'3}"sS7^{YaΘi[.\wJ7>*g'=0I'nXHHu1ڹ.&3o{AΌ Wu$~I}dw+u*_YۧyIQ} "wTR!eFkz̽}w;؉%v/T^O-%1R]=wڒ߷X̜3oYk+jHꝛAW}%H?Qȗ4ToK?9i|ncy֑Twagٜ-eBݬ"4yd5Fk~zmSgKşlِ6ͦ}Ck%sKs?Ntϗ48f\ E}<)ʹ{[Hf|ʨQ.]Tܐ\M[HzWϑb> 9B2S vb/ӟmdiR'>Uu믿^^?|FHpGCmΟ]~^{%鮻*^V$=|L g>Oҙ/_3_y+,X iرʙ(_I8_a쾫?yi)z~{v}#y[==qDRY3i3չ=9<ǷfuVr{2Uٳ'+NxOK~-}3;٣|W.}O丷#w\>o.oתwVu_+i7߼T-ɷZ>fDh!ZL j*ݪǏ+uO'W~nOӎܫaK{o=ßH>o-_aCת)ɵRe:7o/>#oWt+1 7dIr3_â̕tԸ>*t[ut\~-禐U>6/H)/_&iyIR.UIL!"nP8;ދgԑ<%'_]|_(I<%eBͻȢtlo~kyC_{|X+7K:I{!}`͚5o&>N]ҋ,nT!r7}WK`َgY} 6_<3Վ"evhhhwɑVR*!Oy}B܃VuvHne炙s+%-YANuRג2oʥy?'i# 6G<|lEH&[ݽ=?zb~TݗΝ+{[8+w!Z5kPy{#[$-;y# kUVx*y^]JyݰMa)U[Rwlr_|0r1"~]#us]GnWmOO<Sfg'[^g!_ !U=+̟㩅g&e3|7 V?u&z|nsͭ[nœͅ䞹>]ŧ//Зfsll$ߣ;_qc$gIz]}:\&gڝ9m-isrY=[oUV7e`fm{>ؾu&1mnG ̙3GҪO,$JbtHiyIO iܐ3Nj/?<DZБdۙӝ]/=t}ݷ}^%3{ܥ6>deVB3c|-}Ǯ vWBp#])>BIc zIO˝Is7Jڲe3(Fbgk(?r~owU͗)ԻUҹz}|&8rwfW7]զ><m7.kzW)#Y{\f'ۙ.Sl-,8t衇Τ{cpI2Uڿh:l2SuM?wC2^}$nfG;_'kh[k[2U]ezㅗOږ3 ?+nFYLH+mxJ3mU-<_e=|G3Pkջn3Ousk!mhR|KҮԾd$%[x_yH gϖzjUIL/]ղt6O_z%mܸ}$3f2.t=$-7^]sYn͖tV߁zgӦMn<盒zNylxtzLOK3 E.]ՒǞ&o5rG}va=_$*I--Na%m|Iojv5%ΛGll7Y1X(gG/[cyNޤݱveagM<1M^,c^ْx1s%y?$ܞj,J~O}Mst5#"|\(n^mIWT;!g*2}n 廬9>nȏn~e#UӔCҵݬnv!IqJőwK҂^)z^S75Ktw_Be/i7"lkϟ-eg辶rbv 9~AåwkUx ش{Zڻƌ~#9RWZg'j6k~T#~_+3z[vH%،zE-SCYOy `Z!uwU7Ч*黟72<`|iO6)$ײٍnАg}V{P#KV%vmvM/БgIɵYn\tcǪ {QG?^i4~njfvZvbyv;nw.U#ocG̓AHghv)Mgs}%}_'K놵^w)i͚5 K1wu̢%|&ճe>総]I<$V>χv3ۧ_po,#ip(Kd ɝ 㖹{$ZJ;[ 2CNH1O>/w5ĥz̑fLr3fH:?RQ_ ;McbLMeҤMEw}>zɖ?mε`HU? ܭ<Аg*i >Vfo]}"ޕHKJn"ͳI7IڸaRTpJ?|ծ /i饟uڝO;k%bJƴ#>ugȪͷڒ-YΧ{͌MCg+ȎTrzZd=M y5zF1%*_|o/w{R /i 9Exd$ oVCJ׳$~`G~ͦiO6fEMrs\E"Zooc4IyZy[rK%M=n/Is^|zi2{ysHZr6?$&+_c}d\/35dl$}|VI&M'?CkVIZeJZdqcJzGK8n]'M4}I2Sҗ.PҖ-[$J-ZlywyR\]{}~QI=[:[(e>ޑ9^` 6cCd>7'|]9xgxԖ^I[7A E;[k 7KhZ8oOI+VfuKRGaykX)IJ'I[S$i$>TPX? o}$',̞Ovao\gEwVwٳ|+]C>z7%ip_Ӟ$͟3UI:bْt]/13׻#6ltG{{ zÖǩˎ޳nVmt-s1cH+i%fH:a!H:_ni7 Q|ɓ'K>#,h1;{_߶3UOm֬YْV+i=;?RRg]}{ߪAIS$iōuVu?Ow rzhgi>1.ǿ_w:H;C{V_'/3Wv!N;*Gü^>~׫޹iH !%Gvm JHUO51c6ﮦHU=Թ߻]!ZEB< k$iа2USHmn/ 5$3slLkhHai{UR9+ߖޒt$m|vMҙ'=R~3&I:c?QITu3S\>`k6HzƯHz#qhhHҊ+$ f)'ջ!y~d+ګ$Wޱgp6IeʟCf?- Ȳvϔw\Θ2M+)_o jI:lIvNYDmwfsٹΖDs_Z|m;K5q竩Wo曯o)RNm/ޛ=M<-Oo[iI9c[婒 cO}yYn{Bou뷉S^~<}$UMq7teu1HۗBR߾|w~*/}R$=|mJG$I}O<}9_חiA3g,ϙCK:?)z־㰓vl\蘆@_H>vwY_Rc?ǿK 9T~IJ- o[~Rzmo[#i_m߫Τ~"UҎ2&ƪ-1WJӒ29yճ!uqc9+F[l_~VV `d7#Gum.]*I>FҾG?NRْ͑7m7I&Δ9{KR1In2⚽V|]ʓlMQrlږrm!>6җkI2_2/Uƹ<=e/My]^rtH{s+# ݦ +ѯ7_wvD'#dm!l!AN[GK6(I_i:ICKp2IۼmLJ gGz\SwJ>}3f|͒~p\d>7>ZQhK l.˫ iڴid#i{'GRZ;wF?֚&I;N48Яt[rⴗK>>qTwgeqw v_ӹ矕K>6!阽w-&[RyОЙ's[Cvz%meB2gݸ+y/&Uc%%p۠v6F֬Y#iނ _Us}穸Բ׷ϖYvIَ_=kz}Zr|ڪ^^ ?M[[e==Vovt3O*wC"7v?f|s{3XQU^O'ZYU^6Lj(o-w `Zxmq$ɟtO9InTyrRy0+7-禟N- ϔ*rs3|Ilft$9L}ڠ 6Ŀh˟tc%K2~:XP>k@Hc<$7ù)CK孆1Z.i``@Ro$~đ;=˕#ՠ˗/W4q7cnIz'(]*Oƌ;DK>v' [X\]Zy .x[+#=ȭtׯZ>db{I|Iؾ&Wm]%ݴZ{-7sNt޻w1B!e֭['oV9Ǘsّ,? !!d]\:uا9ҕoo퉸oݣ7<}wܳ|w.i{>Ru _?pI}ݻ%J>\5m% ;$m۶Miʟly&BFGKGsP}mf晒vm7IǏڪҦΘ#[>S.'ۻg;2/|TiCIΔt#JNj&ą$]>s Tֵ#̶OW(rkc_IG<^҄5[Jňɦs/oj rs)اS>#;Uc H贻y9JZӏ$xOci%~ wWxj[pGeegƣk`VIo["_i|O9[{ߒN|ƿ˗a\髾̗2"lPӟ.i6ْ5\x䰒#Ɏ3V{rI:uvo1c2w!/瞒V{!_Iֆ~THvgN;Hzô$6c{NtkSk>,ͤZISNTYk3BΊW\޹FD>US2|9FJ3UMɮW1xFizeB1B>]G9-Um1=ɻ_sjyi.d$תb{|yfӏ&{ٽl^H6]*{IJ>i1}}]Ҏ/Xaճ:j΂uߐ/ޓ"7.$1<̗/'׭´I6;m^XI?WmvG7_fϱ_梭Y!ֶ%{Ꮢn1ҦD491s%-8lIIO}cM-]imt.iVhȧUkWgak$$}$M0n nW—/[Sb;[w\+w/VHK;"RdܹnI;囯ΜDy?9IҘ[J7H$qaf#jmS%[%iҮ3zQ*/tYY RlN_S[۟NŸSsIˀf`W _U5¸(xQ;oￓ^Һ;㳣RrnH:eIzS'svᅪq;uExz1~qOP촅>{6JcG~Ǝ_߶KW>[E޷\c׃cMON+C#>YZyCZݘy/~E7y=dž `Zo܎youwWmU-δ|mڒ҇_=>}I#֔(|3p짱>v/}k}Wpϗ/4gH4%$i`kV۟%;VSm&I{̒4tqƕ)oyȧFMȧ'n4s6IӶltYZI}}}^~OI6}rIcnjm`@R_6I3_ m: qIwynAIC;}s1{ѼOLQ17Ԫ$UofחvF~V-_{H5j{bʧjOڕ1w}I5|4 a?&7-nkh3_L33,2@מ0#o IENDB`lexilla/examples/0000775000175000017500000000000014647367374013015 5ustar neilneillexilla/examples/CheckLexilla/0000775000175000017500000000000014647367374015345 5ustar neilneillexilla/examples/CheckLexilla/makefile0000664000175000017500000000056714647367374017055 0ustar neilneil.PHONY: all check clean INCLUDES = -I ../../include EXE = $(if $(windir),CheckLexilla.exe,CheckLexilla) ifdef windir RM = $(if $(wildcard $(dir $(SHELL))rm.exe), $(dir $(SHELL))rm.exe -f, del /q) CC = gcc else LIBS += -ldl endif all: $(EXE) check: $(EXE) ./$(EXE) clean: $(RM) $(EXE) $(EXE): *.c $(CC) $(INCLUDES) $(CPPFLAGS) $(CFLAGS) $^ $(LIBS) $(LDLIBS) -o $@ lexilla/examples/CheckLexilla/CheckLexilla.c0000664000175000017500000001021014647367374020033 0ustar neilneil// Lexilla lexer library use example /** @file CheckLexilla.c ** Check that Lexilla.h works. **/ // Copyright 2021 by Neil Hodgson // This file is in the public domain. // If the public domain is not possible in your location then it can also be used under the same // license as Scintilla. https://www.scintilla.org/License.txt /* Build and run Win32 gcc CheckLexilla.c -I ../../include -o CheckLexilla CheckLexilla CheckLexilla ../SimpleLexer/SimpleLexer.dll Win32 Visual C++ cl CheckLexilla.c -I ../../include -Fe: CheckLexilla CheckLexilla CheckLexilla ../SimpleLexer/SimpleLexer.dll macOS clang CheckLexilla.c -I ../../include -o CheckLexilla ./CheckLexilla ./CheckLexilla ../SimpleLexer/SimpleLexer.dylib Linux gcc CheckLexilla.c -I ../../include -ldl -o CheckLexilla ./CheckLexilla ./CheckLexilla ../SimpleLexer/SimpleLexer.so While principally meant for compilation as C to act as an example of using Lexilla from C it can also be built as C++. Warnings are intentionally shown for the deprecated typedef LexerNameFromIDFn when compiled with GCC or Clang or as C++. */ #include #if defined(_WIN32) #include #else #include #endif #if defined(__cplusplus) #include "ILexer.h" #endif #include "Lexilla.h" #if defined(__cplusplus) using namespace Lexilla; #endif #if defined(_WIN32) typedef FARPROC Function; typedef HMODULE Module; #else typedef void *Function; typedef void *Module; #endif static Function FindSymbol(Module m, const char *symbol) { #if defined(_WIN32) return GetProcAddress(m, symbol); #else return dlsym(m, symbol); #endif } int main(int argc, char *argv[]) { char szLexillaPath[] = "../../bin/" LEXILLA_LIB LEXILLA_EXTENSION; const char *libPath = szLexillaPath; if (argc > 1) { libPath = argv[1]; } #if defined(_WIN32) Module lexillaLibrary = LoadLibraryA(libPath); #else Module lexillaLibrary = dlopen(libPath, RTLD_LAZY); #endif printf("Opened %s -> %p.\n", libPath, lexillaLibrary); if (lexillaLibrary) { GetLexerCountFn lexerCount = (GetLexerCountFn)FindSymbol(lexillaLibrary, LEXILLA_GETLEXERCOUNT); if (lexerCount) { int nLexers = lexerCount(); printf("There are %d lexers.\n", nLexers); GetLexerNameFn lexerName = (GetLexerNameFn)FindSymbol(lexillaLibrary, LEXILLA_GETLEXERNAME); for (int i = 0; i < nLexers; i++) { char name[100] = ""; lexerName(i, name, sizeof(name)); printf("%s ", name); } printf("\n"); GetLexerFactoryFn lexerFactory = (GetLexerFactoryFn)FindSymbol(lexillaLibrary, LEXILLA_GETLEXERFACTORY); LexerFactoryFunction lexerFactory4 = lexerFactory(4); // 4th entry is "as" which is an object lexer so works printf("Lexer factory 4 -> %p.\n", lexerFactory4); CreateLexerFn lexerCreate = (CreateLexerFn)FindSymbol(lexillaLibrary, LEXILLA_CREATELEXER); ILexer5 *lexerCpp = lexerCreate("cpp"); printf("Created cpp lexer -> %p.\n", lexerCpp); LexerNameFromIDFn lexerNameFromID = (LexerNameFromIDFn)FindSymbol(lexillaLibrary, LEXILLA_LEXERNAMEFROMID); if (lexerNameFromID) { const char *lexerNameCpp = lexerNameFromID(3); // SCLEX_CPP=3 if (lexerNameCpp) { printf("Lexer name 3 -> %s.\n", lexerNameCpp); } else { printf("Lexer name 3 not available.\n"); } } else { printf("Lexer name from ID not supported.\n"); } GetLibraryPropertyNamesFn libraryProperties = (GetLibraryPropertyNamesFn)FindSymbol(lexillaLibrary, LEXILLA_GETLIBRARYPROPERTYNAMES); if (libraryProperties) { const char *names = libraryProperties(); printf("Property names '%s'.\n", names); } else { printf("Property names not supported.\n"); } SetLibraryPropertyFn librarySetProperty = (SetLibraryPropertyFn)FindSymbol(lexillaLibrary, LEXILLA_SETLIBRARYPROPERTY); if (librarySetProperty) { librarySetProperty("key", "value"); } else { printf("Set property not supported.\n"); } GetNameSpaceFn libraryNameSpace = (GetLibraryPropertyNamesFn)FindSymbol(lexillaLibrary, LEXILLA_GETNAMESPACE); if (libraryNameSpace) { const char *nameSpace = libraryNameSpace(); printf("Name space '%s'.\n", nameSpace); } else { printf("Name space not supported.\n"); } } } } lexilla/examples/SimpleLexer/0000775000175000017500000000000014647367374015246 5ustar neilneillexilla/examples/SimpleLexer/SimpleLexer.cxx0000664000175000017500000000762714647367374020237 0ustar neilneil// A simple lexer /** @file SimpleLexer.cxx ** A lexer that follows the Lexilla protocol to allow it to be used from Lexilla clients like SciTE. ** The lexer applies alternating styles (0,1) to bytes of the text. **/ // Copyright 2021 by Neil Hodgson // This file is in the public domain. // If the public domain is not possible in your location then it can also be used under the same // license as Scintilla. https://www.scintilla.org/License.txt // Windows/MSVC // cl -std:c++17 -EHsc -LD -I ../../../scintilla/include -I ../../include -I ../../lexlib SimpleLexer.cxx ../../lexlib/*.cxx // macOS/clang // clang++ -dynamiclib --std=c++17 -I ../../../scintilla/include -I ../../include -I ../../lexlib SimpleLexer.cxx ../../lexlib/*.cxx -o SimpleLexer.dylib // Linux/g++ // g++ -fPIC -shared --std=c++17 -I ../../../scintilla/include -I ../../include -I ../../lexlib SimpleLexer.cxx ../../lexlib/*.cxx -o SimpleLexer.so /* It can be demonstrated in SciTE like this, substituting the actual shared library location as lexilla.path: lexilla.path=.;C:\u\hg\lexilla\examples\SimpleLexer\SimpleLexer.dll lexer.*.xx=simple style.simple.1=fore:#FF0000 */ #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" // Lexilla.h should not be included here as it declares statically linked functions without the __declspec( dllexport ) #include "WordList.h" #include "PropSetSimple.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" #include "LexerBase.h" using namespace Scintilla; using namespace Lexilla; class LexerSimple : public LexerBase { public: LexerSimple() { } void SCI_METHOD Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override { try { Accessor astyler(pAccess, &props); if (length > 0) { astyler.StartAt(startPos); astyler.StartSegment(startPos); for (unsigned int k=0; kSetErrorStatus(SC_STATUS_FAILURE); } } void SCI_METHOD Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override { } static ILexer5 *LexerFactorySimple() { try { return new LexerSimple(); } catch (...) { // Should not throw into caller as may be compiled with different compiler or options return nullptr; } } }; #if defined(_WIN32) #define EXPORT_FUNCTION __declspec(dllexport) #define CALLING_CONVENTION __stdcall #else #define EXPORT_FUNCTION __attribute__((visibility("default"))) #define CALLING_CONVENTION #endif static const char *lexerName = "simple"; extern "C" { EXPORT_FUNCTION int CALLING_CONVENTION GetLexerCount() { return 1; } EXPORT_FUNCTION void CALLING_CONVENTION GetLexerName(unsigned int index, char *name, int buflength) { *name = 0; if ((index == 0) && (buflength > static_cast(strlen(lexerName)))) { strcpy(name, lexerName); } } EXPORT_FUNCTION LexerFactoryFunction CALLING_CONVENTION GetLexerFactory(unsigned int index) { if (index == 0) return LexerSimple::LexerFactorySimple; else return 0; } EXPORT_FUNCTION Scintilla::ILexer5* CALLING_CONVENTION CreateLexer(const char *name) { if (0 == strcmp(name, lexerName)) { return LexerSimple::LexerFactorySimple(); } return nullptr; } EXPORT_FUNCTION const char * CALLING_CONVENTION GetNameSpace() { return "example"; } } lexilla/examples/SimpleLexer/makefile0000664000175000017500000000214614647367374016751 0ustar neilneil.PHONY: all check clean INCLUDES = -I ../../../scintilla/include -I ../../include -I ../../lexlib BASE_FLAGS += --std=c++17 ifdef windir SHAREDEXTENSION = dll else ifeq ($(shell uname),Darwin) SHAREDEXTENSION = dylib BASE_FLAGS += -arch arm64 -arch x86_64 LINK_FLAGS += -dynamiclib else BASE_FLAGS += -fPIC SHAREDEXTENSION = so endif BASE_FLAGS += -fvisibility=hidden endif ifdef windir RM = $(if $(wildcard $(dir $(SHELL))rm.exe), $(dir $(SHELL))rm.exe -f, del /q) CXX = g++ endif LIBRARY = SimpleLexer.$(SHAREDEXTENSION) vpath %.cxx ../../lexlib LEXLIB_SOURCES := $(sort $(notdir $(wildcard ../../lexlib/*.cxx))) LEXLIB = $(LEXLIB_SOURCES:.cxx=.o) %.o: %.cxx $(CXX) $(INCLUDES) $(BASE_FLAGS) $(CPPFLAGS) $(CXXFLAGS) -c $< -o $@ all: $(LIBRARY) # make check requires CheckLexilla to have already been built check: $(LIBRARY) ../CheckLexilla/CheckLexilla ./$(LIBRARY) clean: $(RM) *.o *obj *.lib *.exp $(LIBRARY) $(LIBRARY): $(LEXLIB) *.cxx $(CXX) $(INCLUDES) $(LINK_FLAGS) $(BASE_FLAGS) -shared $(CPPFLAGS) $(CXXFLAGS) $^ $(LIBS) $(LDLIBS) -o $@ lexilla/include/0000775000175000017500000000000014647367374012622 5ustar neilneillexilla/include/Lexilla.h0000664000175000017500000000653414647367374014375 0ustar neilneil// Lexilla lexer library /** @file Lexilla.h ** Lexilla definitions for dynamic and static linking. ** For C++, more features and type safety are available with the LexillaAccess module. **/ // Copyright 2020 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #ifndef LEXILLA_H #define LEXILLA_H // Define the default Lexilla shared library name for each platform #if defined(_WIN32) #define LEXILLA_LIB "lexilla" #define LEXILLA_EXTENSION ".dll" #else #define LEXILLA_LIB "liblexilla" #if defined(__APPLE__) #define LEXILLA_EXTENSION ".dylib" #else #define LEXILLA_EXTENSION ".so" #endif #endif // On Win32 use the stdcall calling convention otherwise use the standard calling convention #if defined(_WIN32) #define LEXILLA_CALL __stdcall #else #define LEXILLA_CALL #endif #if defined(__OBJC2__) // Objective C(++) treats '[' as a message expression. #define DEPRECATE_DEFINITION #elif defined(__cplusplus) #define DEPRECATE_DEFINITION [[deprecated]] #elif defined(__GNUC__) || defined(__clang__) #define DEPRECATE_DEFINITION __attribute__((deprecated)) #else // MSVC __declspec(deprecated) has different positioning rules to GCC so define to nothing #define DEPRECATE_DEFINITION #endif #if defined(__cplusplus) // Must have already included ILexer.h to have Scintilla::ILexer5 defined. using Scintilla::ILexer5; #else typedef void ILexer5; #endif typedef ILexer5 *(*LexerFactoryFunction)(void); #if defined(__cplusplus) namespace Lexilla { #endif typedef int (LEXILLA_CALL *GetLexerCountFn)(void); typedef void (LEXILLA_CALL *GetLexerNameFn)(unsigned int Index, char *name, int buflength); typedef LexerFactoryFunction(LEXILLA_CALL *GetLexerFactoryFn)(unsigned int Index); typedef ILexer5*(LEXILLA_CALL *CreateLexerFn)(const char *name); DEPRECATE_DEFINITION typedef const char *(LEXILLA_CALL *LexerNameFromIDFn)(int identifier); typedef const char *(LEXILLA_CALL *GetLibraryPropertyNamesFn)(void); typedef void(LEXILLA_CALL *SetLibraryPropertyFn)(const char *key, const char *value); typedef const char *(LEXILLA_CALL *GetNameSpaceFn)(void); #if defined(__cplusplus) } #endif #define LEXILLA_NAMESPACE_SEPARATOR '.' #define LEXILLA_GETLEXERCOUNT "GetLexerCount" #define LEXILLA_GETLEXERNAME "GetLexerName" #define LEXILLA_GETLEXERFACTORY "GetLexerFactory" #define LEXILLA_CREATELEXER "CreateLexer" #define LEXILLA_LEXERNAMEFROMID "LexerNameFromID" #define LEXILLA_GETLIBRARYPROPERTYNAMES "GetLibraryPropertyNames" #define LEXILLA_SETLIBRARYPROPERTY "SetLibraryProperty" #define LEXILLA_GETNAMESPACE "GetNameSpace" // Static linking prototypes #if defined(__cplusplus) extern "C" { #endif ILexer5 * LEXILLA_CALL CreateLexer(const char *name); int LEXILLA_CALL GetLexerCount(void); void LEXILLA_CALL GetLexerName(unsigned int index, char *name, int buflength); LexerFactoryFunction LEXILLA_CALL GetLexerFactory(unsigned int index); DEPRECATE_DEFINITION const char *LEXILLA_CALL LexerNameFromID(int identifier); const char * LEXILLA_CALL GetLibraryPropertyNames(void); void LEXILLA_CALL SetLibraryProperty(const char *key, const char *value); const char *LEXILLA_CALL GetNameSpace(void); #if defined(__cplusplus) } #endif #if defined(__cplusplus) namespace Lexilla { class LexerModule; } // Add a static lexer (in the same binary) to Lexilla's list void AddStaticLexerModule(Lexilla::LexerModule *plm); #endif #endif lexilla/include/LexicalStyles.iface0000664000175000017500000016267614647367374016422 0ustar neilneil## This file defines the interface to Lexilla ## Copyright 2000-2020 by Neil Hodgson ## The License.txt file describes the conditions under which this software may be distributed. ## Similar file structure as Scintilla.iface but only contains constants. cat Default ################################################ # For SciLexer.h enu Lexer=SCLEX_ val SCLEX_CONTAINER=0 val SCLEX_NULL=1 val SCLEX_PYTHON=2 val SCLEX_CPP=3 val SCLEX_HTML=4 val SCLEX_XML=5 val SCLEX_PERL=6 val SCLEX_SQL=7 val SCLEX_VB=8 val SCLEX_PROPERTIES=9 val SCLEX_ERRORLIST=10 val SCLEX_MAKEFILE=11 val SCLEX_BATCH=12 val SCLEX_XCODE=13 val SCLEX_LATEX=14 val SCLEX_LUA=15 val SCLEX_DIFF=16 val SCLEX_CONF=17 val SCLEX_PASCAL=18 val SCLEX_AVE=19 val SCLEX_ADA=20 val SCLEX_LISP=21 val SCLEX_RUBY=22 val SCLEX_EIFFEL=23 val SCLEX_EIFFELKW=24 val SCLEX_TCL=25 val SCLEX_NNCRONTAB=26 val SCLEX_BULLANT=27 val SCLEX_VBSCRIPT=28 val SCLEX_BAAN=31 val SCLEX_MATLAB=32 val SCLEX_SCRIPTOL=33 val SCLEX_ASM=34 val SCLEX_CPPNOCASE=35 val SCLEX_FORTRAN=36 val SCLEX_F77=37 val SCLEX_CSS=38 val SCLEX_POV=39 val SCLEX_LOUT=40 val SCLEX_ESCRIPT=41 val SCLEX_PS=42 val SCLEX_NSIS=43 val SCLEX_MMIXAL=44 val SCLEX_CLW=45 val SCLEX_CLWNOCASE=46 val SCLEX_LOT=47 val SCLEX_YAML=48 val SCLEX_TEX=49 val SCLEX_METAPOST=50 val SCLEX_POWERBASIC=51 val SCLEX_FORTH=52 val SCLEX_ERLANG=53 val SCLEX_OCTAVE=54 val SCLEX_MSSQL=55 val SCLEX_VERILOG=56 val SCLEX_KIX=57 val SCLEX_GUI4CLI=58 val SCLEX_SPECMAN=59 val SCLEX_AU3=60 val SCLEX_APDL=61 val SCLEX_BASH=62 val SCLEX_ASN1=63 val SCLEX_VHDL=64 val SCLEX_CAML=65 val SCLEX_BLITZBASIC=66 val SCLEX_PUREBASIC=67 val SCLEX_HASKELL=68 val SCLEX_PHPSCRIPT=69 val SCLEX_TADS3=70 val SCLEX_REBOL=71 val SCLEX_SMALLTALK=72 val SCLEX_FLAGSHIP=73 val SCLEX_CSOUND=74 val SCLEX_FREEBASIC=75 val SCLEX_INNOSETUP=76 val SCLEX_OPAL=77 val SCLEX_SPICE=78 val SCLEX_D=79 val SCLEX_CMAKE=80 val SCLEX_GAP=81 val SCLEX_PLM=82 val SCLEX_PROGRESS=83 val SCLEX_ABAQUS=84 val SCLEX_ASYMPTOTE=85 val SCLEX_R=86 val SCLEX_MAGIK=87 val SCLEX_POWERSHELL=88 val SCLEX_MYSQL=89 val SCLEX_PO=90 val SCLEX_TAL=91 val SCLEX_COBOL=92 val SCLEX_TACL=93 val SCLEX_SORCUS=94 val SCLEX_POWERPRO=95 val SCLEX_NIMROD=96 val SCLEX_SML=97 val SCLEX_MARKDOWN=98 val SCLEX_TXT2TAGS=99 val SCLEX_A68K=100 val SCLEX_MODULA=101 val SCLEX_COFFEESCRIPT=102 val SCLEX_TCMD=103 val SCLEX_AVS=104 val SCLEX_ECL=105 val SCLEX_OSCRIPT=106 val SCLEX_VISUALPROLOG=107 val SCLEX_LITERATEHASKELL=108 val SCLEX_STTXT=109 val SCLEX_KVIRC=110 val SCLEX_RUST=111 val SCLEX_DMAP=112 val SCLEX_AS=113 val SCLEX_DMIS=114 val SCLEX_REGISTRY=115 val SCLEX_BIBTEX=116 val SCLEX_SREC=117 val SCLEX_IHEX=118 val SCLEX_TEHEX=119 val SCLEX_JSON=120 val SCLEX_EDIFACT=121 val SCLEX_INDENT=122 val SCLEX_MAXIMA=123 val SCLEX_STATA=124 val SCLEX_SAS=125 val SCLEX_NIM=126 val SCLEX_CIL=127 val SCLEX_X12=128 val SCLEX_DATAFLEX=129 val SCLEX_HOLLYWOOD=130 val SCLEX_RAKU=131 val SCLEX_FSHARP=132 val SCLEX_JULIA=133 val SCLEX_ASCIIDOC=134 val SCLEX_GDSCRIPT=135 # When a lexer specifies its language as SCLEX_AUTOMATIC it receives a # value assigned in sequence from SCLEX_AUTOMATIC+1. val SCLEX_AUTOMATIC=1000 # Lexical states for SCLEX_PYTHON lex Python=SCLEX_PYTHON SCE_P_ lex Nimrod=SCLEX_NIMROD SCE_P_ val SCE_P_DEFAULT=0 val SCE_P_COMMENTLINE=1 val SCE_P_NUMBER=2 val SCE_P_STRING=3 val SCE_P_CHARACTER=4 val SCE_P_WORD=5 val SCE_P_TRIPLE=6 val SCE_P_TRIPLEDOUBLE=7 val SCE_P_CLASSNAME=8 val SCE_P_DEFNAME=9 val SCE_P_OPERATOR=10 val SCE_P_IDENTIFIER=11 val SCE_P_COMMENTBLOCK=12 val SCE_P_STRINGEOL=13 val SCE_P_WORD2=14 val SCE_P_DECORATOR=15 val SCE_P_FSTRING=16 val SCE_P_FCHARACTER=17 val SCE_P_FTRIPLE=18 val SCE_P_FTRIPLEDOUBLE=19 val SCE_P_ATTRIBUTE=20 # Lexical states for SCLEX_CPP # Lexical states for SCLEX_BULLANT # Lexical states for SCLEX_COBOL # Lexical states for SCLEX_TACL # Lexical states for SCLEX_TAL lex Cpp=SCLEX_CPP SCE_C_ lex BullAnt=SCLEX_BULLANT SCE_C_ lex COBOL=SCLEX_COBOL SCE_C_ lex TACL=SCLEX_TACL SCE_C_ lex TAL=SCLEX_TAL SCE_C_ val SCE_C_DEFAULT=0 val SCE_C_COMMENT=1 val SCE_C_COMMENTLINE=2 val SCE_C_COMMENTDOC=3 val SCE_C_NUMBER=4 val SCE_C_WORD=5 val SCE_C_STRING=6 val SCE_C_CHARACTER=7 val SCE_C_UUID=8 val SCE_C_PREPROCESSOR=9 val SCE_C_OPERATOR=10 val SCE_C_IDENTIFIER=11 val SCE_C_STRINGEOL=12 val SCE_C_VERBATIM=13 val SCE_C_REGEX=14 val SCE_C_COMMENTLINEDOC=15 val SCE_C_WORD2=16 val SCE_C_COMMENTDOCKEYWORD=17 val SCE_C_COMMENTDOCKEYWORDERROR=18 val SCE_C_GLOBALCLASS=19 val SCE_C_STRINGRAW=20 val SCE_C_TRIPLEVERBATIM=21 val SCE_C_HASHQUOTEDSTRING=22 val SCE_C_PREPROCESSORCOMMENT=23 val SCE_C_PREPROCESSORCOMMENTDOC=24 val SCE_C_USERLITERAL=25 val SCE_C_TASKMARKER=26 val SCE_C_ESCAPESEQUENCE=27 # Lexical states for SCLEX_D lex D=SCLEX_D SCE_D_ val SCE_D_DEFAULT=0 val SCE_D_COMMENT=1 val SCE_D_COMMENTLINE=2 val SCE_D_COMMENTDOC=3 val SCE_D_COMMENTNESTED=4 val SCE_D_NUMBER=5 val SCE_D_WORD=6 val SCE_D_WORD2=7 val SCE_D_WORD3=8 val SCE_D_TYPEDEF=9 val SCE_D_STRING=10 val SCE_D_STRINGEOL=11 val SCE_D_CHARACTER=12 val SCE_D_OPERATOR=13 val SCE_D_IDENTIFIER=14 val SCE_D_COMMENTLINEDOC=15 val SCE_D_COMMENTDOCKEYWORD=16 val SCE_D_COMMENTDOCKEYWORDERROR=17 val SCE_D_STRINGB=18 val SCE_D_STRINGR=19 val SCE_D_WORD5=20 val SCE_D_WORD6=21 val SCE_D_WORD7=22 # Lexical states for SCLEX_TCL lex TCL=SCLEX_TCL SCE_TCL_ val SCE_TCL_DEFAULT=0 val SCE_TCL_COMMENT=1 val SCE_TCL_COMMENTLINE=2 val SCE_TCL_NUMBER=3 val SCE_TCL_WORD_IN_QUOTE=4 val SCE_TCL_IN_QUOTE=5 val SCE_TCL_OPERATOR=6 val SCE_TCL_IDENTIFIER=7 val SCE_TCL_SUBSTITUTION=8 val SCE_TCL_SUB_BRACE=9 val SCE_TCL_MODIFIER=10 val SCE_TCL_EXPAND=11 val SCE_TCL_WORD=12 val SCE_TCL_WORD2=13 val SCE_TCL_WORD3=14 val SCE_TCL_WORD4=15 val SCE_TCL_WORD5=16 val SCE_TCL_WORD6=17 val SCE_TCL_WORD7=18 val SCE_TCL_WORD8=19 val SCE_TCL_COMMENT_BOX=20 val SCE_TCL_BLOCK_COMMENT=21 # Lexical states for SCLEX_HTML, SCLEX_XML lex HTML=SCLEX_HTML SCE_H_ SCE_HJ_ SCE_HJA_ SCE_HB_ SCE_HBA_ SCE_HP_ SCE_HPHP_ SCE_HPA_ lex XML=SCLEX_XML SCE_H_ SCE_HJ_ SCE_HJA_ SCE_HB_ SCE_HBA_ SCE_HP_ SCE_HPHP_ SCE_HPA_ val SCE_H_DEFAULT=0 val SCE_H_TAG=1 val SCE_H_TAGUNKNOWN=2 val SCE_H_ATTRIBUTE=3 val SCE_H_ATTRIBUTEUNKNOWN=4 val SCE_H_NUMBER=5 val SCE_H_DOUBLESTRING=6 val SCE_H_SINGLESTRING=7 val SCE_H_OTHER=8 val SCE_H_COMMENT=9 val SCE_H_ENTITY=10 # XML and ASP val SCE_H_TAGEND=11 val SCE_H_XMLSTART=12 val SCE_H_XMLEND=13 val SCE_H_SCRIPT=14 val SCE_H_ASP=15 val SCE_H_ASPAT=16 val SCE_H_CDATA=17 val SCE_H_QUESTION=18 # More HTML val SCE_H_VALUE=19 # X-Code, ASP.NET, JSP val SCE_H_XCCOMMENT=20 # SGML val SCE_H_SGML_DEFAULT=21 val SCE_H_SGML_COMMAND=22 val SCE_H_SGML_1ST_PARAM=23 val SCE_H_SGML_DOUBLESTRING=24 val SCE_H_SGML_SIMPLESTRING=25 val SCE_H_SGML_ERROR=26 val SCE_H_SGML_SPECIAL=27 val SCE_H_SGML_ENTITY=28 val SCE_H_SGML_COMMENT=29 val SCE_H_SGML_1ST_PARAM_COMMENT=30 val SCE_H_SGML_BLOCK_DEFAULT=31 # Embedded Javascript val SCE_HJ_START=40 val SCE_HJ_DEFAULT=41 val SCE_HJ_COMMENT=42 val SCE_HJ_COMMENTLINE=43 val SCE_HJ_COMMENTDOC=44 val SCE_HJ_NUMBER=45 val SCE_HJ_WORD=46 val SCE_HJ_KEYWORD=47 val SCE_HJ_DOUBLESTRING=48 val SCE_HJ_SINGLESTRING=49 val SCE_HJ_SYMBOLS=50 val SCE_HJ_STRINGEOL=51 val SCE_HJ_REGEX=52 # ASP Javascript val SCE_HJA_START=55 val SCE_HJA_DEFAULT=56 val SCE_HJA_COMMENT=57 val SCE_HJA_COMMENTLINE=58 val SCE_HJA_COMMENTDOC=59 val SCE_HJA_NUMBER=60 val SCE_HJA_WORD=61 val SCE_HJA_KEYWORD=62 val SCE_HJA_DOUBLESTRING=63 val SCE_HJA_SINGLESTRING=64 val SCE_HJA_SYMBOLS=65 val SCE_HJA_STRINGEOL=66 val SCE_HJA_REGEX=67 # Embedded VBScript val SCE_HB_START=70 val SCE_HB_DEFAULT=71 val SCE_HB_COMMENTLINE=72 val SCE_HB_NUMBER=73 val SCE_HB_WORD=74 val SCE_HB_STRING=75 val SCE_HB_IDENTIFIER=76 val SCE_HB_STRINGEOL=77 # ASP VBScript val SCE_HBA_START=80 val SCE_HBA_DEFAULT=81 val SCE_HBA_COMMENTLINE=82 val SCE_HBA_NUMBER=83 val SCE_HBA_WORD=84 val SCE_HBA_STRING=85 val SCE_HBA_IDENTIFIER=86 val SCE_HBA_STRINGEOL=87 # Embedded Python val SCE_HP_START=90 val SCE_HP_DEFAULT=91 val SCE_HP_COMMENTLINE=92 val SCE_HP_NUMBER=93 val SCE_HP_STRING=94 val SCE_HP_CHARACTER=95 val SCE_HP_WORD=96 val SCE_HP_TRIPLE=97 val SCE_HP_TRIPLEDOUBLE=98 val SCE_HP_CLASSNAME=99 val SCE_HP_DEFNAME=100 val SCE_HP_OPERATOR=101 val SCE_HP_IDENTIFIER=102 # PHP val SCE_HPHP_COMPLEX_VARIABLE=104 # ASP Python val SCE_HPA_START=105 val SCE_HPA_DEFAULT=106 val SCE_HPA_COMMENTLINE=107 val SCE_HPA_NUMBER=108 val SCE_HPA_STRING=109 val SCE_HPA_CHARACTER=110 val SCE_HPA_WORD=111 val SCE_HPA_TRIPLE=112 val SCE_HPA_TRIPLEDOUBLE=113 val SCE_HPA_CLASSNAME=114 val SCE_HPA_DEFNAME=115 val SCE_HPA_OPERATOR=116 val SCE_HPA_IDENTIFIER=117 # PHP val SCE_HPHP_DEFAULT=118 val SCE_HPHP_HSTRING=119 val SCE_HPHP_SIMPLESTRING=120 val SCE_HPHP_WORD=121 val SCE_HPHP_NUMBER=122 val SCE_HPHP_VARIABLE=123 val SCE_HPHP_COMMENT=124 val SCE_HPHP_COMMENTLINE=125 val SCE_HPHP_HSTRING_VARIABLE=126 val SCE_HPHP_OPERATOR=127 # Lexical states for SCLEX_PERL lex Perl=SCLEX_PERL SCE_PL_ val SCE_PL_DEFAULT=0 val SCE_PL_ERROR=1 val SCE_PL_COMMENTLINE=2 val SCE_PL_POD=3 val SCE_PL_NUMBER=4 val SCE_PL_WORD=5 val SCE_PL_STRING=6 val SCE_PL_CHARACTER=7 val SCE_PL_PUNCTUATION=8 val SCE_PL_PREPROCESSOR=9 val SCE_PL_OPERATOR=10 val SCE_PL_IDENTIFIER=11 val SCE_PL_SCALAR=12 val SCE_PL_ARRAY=13 val SCE_PL_HASH=14 val SCE_PL_SYMBOLTABLE=15 val SCE_PL_VARIABLE_INDEXER=16 val SCE_PL_REGEX=17 val SCE_PL_REGSUBST=18 val SCE_PL_LONGQUOTE=19 val SCE_PL_BACKTICKS=20 val SCE_PL_DATASECTION=21 val SCE_PL_HERE_DELIM=22 val SCE_PL_HERE_Q=23 val SCE_PL_HERE_QQ=24 val SCE_PL_HERE_QX=25 val SCE_PL_STRING_Q=26 val SCE_PL_STRING_QQ=27 val SCE_PL_STRING_QX=28 val SCE_PL_STRING_QR=29 val SCE_PL_STRING_QW=30 val SCE_PL_POD_VERB=31 val SCE_PL_SUB_PROTOTYPE=40 val SCE_PL_FORMAT_IDENT=41 val SCE_PL_FORMAT=42 val SCE_PL_STRING_VAR=43 val SCE_PL_XLAT=44 val SCE_PL_REGEX_VAR=54 val SCE_PL_REGSUBST_VAR=55 val SCE_PL_BACKTICKS_VAR=57 val SCE_PL_HERE_QQ_VAR=61 val SCE_PL_HERE_QX_VAR=62 val SCE_PL_STRING_QQ_VAR=64 val SCE_PL_STRING_QX_VAR=65 val SCE_PL_STRING_QR_VAR=66 # Lexical states for SCLEX_RUBY lex Ruby=SCLEX_RUBY SCE_RB_ val SCE_RB_DEFAULT=0 val SCE_RB_ERROR=1 val SCE_RB_COMMENTLINE=2 val SCE_RB_POD=3 val SCE_RB_NUMBER=4 val SCE_RB_WORD=5 val SCE_RB_STRING=6 val SCE_RB_CHARACTER=7 val SCE_RB_CLASSNAME=8 val SCE_RB_DEFNAME=9 val SCE_RB_OPERATOR=10 val SCE_RB_IDENTIFIER=11 val SCE_RB_REGEX=12 val SCE_RB_GLOBAL=13 val SCE_RB_SYMBOL=14 val SCE_RB_MODULE_NAME=15 val SCE_RB_INSTANCE_VAR=16 val SCE_RB_CLASS_VAR=17 val SCE_RB_BACKTICKS=18 val SCE_RB_DATASECTION=19 val SCE_RB_HERE_DELIM=20 val SCE_RB_HERE_Q=21 val SCE_RB_HERE_QQ=22 val SCE_RB_HERE_QX=23 val SCE_RB_STRING_Q=24 val SCE_RB_STRING_QQ=25 val SCE_RB_STRING_QX=26 val SCE_RB_STRING_QR=27 val SCE_RB_STRING_QW=28 val SCE_RB_WORD_DEMOTED=29 val SCE_RB_STDIN=30 val SCE_RB_STDOUT=31 val SCE_RB_STDERR=40 val SCE_RB_STRING_W=41 val SCE_RB_STRING_I=42 val SCE_RB_STRING_QI=43 val SCE_RB_STRING_QS=44 val SCE_RB_UPPER_BOUND=45 # Lexical states for SCLEX_VB, SCLEX_VBSCRIPT, SCLEX_POWERBASIC, SCLEX_BLITZBASIC, SCLEX_PUREBASIC, SCLEX_FREEBASIC lex VB=SCLEX_VB SCE_B_ lex VBScript=SCLEX_VBSCRIPT SCE_B_ lex PowerBasic=SCLEX_POWERBASIC SCE_B_ lex BlitzBasic=SCLEX_BLITZBASIC SCE_B_ lex PureBasic=SCLEX_PUREBASIC SCE_B_ lex FreeBasic=SCLEX_FREEBASIC SCE_B_ val SCE_B_DEFAULT=0 val SCE_B_COMMENT=1 val SCE_B_NUMBER=2 val SCE_B_KEYWORD=3 val SCE_B_STRING=4 val SCE_B_PREPROCESSOR=5 val SCE_B_OPERATOR=6 val SCE_B_IDENTIFIER=7 val SCE_B_DATE=8 val SCE_B_STRINGEOL=9 val SCE_B_KEYWORD2=10 val SCE_B_KEYWORD3=11 val SCE_B_KEYWORD4=12 val SCE_B_CONSTANT=13 val SCE_B_ASM=14 val SCE_B_LABEL=15 val SCE_B_ERROR=16 val SCE_B_HEXNUMBER=17 val SCE_B_BINNUMBER=18 val SCE_B_COMMENTBLOCK=19 val SCE_B_DOCLINE=20 val SCE_B_DOCBLOCK=21 val SCE_B_DOCKEYWORD=22 # Lexical states for SCLEX_PROPERTIES lex Properties=SCLEX_PROPERTIES SCE_PROPS_ val SCE_PROPS_DEFAULT=0 val SCE_PROPS_COMMENT=1 val SCE_PROPS_SECTION=2 val SCE_PROPS_ASSIGNMENT=3 val SCE_PROPS_DEFVAL=4 val SCE_PROPS_KEY=5 # Lexical states for SCLEX_LATEX lex LaTeX=SCLEX_LATEX SCE_L_ val SCE_L_DEFAULT=0 val SCE_L_COMMAND=1 val SCE_L_TAG=2 val SCE_L_MATH=3 val SCE_L_COMMENT=4 val SCE_L_TAG2=5 val SCE_L_MATH2=6 val SCE_L_COMMENT2=7 val SCE_L_VERBATIM=8 val SCE_L_SHORTCMD=9 val SCE_L_SPECIAL=10 val SCE_L_CMDOPT=11 val SCE_L_ERROR=12 # Lexical states for SCLEX_LUA lex Lua=SCLEX_LUA SCE_LUA_ val SCE_LUA_DEFAULT=0 val SCE_LUA_COMMENT=1 val SCE_LUA_COMMENTLINE=2 val SCE_LUA_COMMENTDOC=3 val SCE_LUA_NUMBER=4 val SCE_LUA_WORD=5 val SCE_LUA_STRING=6 val SCE_LUA_CHARACTER=7 val SCE_LUA_LITERALSTRING=8 val SCE_LUA_PREPROCESSOR=9 val SCE_LUA_OPERATOR=10 val SCE_LUA_IDENTIFIER=11 val SCE_LUA_STRINGEOL=12 val SCE_LUA_WORD2=13 val SCE_LUA_WORD3=14 val SCE_LUA_WORD4=15 val SCE_LUA_WORD5=16 val SCE_LUA_WORD6=17 val SCE_LUA_WORD7=18 val SCE_LUA_WORD8=19 val SCE_LUA_LABEL=20 # Lexical states for SCLEX_ERRORLIST lex ErrorList=SCLEX_ERRORLIST SCE_ERR_ val SCE_ERR_DEFAULT=0 val SCE_ERR_PYTHON=1 val SCE_ERR_GCC=2 val SCE_ERR_MS=3 val SCE_ERR_CMD=4 val SCE_ERR_BORLAND=5 val SCE_ERR_PERL=6 val SCE_ERR_NET=7 val SCE_ERR_LUA=8 val SCE_ERR_CTAG=9 val SCE_ERR_DIFF_CHANGED=10 val SCE_ERR_DIFF_ADDITION=11 val SCE_ERR_DIFF_DELETION=12 val SCE_ERR_DIFF_MESSAGE=13 val SCE_ERR_PHP=14 val SCE_ERR_ELF=15 val SCE_ERR_IFC=16 val SCE_ERR_IFORT=17 val SCE_ERR_ABSF=18 val SCE_ERR_TIDY=19 val SCE_ERR_JAVA_STACK=20 val SCE_ERR_VALUE=21 val SCE_ERR_GCC_INCLUDED_FROM=22 val SCE_ERR_ESCSEQ=23 val SCE_ERR_ESCSEQ_UNKNOWN=24 val SCE_ERR_GCC_EXCERPT=25 val SCE_ERR_BASH=26 val SCE_ERR_ES_BLACK=40 val SCE_ERR_ES_RED=41 val SCE_ERR_ES_GREEN=42 val SCE_ERR_ES_BROWN=43 val SCE_ERR_ES_BLUE=44 val SCE_ERR_ES_MAGENTA=45 val SCE_ERR_ES_CYAN=46 val SCE_ERR_ES_GRAY=47 val SCE_ERR_ES_DARK_GRAY=48 val SCE_ERR_ES_BRIGHT_RED=49 val SCE_ERR_ES_BRIGHT_GREEN=50 val SCE_ERR_ES_YELLOW=51 val SCE_ERR_ES_BRIGHT_BLUE=52 val SCE_ERR_ES_BRIGHT_MAGENTA=53 val SCE_ERR_ES_BRIGHT_CYAN=54 val SCE_ERR_ES_WHITE=55 # Lexical states for SCLEX_BATCH lex Batch=SCLEX_BATCH SCE_BAT_ val SCE_BAT_DEFAULT=0 val SCE_BAT_COMMENT=1 val SCE_BAT_WORD=2 val SCE_BAT_LABEL=3 val SCE_BAT_HIDE=4 val SCE_BAT_COMMAND=5 val SCE_BAT_IDENTIFIER=6 val SCE_BAT_OPERATOR=7 val SCE_BAT_AFTER_LABEL=8 # Lexical states for SCLEX_TCMD lex TCMD=SCLEX_TCMD SCE_TCMD_ val SCE_TCMD_DEFAULT=0 val SCE_TCMD_COMMENT=1 val SCE_TCMD_WORD=2 val SCE_TCMD_LABEL=3 val SCE_TCMD_HIDE=4 val SCE_TCMD_COMMAND=5 val SCE_TCMD_IDENTIFIER=6 val SCE_TCMD_OPERATOR=7 val SCE_TCMD_ENVIRONMENT=8 val SCE_TCMD_EXPANSION=9 val SCE_TCMD_CLABEL=10 # Lexical states for SCLEX_MAKEFILE lex MakeFile=SCLEX_MAKEFILE SCE_MAKE_ val SCE_MAKE_DEFAULT=0 val SCE_MAKE_COMMENT=1 val SCE_MAKE_PREPROCESSOR=2 val SCE_MAKE_IDENTIFIER=3 val SCE_MAKE_OPERATOR=4 val SCE_MAKE_TARGET=5 val SCE_MAKE_IDEOL=9 # Lexical states for SCLEX_DIFF lex Diff=SCLEX_DIFF SCE_DIFF_ val SCE_DIFF_DEFAULT=0 val SCE_DIFF_COMMENT=1 val SCE_DIFF_COMMAND=2 val SCE_DIFF_HEADER=3 val SCE_DIFF_POSITION=4 val SCE_DIFF_DELETED=5 val SCE_DIFF_ADDED=6 val SCE_DIFF_CHANGED=7 val SCE_DIFF_PATCH_ADD=8 val SCE_DIFF_PATCH_DELETE=9 val SCE_DIFF_REMOVED_PATCH_ADD=10 val SCE_DIFF_REMOVED_PATCH_DELETE=11 # Lexical states for SCLEX_CONF (Apache Configuration Files Lexer) lex Conf=SCLEX_CONF SCE_CONF_ val SCE_CONF_DEFAULT=0 val SCE_CONF_COMMENT=1 val SCE_CONF_NUMBER=2 val SCE_CONF_IDENTIFIER=3 val SCE_CONF_EXTENSION=4 val SCE_CONF_PARAMETER=5 val SCE_CONF_STRING=6 val SCE_CONF_OPERATOR=7 val SCE_CONF_IP=8 val SCE_CONF_DIRECTIVE=9 # Lexical states for SCLEX_AVE, Avenue lex Avenue=SCLEX_AVE SCE_AVE_ val SCE_AVE_DEFAULT=0 val SCE_AVE_COMMENT=1 val SCE_AVE_NUMBER=2 val SCE_AVE_WORD=3 val SCE_AVE_STRING=6 val SCE_AVE_ENUM=7 val SCE_AVE_STRINGEOL=8 val SCE_AVE_IDENTIFIER=9 val SCE_AVE_OPERATOR=10 val SCE_AVE_WORD1=11 val SCE_AVE_WORD2=12 val SCE_AVE_WORD3=13 val SCE_AVE_WORD4=14 val SCE_AVE_WORD5=15 val SCE_AVE_WORD6=16 # Lexical states for SCLEX_ADA lex Ada=SCLEX_ADA SCE_ADA_ val SCE_ADA_DEFAULT=0 val SCE_ADA_WORD=1 val SCE_ADA_IDENTIFIER=2 val SCE_ADA_NUMBER=3 val SCE_ADA_DELIMITER=4 val SCE_ADA_CHARACTER=5 val SCE_ADA_CHARACTEREOL=6 val SCE_ADA_STRING=7 val SCE_ADA_STRINGEOL=8 val SCE_ADA_LABEL=9 val SCE_ADA_COMMENTLINE=10 val SCE_ADA_ILLEGAL=11 # Lexical states for SCLEX_BAAN lex Baan=SCLEX_BAAN SCE_BAAN_ val SCE_BAAN_DEFAULT=0 val SCE_BAAN_COMMENT=1 val SCE_BAAN_COMMENTDOC=2 val SCE_BAAN_NUMBER=3 val SCE_BAAN_WORD=4 val SCE_BAAN_STRING=5 val SCE_BAAN_PREPROCESSOR=6 val SCE_BAAN_OPERATOR=7 val SCE_BAAN_IDENTIFIER=8 val SCE_BAAN_STRINGEOL=9 val SCE_BAAN_WORD2=10 val SCE_BAAN_WORD3=11 val SCE_BAAN_WORD4=12 val SCE_BAAN_WORD5=13 val SCE_BAAN_WORD6=14 val SCE_BAAN_WORD7=15 val SCE_BAAN_WORD8=16 val SCE_BAAN_WORD9=17 val SCE_BAAN_TABLEDEF=18 val SCE_BAAN_TABLESQL=19 val SCE_BAAN_FUNCTION=20 val SCE_BAAN_DOMDEF=21 val SCE_BAAN_FUNCDEF=22 val SCE_BAAN_OBJECTDEF=23 val SCE_BAAN_DEFINEDEF=24 # Lexical states for SCLEX_LISP lex Lisp=SCLEX_LISP SCE_LISP_ val SCE_LISP_DEFAULT=0 val SCE_LISP_COMMENT=1 val SCE_LISP_NUMBER=2 val SCE_LISP_KEYWORD=3 val SCE_LISP_KEYWORD_KW=4 val SCE_LISP_SYMBOL=5 val SCE_LISP_STRING=6 val SCE_LISP_STRINGEOL=8 val SCE_LISP_IDENTIFIER=9 val SCE_LISP_OPERATOR=10 val SCE_LISP_SPECIAL=11 val SCE_LISP_MULTI_COMMENT=12 # Lexical states for SCLEX_EIFFEL and SCLEX_EIFFELKW lex Eiffel=SCLEX_EIFFEL SCE_EIFFEL_ lex EiffelKW=SCLEX_EIFFELKW SCE_EIFFEL_ val SCE_EIFFEL_DEFAULT=0 val SCE_EIFFEL_COMMENTLINE=1 val SCE_EIFFEL_NUMBER=2 val SCE_EIFFEL_WORD=3 val SCE_EIFFEL_STRING=4 val SCE_EIFFEL_CHARACTER=5 val SCE_EIFFEL_OPERATOR=6 val SCE_EIFFEL_IDENTIFIER=7 val SCE_EIFFEL_STRINGEOL=8 # Lexical states for SCLEX_NNCRONTAB (nnCron crontab Lexer) lex NNCronTab=SCLEX_NNCRONTAB SCE_NNCRONTAB_ val SCE_NNCRONTAB_DEFAULT=0 val SCE_NNCRONTAB_COMMENT=1 val SCE_NNCRONTAB_TASK=2 val SCE_NNCRONTAB_SECTION=3 val SCE_NNCRONTAB_KEYWORD=4 val SCE_NNCRONTAB_MODIFIER=5 val SCE_NNCRONTAB_ASTERISK=6 val SCE_NNCRONTAB_NUMBER=7 val SCE_NNCRONTAB_STRING=8 val SCE_NNCRONTAB_ENVIRONMENT=9 val SCE_NNCRONTAB_IDENTIFIER=10 # Lexical states for SCLEX_FORTH (Forth Lexer) lex Forth=SCLEX_FORTH SCE_FORTH_ val SCE_FORTH_DEFAULT=0 val SCE_FORTH_COMMENT=1 val SCE_FORTH_COMMENT_ML=2 val SCE_FORTH_IDENTIFIER=3 val SCE_FORTH_CONTROL=4 val SCE_FORTH_KEYWORD=5 val SCE_FORTH_DEFWORD=6 val SCE_FORTH_PREWORD1=7 val SCE_FORTH_PREWORD2=8 val SCE_FORTH_NUMBER=9 val SCE_FORTH_STRING=10 val SCE_FORTH_LOCALE=11 # Lexical states for SCLEX_MATLAB lex MatLab=SCLEX_MATLAB SCE_MATLAB_ val SCE_MATLAB_DEFAULT=0 val SCE_MATLAB_COMMENT=1 val SCE_MATLAB_COMMAND=2 val SCE_MATLAB_NUMBER=3 val SCE_MATLAB_KEYWORD=4 # single quoted string val SCE_MATLAB_STRING=5 val SCE_MATLAB_OPERATOR=6 val SCE_MATLAB_IDENTIFIER=7 val SCE_MATLAB_DOUBLEQUOTESTRING=8 # Lexical states for SCLEX_MAXIMA lex Maxima=SCLEX_MAXIMA SCE_MAXIMA_ val SCE_MAXIMA_OPERATOR=0 val SCE_MAXIMA_COMMANDENDING=1 val SCE_MAXIMA_COMMENT=2 val SCE_MAXIMA_NUMBER=3 val SCE_MAXIMA_STRING=4 val SCE_MAXIMA_COMMAND=5 val SCE_MAXIMA_VARIABLE=6 val SCE_MAXIMA_UNKNOWN=7 # Lexical states for SCLEX_SCRIPTOL lex Sol=SCLEX_SCRIPTOL SCE_SCRIPTOL_ val SCE_SCRIPTOL_DEFAULT=0 val SCE_SCRIPTOL_WHITE=1 val SCE_SCRIPTOL_COMMENTLINE=2 val SCE_SCRIPTOL_PERSISTENT=3 val SCE_SCRIPTOL_CSTYLE=4 val SCE_SCRIPTOL_COMMENTBLOCK=5 val SCE_SCRIPTOL_NUMBER=6 val SCE_SCRIPTOL_STRING=7 val SCE_SCRIPTOL_CHARACTER=8 val SCE_SCRIPTOL_STRINGEOL=9 val SCE_SCRIPTOL_KEYWORD=10 val SCE_SCRIPTOL_OPERATOR=11 val SCE_SCRIPTOL_IDENTIFIER=12 val SCE_SCRIPTOL_TRIPLE=13 val SCE_SCRIPTOL_CLASSNAME=14 val SCE_SCRIPTOL_PREPROCESSOR=15 # Lexical states for SCLEX_ASM, SCLEX_AS lex Asm=SCLEX_ASM SCE_ASM_ lex As=SCLEX_AS SCE_ASM_ val SCE_ASM_DEFAULT=0 val SCE_ASM_COMMENT=1 val SCE_ASM_NUMBER=2 val SCE_ASM_STRING=3 val SCE_ASM_OPERATOR=4 val SCE_ASM_IDENTIFIER=5 val SCE_ASM_CPUINSTRUCTION=6 val SCE_ASM_MATHINSTRUCTION=7 val SCE_ASM_REGISTER=8 val SCE_ASM_DIRECTIVE=9 val SCE_ASM_DIRECTIVEOPERAND=10 val SCE_ASM_COMMENTBLOCK=11 val SCE_ASM_CHARACTER=12 val SCE_ASM_STRINGEOL=13 val SCE_ASM_EXTINSTRUCTION=14 val SCE_ASM_COMMENTDIRECTIVE=15 # Lexical states for SCLEX_FORTRAN lex Fortran=SCLEX_FORTRAN SCE_F_ lex F77=SCLEX_F77 SCE_F_ val SCE_F_DEFAULT=0 val SCE_F_COMMENT=1 val SCE_F_NUMBER=2 val SCE_F_STRING1=3 val SCE_F_STRING2=4 val SCE_F_STRINGEOL=5 val SCE_F_OPERATOR=6 val SCE_F_IDENTIFIER=7 val SCE_F_WORD=8 val SCE_F_WORD2=9 val SCE_F_WORD3=10 val SCE_F_PREPROCESSOR=11 val SCE_F_OPERATOR2=12 val SCE_F_LABEL=13 val SCE_F_CONTINUATION=14 # Lexical states for SCLEX_CSS lex CSS=SCLEX_CSS SCE_CSS_ val SCE_CSS_DEFAULT=0 val SCE_CSS_TAG=1 val SCE_CSS_CLASS=2 val SCE_CSS_PSEUDOCLASS=3 val SCE_CSS_UNKNOWN_PSEUDOCLASS=4 val SCE_CSS_OPERATOR=5 val SCE_CSS_IDENTIFIER=6 val SCE_CSS_UNKNOWN_IDENTIFIER=7 val SCE_CSS_VALUE=8 val SCE_CSS_COMMENT=9 val SCE_CSS_ID=10 val SCE_CSS_IMPORTANT=11 val SCE_CSS_DIRECTIVE=12 val SCE_CSS_DOUBLESTRING=13 val SCE_CSS_SINGLESTRING=14 val SCE_CSS_IDENTIFIER2=15 val SCE_CSS_ATTRIBUTE=16 val SCE_CSS_IDENTIFIER3=17 val SCE_CSS_PSEUDOELEMENT=18 val SCE_CSS_EXTENDED_IDENTIFIER=19 val SCE_CSS_EXTENDED_PSEUDOCLASS=20 val SCE_CSS_EXTENDED_PSEUDOELEMENT=21 val SCE_CSS_GROUP_RULE=22 val SCE_CSS_VARIABLE=23 # Lexical states for SCLEX_POV lex POV=SCLEX_POV SCE_POV_ val SCE_POV_DEFAULT=0 val SCE_POV_COMMENT=1 val SCE_POV_COMMENTLINE=2 val SCE_POV_NUMBER=3 val SCE_POV_OPERATOR=4 val SCE_POV_IDENTIFIER=5 val SCE_POV_STRING=6 val SCE_POV_STRINGEOL=7 val SCE_POV_DIRECTIVE=8 val SCE_POV_BADDIRECTIVE=9 val SCE_POV_WORD2=10 val SCE_POV_WORD3=11 val SCE_POV_WORD4=12 val SCE_POV_WORD5=13 val SCE_POV_WORD6=14 val SCE_POV_WORD7=15 val SCE_POV_WORD8=16 # Lexical states for SCLEX_LOUT lex LOUT=SCLEX_LOUT SCE_LOUT_ val SCE_LOUT_DEFAULT=0 val SCE_LOUT_COMMENT=1 val SCE_LOUT_NUMBER=2 val SCE_LOUT_WORD=3 val SCE_LOUT_WORD2=4 val SCE_LOUT_WORD3=5 val SCE_LOUT_WORD4=6 val SCE_LOUT_STRING=7 val SCE_LOUT_OPERATOR=8 val SCE_LOUT_IDENTIFIER=9 val SCE_LOUT_STRINGEOL=10 # Lexical states for SCLEX_ESCRIPT lex ESCRIPT=SCLEX_ESCRIPT SCE_ESCRIPT_ val SCE_ESCRIPT_DEFAULT=0 val SCE_ESCRIPT_COMMENT=1 val SCE_ESCRIPT_COMMENTLINE=2 val SCE_ESCRIPT_COMMENTDOC=3 val SCE_ESCRIPT_NUMBER=4 val SCE_ESCRIPT_WORD=5 val SCE_ESCRIPT_STRING=6 val SCE_ESCRIPT_OPERATOR=7 val SCE_ESCRIPT_IDENTIFIER=8 val SCE_ESCRIPT_BRACE=9 val SCE_ESCRIPT_WORD2=10 val SCE_ESCRIPT_WORD3=11 # Lexical states for SCLEX_PS lex PS=SCLEX_PS SCE_PS_ val SCE_PS_DEFAULT=0 val SCE_PS_COMMENT=1 val SCE_PS_DSC_COMMENT=2 val SCE_PS_DSC_VALUE=3 val SCE_PS_NUMBER=4 val SCE_PS_NAME=5 val SCE_PS_KEYWORD=6 val SCE_PS_LITERAL=7 val SCE_PS_IMMEVAL=8 val SCE_PS_PAREN_ARRAY=9 val SCE_PS_PAREN_DICT=10 val SCE_PS_PAREN_PROC=11 val SCE_PS_TEXT=12 val SCE_PS_HEXSTRING=13 val SCE_PS_BASE85STRING=14 val SCE_PS_BADSTRINGCHAR=15 # Lexical states for SCLEX_NSIS lex NSIS=SCLEX_NSIS SCE_NSIS_ val SCE_NSIS_DEFAULT=0 val SCE_NSIS_COMMENT=1 val SCE_NSIS_STRINGDQ=2 val SCE_NSIS_STRINGLQ=3 val SCE_NSIS_STRINGRQ=4 val SCE_NSIS_FUNCTION=5 val SCE_NSIS_VARIABLE=6 val SCE_NSIS_LABEL=7 val SCE_NSIS_USERDEFINED=8 val SCE_NSIS_SECTIONDEF=9 val SCE_NSIS_SUBSECTIONDEF=10 val SCE_NSIS_IFDEFINEDEF=11 val SCE_NSIS_MACRODEF=12 val SCE_NSIS_STRINGVAR=13 val SCE_NSIS_NUMBER=14 val SCE_NSIS_SECTIONGROUP=15 val SCE_NSIS_PAGEEX=16 val SCE_NSIS_FUNCTIONDEF=17 val SCE_NSIS_COMMENTBOX=18 # Lexical states for SCLEX_MMIXAL lex MMIXAL=SCLEX_MMIXAL SCE_MMIXAL_ val SCE_MMIXAL_LEADWS=0 val SCE_MMIXAL_COMMENT=1 val SCE_MMIXAL_LABEL=2 val SCE_MMIXAL_OPCODE=3 val SCE_MMIXAL_OPCODE_PRE=4 val SCE_MMIXAL_OPCODE_VALID=5 val SCE_MMIXAL_OPCODE_UNKNOWN=6 val SCE_MMIXAL_OPCODE_POST=7 val SCE_MMIXAL_OPERANDS=8 val SCE_MMIXAL_NUMBER=9 val SCE_MMIXAL_REF=10 val SCE_MMIXAL_CHAR=11 val SCE_MMIXAL_STRING=12 val SCE_MMIXAL_REGISTER=13 val SCE_MMIXAL_HEX=14 val SCE_MMIXAL_OPERATOR=15 val SCE_MMIXAL_SYMBOL=16 val SCE_MMIXAL_INCLUDE=17 # Lexical states for SCLEX_CLW lex Clarion=SCLEX_CLW SCE_CLW_ val SCE_CLW_DEFAULT=0 val SCE_CLW_LABEL=1 val SCE_CLW_COMMENT=2 val SCE_CLW_STRING=3 val SCE_CLW_USER_IDENTIFIER=4 val SCE_CLW_INTEGER_CONSTANT=5 val SCE_CLW_REAL_CONSTANT=6 val SCE_CLW_PICTURE_STRING=7 val SCE_CLW_KEYWORD=8 val SCE_CLW_COMPILER_DIRECTIVE=9 val SCE_CLW_RUNTIME_EXPRESSIONS=10 val SCE_CLW_BUILTIN_PROCEDURES_FUNCTION=11 val SCE_CLW_STRUCTURE_DATA_TYPE=12 val SCE_CLW_ATTRIBUTE=13 val SCE_CLW_STANDARD_EQUATE=14 val SCE_CLW_ERROR=15 val SCE_CLW_DEPRECATED=16 # Lexical states for SCLEX_LOT lex LOT=SCLEX_LOT SCE_LOT_ val SCE_LOT_DEFAULT=0 val SCE_LOT_HEADER=1 val SCE_LOT_BREAK=2 val SCE_LOT_SET=3 val SCE_LOT_PASS=4 val SCE_LOT_FAIL=5 val SCE_LOT_ABORT=6 # Lexical states for SCLEX_YAML lex YAML=SCLEX_YAML SCE_YAML_ val SCE_YAML_DEFAULT=0 val SCE_YAML_COMMENT=1 val SCE_YAML_IDENTIFIER=2 val SCE_YAML_KEYWORD=3 val SCE_YAML_NUMBER=4 val SCE_YAML_REFERENCE=5 val SCE_YAML_DOCUMENT=6 val SCE_YAML_TEXT=7 val SCE_YAML_ERROR=8 val SCE_YAML_OPERATOR=9 # Lexical states for SCLEX_TEX lex TeX=SCLEX_TEX SCE_TEX_ val SCE_TEX_DEFAULT=0 val SCE_TEX_SPECIAL=1 val SCE_TEX_GROUP=2 val SCE_TEX_SYMBOL=3 val SCE_TEX_COMMAND=4 val SCE_TEX_TEXT=5 lex Metapost=SCLEX_METAPOST SCE_METAPOST_ val SCE_METAPOST_DEFAULT=0 val SCE_METAPOST_SPECIAL=1 val SCE_METAPOST_GROUP=2 val SCE_METAPOST_SYMBOL=3 val SCE_METAPOST_COMMAND=4 val SCE_METAPOST_TEXT=5 val SCE_METAPOST_EXTRA=6 # Lexical states for SCLEX_ERLANG lex Erlang=SCLEX_ERLANG SCE_ERLANG_ val SCE_ERLANG_DEFAULT=0 val SCE_ERLANG_COMMENT=1 val SCE_ERLANG_VARIABLE=2 val SCE_ERLANG_NUMBER=3 val SCE_ERLANG_KEYWORD=4 val SCE_ERLANG_STRING=5 val SCE_ERLANG_OPERATOR=6 val SCE_ERLANG_ATOM=7 val SCE_ERLANG_FUNCTION_NAME=8 val SCE_ERLANG_CHARACTER=9 val SCE_ERLANG_MACRO=10 val SCE_ERLANG_RECORD=11 val SCE_ERLANG_PREPROC=12 val SCE_ERLANG_NODE_NAME=13 val SCE_ERLANG_COMMENT_FUNCTION=14 val SCE_ERLANG_COMMENT_MODULE=15 val SCE_ERLANG_COMMENT_DOC=16 val SCE_ERLANG_COMMENT_DOC_MACRO=17 val SCE_ERLANG_ATOM_QUOTED=18 val SCE_ERLANG_MACRO_QUOTED=19 val SCE_ERLANG_RECORD_QUOTED=20 val SCE_ERLANG_NODE_NAME_QUOTED=21 val SCE_ERLANG_BIFS=22 val SCE_ERLANG_MODULES=23 val SCE_ERLANG_MODULES_ATT=24 val SCE_ERLANG_UNKNOWN=31 # Lexical states for SCLEX_OCTAVE are identical to MatLab lex Octave=SCLEX_OCTAVE SCE_MATLAB_ # Lexical states for SCLEX_JULIA lex Julia=SCLEX_JULIA SCE_JULIA_ val SCE_JULIA_DEFAULT=0 val SCE_JULIA_COMMENT=1 val SCE_JULIA_NUMBER=2 val SCE_JULIA_KEYWORD1=3 val SCE_JULIA_KEYWORD2=4 val SCE_JULIA_KEYWORD3=5 val SCE_JULIA_CHAR=6 val SCE_JULIA_OPERATOR=7 val SCE_JULIA_BRACKET=8 val SCE_JULIA_IDENTIFIER=9 val SCE_JULIA_STRING=10 val SCE_JULIA_SYMBOL=11 val SCE_JULIA_MACRO=12 val SCE_JULIA_STRINGINTERP=13 val SCE_JULIA_DOCSTRING=14 val SCE_JULIA_STRINGLITERAL=15 val SCE_JULIA_COMMAND=16 val SCE_JULIA_COMMANDLITERAL=17 val SCE_JULIA_TYPEANNOT=18 val SCE_JULIA_LEXERROR=19 val SCE_JULIA_KEYWORD4=20 val SCE_JULIA_TYPEOPERATOR=21 # Lexical states for SCLEX_MSSQL lex MSSQL=SCLEX_MSSQL SCE_MSSQL_ val SCE_MSSQL_DEFAULT=0 val SCE_MSSQL_COMMENT=1 val SCE_MSSQL_LINE_COMMENT=2 val SCE_MSSQL_NUMBER=3 val SCE_MSSQL_STRING=4 val SCE_MSSQL_OPERATOR=5 val SCE_MSSQL_IDENTIFIER=6 val SCE_MSSQL_VARIABLE=7 val SCE_MSSQL_COLUMN_NAME=8 val SCE_MSSQL_STATEMENT=9 val SCE_MSSQL_DATATYPE=10 val SCE_MSSQL_SYSTABLE=11 val SCE_MSSQL_GLOBAL_VARIABLE=12 val SCE_MSSQL_FUNCTION=13 val SCE_MSSQL_STORED_PROCEDURE=14 val SCE_MSSQL_DEFAULT_PREF_DATATYPE=15 val SCE_MSSQL_COLUMN_NAME_2=16 # Lexical states for SCLEX_VERILOG lex Verilog=SCLEX_VERILOG SCE_V_ val SCE_V_DEFAULT=0 val SCE_V_COMMENT=1 val SCE_V_COMMENTLINE=2 val SCE_V_COMMENTLINEBANG=3 val SCE_V_NUMBER=4 val SCE_V_WORD=5 val SCE_V_STRING=6 val SCE_V_WORD2=7 val SCE_V_WORD3=8 val SCE_V_PREPROCESSOR=9 val SCE_V_OPERATOR=10 val SCE_V_IDENTIFIER=11 val SCE_V_STRINGEOL=12 val SCE_V_USER=19 val SCE_V_COMMENT_WORD=20 val SCE_V_INPUT=21 val SCE_V_OUTPUT=22 val SCE_V_INOUT=23 val SCE_V_PORT_CONNECT=24 # Lexical states for SCLEX_KIX lex Kix=SCLEX_KIX SCE_KIX_ val SCE_KIX_DEFAULT=0 val SCE_KIX_COMMENT=1 val SCE_KIX_STRING1=2 val SCE_KIX_STRING2=3 val SCE_KIX_NUMBER=4 val SCE_KIX_VAR=5 val SCE_KIX_MACRO=6 val SCE_KIX_KEYWORD=7 val SCE_KIX_FUNCTIONS=8 val SCE_KIX_OPERATOR=9 val SCE_KIX_COMMENTSTREAM=10 val SCE_KIX_IDENTIFIER=31 # Lexical states for SCLEX_GUI4CLI lex Gui4Cli=SCLEX_GUI4CLI SCE_GC_ val SCE_GC_DEFAULT=0 val SCE_GC_COMMENTLINE=1 val SCE_GC_COMMENTBLOCK=2 val SCE_GC_GLOBAL=3 val SCE_GC_EVENT=4 val SCE_GC_ATTRIBUTE=5 val SCE_GC_CONTROL=6 val SCE_GC_COMMAND=7 val SCE_GC_STRING=8 val SCE_GC_OPERATOR=9 # Lexical states for SCLEX_SPECMAN lex Specman=SCLEX_SPECMAN SCE_SN_ val SCE_SN_DEFAULT=0 val SCE_SN_CODE=1 val SCE_SN_COMMENTLINE=2 val SCE_SN_COMMENTLINEBANG=3 val SCE_SN_NUMBER=4 val SCE_SN_WORD=5 val SCE_SN_STRING=6 val SCE_SN_WORD2=7 val SCE_SN_WORD3=8 val SCE_SN_PREPROCESSOR=9 val SCE_SN_OPERATOR=10 val SCE_SN_IDENTIFIER=11 val SCE_SN_STRINGEOL=12 val SCE_SN_REGEXTAG=13 val SCE_SN_SIGNAL=14 val SCE_SN_USER=19 # Lexical states for SCLEX_AU3 lex Au3=SCLEX_AU3 SCE_AU3_ val SCE_AU3_DEFAULT=0 val SCE_AU3_COMMENT=1 val SCE_AU3_COMMENTBLOCK=2 val SCE_AU3_NUMBER=3 val SCE_AU3_FUNCTION=4 val SCE_AU3_KEYWORD=5 val SCE_AU3_MACRO=6 val SCE_AU3_STRING=7 val SCE_AU3_OPERATOR=8 val SCE_AU3_VARIABLE=9 val SCE_AU3_SENT=10 val SCE_AU3_PREPROCESSOR=11 val SCE_AU3_SPECIAL=12 val SCE_AU3_EXPAND=13 val SCE_AU3_COMOBJ=14 val SCE_AU3_UDF=15 # Lexical states for SCLEX_APDL lex APDL=SCLEX_APDL SCE_APDL_ val SCE_APDL_DEFAULT=0 val SCE_APDL_COMMENT=1 val SCE_APDL_COMMENTBLOCK=2 val SCE_APDL_NUMBER=3 val SCE_APDL_STRING=4 val SCE_APDL_OPERATOR=5 val SCE_APDL_WORD=6 val SCE_APDL_PROCESSOR=7 val SCE_APDL_COMMAND=8 val SCE_APDL_SLASHCOMMAND=9 val SCE_APDL_STARCOMMAND=10 val SCE_APDL_ARGUMENT=11 val SCE_APDL_FUNCTION=12 # Lexical states for SCLEX_BASH lex Bash=SCLEX_BASH SCE_SH_ val SCE_SH_DEFAULT=0 val SCE_SH_ERROR=1 val SCE_SH_COMMENTLINE=2 val SCE_SH_NUMBER=3 val SCE_SH_WORD=4 val SCE_SH_STRING=5 val SCE_SH_CHARACTER=6 val SCE_SH_OPERATOR=7 val SCE_SH_IDENTIFIER=8 val SCE_SH_SCALAR=9 val SCE_SH_PARAM=10 val SCE_SH_BACKTICKS=11 val SCE_SH_HERE_DELIM=12 val SCE_SH_HERE_Q=13 # Lexical states for SCLEX_ASN1 lex Asn1=SCLEX_ASN1 SCE_ASN1_ val SCE_ASN1_DEFAULT=0 val SCE_ASN1_COMMENT=1 val SCE_ASN1_IDENTIFIER=2 val SCE_ASN1_STRING=3 val SCE_ASN1_OID=4 val SCE_ASN1_SCALAR=5 val SCE_ASN1_KEYWORD=6 val SCE_ASN1_ATTRIBUTE=7 val SCE_ASN1_DESCRIPTOR=8 val SCE_ASN1_TYPE=9 val SCE_ASN1_OPERATOR=10 # Lexical states for SCLEX_VHDL lex VHDL=SCLEX_VHDL SCE_VHDL_ val SCE_VHDL_DEFAULT=0 val SCE_VHDL_COMMENT=1 val SCE_VHDL_COMMENTLINEBANG=2 val SCE_VHDL_NUMBER=3 val SCE_VHDL_STRING=4 val SCE_VHDL_OPERATOR=5 val SCE_VHDL_IDENTIFIER=6 val SCE_VHDL_STRINGEOL=7 val SCE_VHDL_KEYWORD=8 val SCE_VHDL_STDOPERATOR=9 val SCE_VHDL_ATTRIBUTE=10 val SCE_VHDL_STDFUNCTION=11 val SCE_VHDL_STDPACKAGE=12 val SCE_VHDL_STDTYPE=13 val SCE_VHDL_USERWORD=14 val SCE_VHDL_BLOCK_COMMENT=15 # Lexical states for SCLEX_CAML lex Caml=SCLEX_CAML SCE_CAML_ val SCE_CAML_DEFAULT=0 val SCE_CAML_IDENTIFIER=1 val SCE_CAML_TAGNAME=2 val SCE_CAML_KEYWORD=3 val SCE_CAML_KEYWORD2=4 val SCE_CAML_KEYWORD3=5 val SCE_CAML_LINENUM=6 val SCE_CAML_OPERATOR=7 val SCE_CAML_NUMBER=8 val SCE_CAML_CHAR=9 val SCE_CAML_WHITE=10 val SCE_CAML_STRING=11 val SCE_CAML_COMMENT=12 val SCE_CAML_COMMENT1=13 val SCE_CAML_COMMENT2=14 val SCE_CAML_COMMENT3=15 # Lexical states for SCLEX_HASKELL lex Haskell=SCLEX_HASKELL SCE_HA_ val SCE_HA_DEFAULT=0 val SCE_HA_IDENTIFIER=1 val SCE_HA_KEYWORD=2 val SCE_HA_NUMBER=3 val SCE_HA_STRING=4 val SCE_HA_CHARACTER=5 val SCE_HA_CLASS=6 val SCE_HA_MODULE=7 val SCE_HA_CAPITAL=8 val SCE_HA_DATA=9 val SCE_HA_IMPORT=10 val SCE_HA_OPERATOR=11 val SCE_HA_INSTANCE=12 val SCE_HA_COMMENTLINE=13 val SCE_HA_COMMENTBLOCK=14 val SCE_HA_COMMENTBLOCK2=15 val SCE_HA_COMMENTBLOCK3=16 val SCE_HA_PRAGMA=17 val SCE_HA_PREPROCESSOR=18 val SCE_HA_STRINGEOL=19 val SCE_HA_RESERVED_OPERATOR=20 val SCE_HA_LITERATE_COMMENT=21 val SCE_HA_LITERATE_CODEDELIM=22 # Lexical states of SCLEX_TADS3 lex TADS3=SCLEX_TADS3 SCE_T3_ val SCE_T3_DEFAULT=0 val SCE_T3_X_DEFAULT=1 val SCE_T3_PREPROCESSOR=2 val SCE_T3_BLOCK_COMMENT=3 val SCE_T3_LINE_COMMENT=4 val SCE_T3_OPERATOR=5 val SCE_T3_KEYWORD=6 val SCE_T3_NUMBER=7 val SCE_T3_IDENTIFIER=8 val SCE_T3_S_STRING=9 val SCE_T3_D_STRING=10 val SCE_T3_X_STRING=11 val SCE_T3_LIB_DIRECTIVE=12 val SCE_T3_MSG_PARAM=13 val SCE_T3_HTML_TAG=14 val SCE_T3_HTML_DEFAULT=15 val SCE_T3_HTML_STRING=16 val SCE_T3_USER1=17 val SCE_T3_USER2=18 val SCE_T3_USER3=19 val SCE_T3_BRACE=20 # Lexical states for SCLEX_REBOL lex Rebol=SCLEX_REBOL SCE_REBOL_ val SCE_REBOL_DEFAULT=0 val SCE_REBOL_COMMENTLINE=1 val SCE_REBOL_COMMENTBLOCK=2 val SCE_REBOL_PREFACE=3 val SCE_REBOL_OPERATOR=4 val SCE_REBOL_CHARACTER=5 val SCE_REBOL_QUOTEDSTRING=6 val SCE_REBOL_BRACEDSTRING=7 val SCE_REBOL_NUMBER=8 val SCE_REBOL_PAIR=9 val SCE_REBOL_TUPLE=10 val SCE_REBOL_BINARY=11 val SCE_REBOL_MONEY=12 val SCE_REBOL_ISSUE=13 val SCE_REBOL_TAG=14 val SCE_REBOL_FILE=15 val SCE_REBOL_EMAIL=16 val SCE_REBOL_URL=17 val SCE_REBOL_DATE=18 val SCE_REBOL_TIME=19 val SCE_REBOL_IDENTIFIER=20 val SCE_REBOL_WORD=21 val SCE_REBOL_WORD2=22 val SCE_REBOL_WORD3=23 val SCE_REBOL_WORD4=24 val SCE_REBOL_WORD5=25 val SCE_REBOL_WORD6=26 val SCE_REBOL_WORD7=27 val SCE_REBOL_WORD8=28 # Lexical states for SCLEX_SQL lex SQL=SCLEX_SQL SCE_SQL_ val SCE_SQL_DEFAULT=0 val SCE_SQL_COMMENT=1 val SCE_SQL_COMMENTLINE=2 val SCE_SQL_COMMENTDOC=3 val SCE_SQL_NUMBER=4 val SCE_SQL_WORD=5 val SCE_SQL_STRING=6 val SCE_SQL_CHARACTER=7 val SCE_SQL_SQLPLUS=8 val SCE_SQL_SQLPLUS_PROMPT=9 val SCE_SQL_OPERATOR=10 val SCE_SQL_IDENTIFIER=11 val SCE_SQL_SQLPLUS_COMMENT=13 val SCE_SQL_COMMENTLINEDOC=15 val SCE_SQL_WORD2=16 val SCE_SQL_COMMENTDOCKEYWORD=17 val SCE_SQL_COMMENTDOCKEYWORDERROR=18 val SCE_SQL_USER1=19 val SCE_SQL_USER2=20 val SCE_SQL_USER3=21 val SCE_SQL_USER4=22 val SCE_SQL_QUOTEDIDENTIFIER=23 val SCE_SQL_QOPERATOR=24 # Lexical states for SCLEX_SMALLTALK lex Smalltalk=SCLEX_SMALLTALK SCE_ST_ val SCE_ST_DEFAULT=0 val SCE_ST_STRING=1 val SCE_ST_NUMBER=2 val SCE_ST_COMMENT=3 val SCE_ST_SYMBOL=4 val SCE_ST_BINARY=5 val SCE_ST_BOOL=6 val SCE_ST_SELF=7 val SCE_ST_SUPER=8 val SCE_ST_NIL=9 val SCE_ST_GLOBAL=10 val SCE_ST_RETURN=11 val SCE_ST_SPECIAL=12 val SCE_ST_KWSEND=13 val SCE_ST_ASSIGN=14 val SCE_ST_CHARACTER=15 val SCE_ST_SPEC_SEL=16 # Lexical states for SCLEX_FLAGSHIP (clipper) lex FlagShip=SCLEX_FLAGSHIP SCE_FS_ val SCE_FS_DEFAULT=0 val SCE_FS_COMMENT=1 val SCE_FS_COMMENTLINE=2 val SCE_FS_COMMENTDOC=3 val SCE_FS_COMMENTLINEDOC=4 val SCE_FS_COMMENTDOCKEYWORD=5 val SCE_FS_COMMENTDOCKEYWORDERROR=6 val SCE_FS_KEYWORD=7 val SCE_FS_KEYWORD2=8 val SCE_FS_KEYWORD3=9 val SCE_FS_KEYWORD4=10 val SCE_FS_NUMBER=11 val SCE_FS_STRING=12 val SCE_FS_PREPROCESSOR=13 val SCE_FS_OPERATOR=14 val SCE_FS_IDENTIFIER=15 val SCE_FS_DATE=16 val SCE_FS_STRINGEOL=17 val SCE_FS_CONSTANT=18 val SCE_FS_WORDOPERATOR=19 val SCE_FS_DISABLEDCODE=20 val SCE_FS_DEFAULT_C=21 val SCE_FS_COMMENTDOC_C=22 val SCE_FS_COMMENTLINEDOC_C=23 val SCE_FS_KEYWORD_C=24 val SCE_FS_KEYWORD2_C=25 val SCE_FS_NUMBER_C=26 val SCE_FS_STRING_C=27 val SCE_FS_PREPROCESSOR_C=28 val SCE_FS_OPERATOR_C=29 val SCE_FS_IDENTIFIER_C=30 val SCE_FS_STRINGEOL_C=31 # Lexical states for SCLEX_CSOUND lex Csound=SCLEX_CSOUND SCE_CSOUND_ val SCE_CSOUND_DEFAULT=0 val SCE_CSOUND_COMMENT=1 val SCE_CSOUND_NUMBER=2 val SCE_CSOUND_OPERATOR=3 val SCE_CSOUND_INSTR=4 val SCE_CSOUND_IDENTIFIER=5 val SCE_CSOUND_OPCODE=6 val SCE_CSOUND_HEADERSTMT=7 val SCE_CSOUND_USERKEYWORD=8 val SCE_CSOUND_COMMENTBLOCK=9 val SCE_CSOUND_PARAM=10 val SCE_CSOUND_ARATE_VAR=11 val SCE_CSOUND_KRATE_VAR=12 val SCE_CSOUND_IRATE_VAR=13 val SCE_CSOUND_GLOBAL_VAR=14 val SCE_CSOUND_STRINGEOL=15 # Lexical states for SCLEX_INNOSETUP lex Inno=SCLEX_INNOSETUP SCE_INNO_ val SCE_INNO_DEFAULT=0 val SCE_INNO_COMMENT=1 val SCE_INNO_KEYWORD=2 val SCE_INNO_PARAMETER=3 val SCE_INNO_SECTION=4 val SCE_INNO_PREPROC=5 val SCE_INNO_INLINE_EXPANSION=6 val SCE_INNO_COMMENT_PASCAL=7 val SCE_INNO_KEYWORD_PASCAL=8 val SCE_INNO_KEYWORD_USER=9 val SCE_INNO_STRING_DOUBLE=10 val SCE_INNO_STRING_SINGLE=11 val SCE_INNO_IDENTIFIER=12 # Lexical states for SCLEX_OPAL lex Opal=SCLEX_OPAL SCE_OPAL_ val SCE_OPAL_SPACE=0 val SCE_OPAL_COMMENT_BLOCK=1 val SCE_OPAL_COMMENT_LINE=2 val SCE_OPAL_INTEGER=3 val SCE_OPAL_KEYWORD=4 val SCE_OPAL_SORT=5 val SCE_OPAL_STRING=6 val SCE_OPAL_PAR=7 val SCE_OPAL_BOOL_CONST=8 val SCE_OPAL_DEFAULT=32 # Lexical states for SCLEX_SPICE lex Spice=SCLEX_SPICE SCE_SPICE_ val SCE_SPICE_DEFAULT=0 val SCE_SPICE_IDENTIFIER=1 val SCE_SPICE_KEYWORD=2 val SCE_SPICE_KEYWORD2=3 val SCE_SPICE_KEYWORD3=4 val SCE_SPICE_NUMBER=5 val SCE_SPICE_DELIMITER=6 val SCE_SPICE_VALUE=7 val SCE_SPICE_COMMENTLINE=8 # Lexical states for SCLEX_CMAKE lex CMAKE=SCLEX_CMAKE SCE_CMAKE_ val SCE_CMAKE_DEFAULT=0 val SCE_CMAKE_COMMENT=1 val SCE_CMAKE_STRINGDQ=2 val SCE_CMAKE_STRINGLQ=3 val SCE_CMAKE_STRINGRQ=4 val SCE_CMAKE_COMMANDS=5 val SCE_CMAKE_PARAMETERS=6 val SCE_CMAKE_VARIABLE=7 val SCE_CMAKE_USERDEFINED=8 val SCE_CMAKE_WHILEDEF=9 val SCE_CMAKE_FOREACHDEF=10 val SCE_CMAKE_IFDEFINEDEF=11 val SCE_CMAKE_MACRODEF=12 val SCE_CMAKE_STRINGVAR=13 val SCE_CMAKE_NUMBER=14 # Lexical states for SCLEX_GAP lex Gap=SCLEX_GAP SCE_GAP_ val SCE_GAP_DEFAULT=0 val SCE_GAP_IDENTIFIER=1 val SCE_GAP_KEYWORD=2 val SCE_GAP_KEYWORD2=3 val SCE_GAP_KEYWORD3=4 val SCE_GAP_KEYWORD4=5 val SCE_GAP_STRING=6 val SCE_GAP_CHAR=7 val SCE_GAP_OPERATOR=8 val SCE_GAP_COMMENT=9 val SCE_GAP_NUMBER=10 val SCE_GAP_STRINGEOL=11 # Lexical state for SCLEX_PLM lex PLM=SCLEX_PLM SCE_PLM_ val SCE_PLM_DEFAULT=0 val SCE_PLM_COMMENT=1 val SCE_PLM_STRING=2 val SCE_PLM_NUMBER=3 val SCE_PLM_IDENTIFIER=4 val SCE_PLM_OPERATOR=5 val SCE_PLM_CONTROL=6 val SCE_PLM_KEYWORD=7 # Lexical state for SCLEX_PROGRESS lex Progress=SCLEX_PROGRESS SCE_ABL_ val SCE_ABL_DEFAULT=0 val SCE_ABL_NUMBER=1 val SCE_ABL_WORD=2 val SCE_ABL_STRING=3 val SCE_ABL_CHARACTER=4 val SCE_ABL_PREPROCESSOR=5 val SCE_ABL_OPERATOR=6 val SCE_ABL_IDENTIFIER=7 val SCE_ABL_BLOCK=8 val SCE_ABL_END=9 val SCE_ABL_COMMENT=10 val SCE_ABL_TASKMARKER=11 val SCE_ABL_LINECOMMENT=12 # Lexical states for SCLEX_ABAQUS lex ABAQUS=SCLEX_ABAQUS SCE_ABAQUS_ val SCE_ABAQUS_DEFAULT=0 val SCE_ABAQUS_COMMENT=1 val SCE_ABAQUS_COMMENTBLOCK=2 val SCE_ABAQUS_NUMBER=3 val SCE_ABAQUS_STRING=4 val SCE_ABAQUS_OPERATOR=5 val SCE_ABAQUS_WORD=6 val SCE_ABAQUS_PROCESSOR=7 val SCE_ABAQUS_COMMAND=8 val SCE_ABAQUS_SLASHCOMMAND=9 val SCE_ABAQUS_STARCOMMAND=10 val SCE_ABAQUS_ARGUMENT=11 val SCE_ABAQUS_FUNCTION=12 # Lexical states for SCLEX_ASYMPTOTE lex Asymptote=SCLEX_ASYMPTOTE SCE_ASY_ val SCE_ASY_DEFAULT=0 val SCE_ASY_COMMENT=1 val SCE_ASY_COMMENTLINE=2 val SCE_ASY_NUMBER=3 val SCE_ASY_WORD=4 val SCE_ASY_STRING=5 val SCE_ASY_CHARACTER=6 val SCE_ASY_OPERATOR=7 val SCE_ASY_IDENTIFIER=8 val SCE_ASY_STRINGEOL=9 val SCE_ASY_COMMENTLINEDOC=10 val SCE_ASY_WORD2=11 # Lexical states for SCLEX_R lex R=SCLEX_R SCE_R_ val SCE_R_DEFAULT=0 val SCE_R_COMMENT=1 val SCE_R_KWORD=2 val SCE_R_BASEKWORD=3 val SCE_R_OTHERKWORD=4 val SCE_R_NUMBER=5 val SCE_R_STRING=6 val SCE_R_STRING2=7 val SCE_R_OPERATOR=8 val SCE_R_IDENTIFIER=9 val SCE_R_INFIX=10 val SCE_R_INFIXEOL=11 val SCE_R_BACKTICKS=12 val SCE_R_RAWSTRING=13 val SCE_R_RAWSTRING2=14 val SCE_R_ESCAPESEQUENCE=15 # Lexical state for SCLEX_MAGIK lex MagikSF=SCLEX_MAGIK SCE_MAGIK_ val SCE_MAGIK_DEFAULT=0 val SCE_MAGIK_COMMENT=1 val SCE_MAGIK_HYPER_COMMENT=16 val SCE_MAGIK_STRING=2 val SCE_MAGIK_CHARACTER=3 val SCE_MAGIK_NUMBER=4 val SCE_MAGIK_IDENTIFIER=5 val SCE_MAGIK_OPERATOR=6 val SCE_MAGIK_FLOW=7 val SCE_MAGIK_CONTAINER=8 val SCE_MAGIK_BRACKET_BLOCK=9 val SCE_MAGIK_BRACE_BLOCK=10 val SCE_MAGIK_SQBRACKET_BLOCK=11 val SCE_MAGIK_UNKNOWN_KEYWORD=12 val SCE_MAGIK_KEYWORD=13 val SCE_MAGIK_PRAGMA=14 val SCE_MAGIK_SYMBOL=15 # Lexical state for SCLEX_POWERSHELL lex PowerShell=SCLEX_POWERSHELL SCE_POWERSHELL_ val SCE_POWERSHELL_DEFAULT=0 val SCE_POWERSHELL_COMMENT=1 val SCE_POWERSHELL_STRING=2 val SCE_POWERSHELL_CHARACTER=3 val SCE_POWERSHELL_NUMBER=4 val SCE_POWERSHELL_VARIABLE=5 val SCE_POWERSHELL_OPERATOR=6 val SCE_POWERSHELL_IDENTIFIER=7 val SCE_POWERSHELL_KEYWORD=8 val SCE_POWERSHELL_CMDLET=9 val SCE_POWERSHELL_ALIAS=10 val SCE_POWERSHELL_FUNCTION=11 val SCE_POWERSHELL_USER1=12 val SCE_POWERSHELL_COMMENTSTREAM=13 val SCE_POWERSHELL_HERE_STRING=14 val SCE_POWERSHELL_HERE_CHARACTER=15 val SCE_POWERSHELL_COMMENTDOCKEYWORD=16 # Lexical state for SCLEX_MYSQL lex MySQL=SCLEX_MYSQL SCE_MYSQL_ val SCE_MYSQL_DEFAULT=0 val SCE_MYSQL_COMMENT=1 val SCE_MYSQL_COMMENTLINE=2 val SCE_MYSQL_VARIABLE=3 val SCE_MYSQL_SYSTEMVARIABLE=4 val SCE_MYSQL_KNOWNSYSTEMVARIABLE=5 val SCE_MYSQL_NUMBER=6 val SCE_MYSQL_MAJORKEYWORD=7 val SCE_MYSQL_KEYWORD=8 val SCE_MYSQL_DATABASEOBJECT=9 val SCE_MYSQL_PROCEDUREKEYWORD=10 val SCE_MYSQL_STRING=11 val SCE_MYSQL_SQSTRING=12 val SCE_MYSQL_DQSTRING=13 val SCE_MYSQL_OPERATOR=14 val SCE_MYSQL_FUNCTION=15 val SCE_MYSQL_IDENTIFIER=16 val SCE_MYSQL_QUOTEDIDENTIFIER=17 val SCE_MYSQL_USER1=18 val SCE_MYSQL_USER2=19 val SCE_MYSQL_USER3=20 val SCE_MYSQL_HIDDENCOMMAND=21 val SCE_MYSQL_PLACEHOLDER=22 # Lexical state for SCLEX_PO lex Po=SCLEX_PO SCE_PO_ val SCE_PO_DEFAULT=0 val SCE_PO_COMMENT=1 val SCE_PO_MSGID=2 val SCE_PO_MSGID_TEXT=3 val SCE_PO_MSGSTR=4 val SCE_PO_MSGSTR_TEXT=5 val SCE_PO_MSGCTXT=6 val SCE_PO_MSGCTXT_TEXT=7 val SCE_PO_FUZZY=8 val SCE_PO_PROGRAMMER_COMMENT=9 val SCE_PO_REFERENCE=10 val SCE_PO_FLAGS=11 val SCE_PO_MSGID_TEXT_EOL=12 val SCE_PO_MSGSTR_TEXT_EOL=13 val SCE_PO_MSGCTXT_TEXT_EOL=14 val SCE_PO_ERROR=15 # Lexical states for SCLEX_PASCAL lex Pascal=SCLEX_PASCAL SCE_PAS_ val SCE_PAS_DEFAULT=0 val SCE_PAS_IDENTIFIER=1 val SCE_PAS_COMMENT=2 val SCE_PAS_COMMENT2=3 val SCE_PAS_COMMENTLINE=4 val SCE_PAS_PREPROCESSOR=5 val SCE_PAS_PREPROCESSOR2=6 val SCE_PAS_NUMBER=7 val SCE_PAS_HEXNUMBER=8 val SCE_PAS_WORD=9 val SCE_PAS_STRING=10 val SCE_PAS_STRINGEOL=11 val SCE_PAS_CHARACTER=12 val SCE_PAS_OPERATOR=13 val SCE_PAS_ASM=14 # Lexical state for SCLEX_SORCUS lex SORCUS=SCLEX_SORCUS SCE_SORCUS_ val SCE_SORCUS_DEFAULT=0 val SCE_SORCUS_COMMAND=1 val SCE_SORCUS_PARAMETER=2 val SCE_SORCUS_COMMENTLINE=3 val SCE_SORCUS_STRING=4 val SCE_SORCUS_STRINGEOL=5 val SCE_SORCUS_IDENTIFIER=6 val SCE_SORCUS_OPERATOR=7 val SCE_SORCUS_NUMBER=8 val SCE_SORCUS_CONSTANT=9 # Lexical state for SCLEX_POWERPRO lex PowerPro=SCLEX_POWERPRO SCE_POWERPRO_ val SCE_POWERPRO_DEFAULT=0 val SCE_POWERPRO_COMMENTBLOCK=1 val SCE_POWERPRO_COMMENTLINE=2 val SCE_POWERPRO_NUMBER=3 val SCE_POWERPRO_WORD=4 val SCE_POWERPRO_WORD2=5 val SCE_POWERPRO_WORD3=6 val SCE_POWERPRO_WORD4=7 val SCE_POWERPRO_DOUBLEQUOTEDSTRING=8 val SCE_POWERPRO_SINGLEQUOTEDSTRING=9 val SCE_POWERPRO_LINECONTINUE=10 val SCE_POWERPRO_OPERATOR=11 val SCE_POWERPRO_IDENTIFIER=12 val SCE_POWERPRO_STRINGEOL=13 val SCE_POWERPRO_VERBATIM=14 val SCE_POWERPRO_ALTQUOTE=15 val SCE_POWERPRO_FUNCTION=16 # Lexical states for SCLEX_SML lex SML=SCLEX_SML SCE_SML_ val SCE_SML_DEFAULT=0 val SCE_SML_IDENTIFIER=1 val SCE_SML_TAGNAME=2 val SCE_SML_KEYWORD=3 val SCE_SML_KEYWORD2=4 val SCE_SML_KEYWORD3=5 val SCE_SML_LINENUM=6 val SCE_SML_OPERATOR=7 val SCE_SML_NUMBER=8 val SCE_SML_CHAR=9 val SCE_SML_STRING=11 val SCE_SML_COMMENT=12 val SCE_SML_COMMENT1=13 val SCE_SML_COMMENT2=14 val SCE_SML_COMMENT3=15 # Lexical state for SCLEX_MARKDOWN lex Markdown=SCLEX_MARKDOWN SCE_MARKDOWN_ val SCE_MARKDOWN_DEFAULT=0 val SCE_MARKDOWN_LINE_BEGIN=1 val SCE_MARKDOWN_STRONG1=2 val SCE_MARKDOWN_STRONG2=3 val SCE_MARKDOWN_EM1=4 val SCE_MARKDOWN_EM2=5 val SCE_MARKDOWN_HEADER1=6 val SCE_MARKDOWN_HEADER2=7 val SCE_MARKDOWN_HEADER3=8 val SCE_MARKDOWN_HEADER4=9 val SCE_MARKDOWN_HEADER5=10 val SCE_MARKDOWN_HEADER6=11 val SCE_MARKDOWN_PRECHAR=12 val SCE_MARKDOWN_ULIST_ITEM=13 val SCE_MARKDOWN_OLIST_ITEM=14 val SCE_MARKDOWN_BLOCKQUOTE=15 val SCE_MARKDOWN_STRIKEOUT=16 val SCE_MARKDOWN_HRULE=17 val SCE_MARKDOWN_LINK=18 val SCE_MARKDOWN_CODE=19 val SCE_MARKDOWN_CODE2=20 val SCE_MARKDOWN_CODEBK=21 # Lexical state for SCLEX_TXT2TAGS lex Txt2tags=SCLEX_TXT2TAGS SCE_TXT2TAGS_ val SCE_TXT2TAGS_DEFAULT=0 val SCE_TXT2TAGS_LINE_BEGIN=1 val SCE_TXT2TAGS_STRONG1=2 val SCE_TXT2TAGS_STRONG2=3 val SCE_TXT2TAGS_EM1=4 val SCE_TXT2TAGS_EM2=5 val SCE_TXT2TAGS_HEADER1=6 val SCE_TXT2TAGS_HEADER2=7 val SCE_TXT2TAGS_HEADER3=8 val SCE_TXT2TAGS_HEADER4=9 val SCE_TXT2TAGS_HEADER5=10 val SCE_TXT2TAGS_HEADER6=11 val SCE_TXT2TAGS_PRECHAR=12 val SCE_TXT2TAGS_ULIST_ITEM=13 val SCE_TXT2TAGS_OLIST_ITEM=14 val SCE_TXT2TAGS_BLOCKQUOTE=15 val SCE_TXT2TAGS_STRIKEOUT=16 val SCE_TXT2TAGS_HRULE=17 val SCE_TXT2TAGS_LINK=18 val SCE_TXT2TAGS_CODE=19 val SCE_TXT2TAGS_CODE2=20 val SCE_TXT2TAGS_CODEBK=21 val SCE_TXT2TAGS_COMMENT=22 val SCE_TXT2TAGS_OPTION=23 val SCE_TXT2TAGS_PREPROC=24 val SCE_TXT2TAGS_POSTPROC=25 # Lexical states for SCLEX_A68K lex A68k=SCLEX_A68K SCE_A68K_ val SCE_A68K_DEFAULT=0 val SCE_A68K_COMMENT=1 val SCE_A68K_NUMBER_DEC=2 val SCE_A68K_NUMBER_BIN=3 val SCE_A68K_NUMBER_HEX=4 val SCE_A68K_STRING1=5 val SCE_A68K_OPERATOR=6 val SCE_A68K_CPUINSTRUCTION=7 val SCE_A68K_EXTINSTRUCTION=8 val SCE_A68K_REGISTER=9 val SCE_A68K_DIRECTIVE=10 val SCE_A68K_MACRO_ARG=11 val SCE_A68K_LABEL=12 val SCE_A68K_STRING2=13 val SCE_A68K_IDENTIFIER=14 val SCE_A68K_MACRO_DECLARATION=15 val SCE_A68K_COMMENT_WORD=16 val SCE_A68K_COMMENT_SPECIAL=17 val SCE_A68K_COMMENT_DOXYGEN=18 # Lexical states for SCLEX_MODULA lex Modula=SCLEX_MODULA SCE_MODULA_ val SCE_MODULA_DEFAULT=0 val SCE_MODULA_COMMENT=1 val SCE_MODULA_DOXYCOMM=2 val SCE_MODULA_DOXYKEY=3 val SCE_MODULA_KEYWORD=4 val SCE_MODULA_RESERVED=5 val SCE_MODULA_NUMBER=6 val SCE_MODULA_BASENUM=7 val SCE_MODULA_FLOAT=8 val SCE_MODULA_STRING=9 val SCE_MODULA_STRSPEC=10 val SCE_MODULA_CHAR=11 val SCE_MODULA_CHARSPEC=12 val SCE_MODULA_PROC=13 val SCE_MODULA_PRAGMA=14 val SCE_MODULA_PRGKEY=15 val SCE_MODULA_OPERATOR=16 val SCE_MODULA_BADSTR=17 # Lexical states for SCLEX_COFFEESCRIPT lex CoffeeScript=SCLEX_COFFEESCRIPT SCE_COFFEESCRIPT_ val SCE_COFFEESCRIPT_DEFAULT=0 val SCE_COFFEESCRIPT_COMMENT=1 val SCE_COFFEESCRIPT_COMMENTLINE=2 val SCE_COFFEESCRIPT_COMMENTDOC=3 val SCE_COFFEESCRIPT_NUMBER=4 val SCE_COFFEESCRIPT_WORD=5 val SCE_COFFEESCRIPT_STRING=6 val SCE_COFFEESCRIPT_CHARACTER=7 val SCE_COFFEESCRIPT_UUID=8 val SCE_COFFEESCRIPT_PREPROCESSOR=9 val SCE_COFFEESCRIPT_OPERATOR=10 val SCE_COFFEESCRIPT_IDENTIFIER=11 val SCE_COFFEESCRIPT_STRINGEOL=12 val SCE_COFFEESCRIPT_VERBATIM=13 val SCE_COFFEESCRIPT_REGEX=14 val SCE_COFFEESCRIPT_COMMENTLINEDOC=15 val SCE_COFFEESCRIPT_WORD2=16 val SCE_COFFEESCRIPT_COMMENTDOCKEYWORD=17 val SCE_COFFEESCRIPT_COMMENTDOCKEYWORDERROR=18 val SCE_COFFEESCRIPT_GLOBALCLASS=19 val SCE_COFFEESCRIPT_STRINGRAW=20 val SCE_COFFEESCRIPT_TRIPLEVERBATIM=21 val SCE_COFFEESCRIPT_COMMENTBLOCK=22 val SCE_COFFEESCRIPT_VERBOSE_REGEX=23 val SCE_COFFEESCRIPT_VERBOSE_REGEX_COMMENT=24 val SCE_COFFEESCRIPT_INSTANCEPROPERTY=25 # Lexical states for SCLEX_AVS lex AVS=SCLEX_AVS SCE_AVS_ val SCE_AVS_DEFAULT=0 val SCE_AVS_COMMENTBLOCK=1 val SCE_AVS_COMMENTBLOCKN=2 val SCE_AVS_COMMENTLINE=3 val SCE_AVS_NUMBER=4 val SCE_AVS_OPERATOR=5 val SCE_AVS_IDENTIFIER=6 val SCE_AVS_STRING=7 val SCE_AVS_TRIPLESTRING=8 val SCE_AVS_KEYWORD=9 val SCE_AVS_FILTER=10 val SCE_AVS_PLUGIN=11 val SCE_AVS_FUNCTION=12 val SCE_AVS_CLIPPROP=13 val SCE_AVS_USERDFN=14 # Lexical states for SCLEX_ECL lex ECL=SCLEX_ECL SCE_ECL_ val SCE_ECL_DEFAULT=0 val SCE_ECL_COMMENT=1 val SCE_ECL_COMMENTLINE=2 val SCE_ECL_NUMBER=3 val SCE_ECL_STRING=4 val SCE_ECL_WORD0=5 val SCE_ECL_OPERATOR=6 val SCE_ECL_CHARACTER=7 val SCE_ECL_UUID=8 val SCE_ECL_PREPROCESSOR=9 val SCE_ECL_UNKNOWN=10 val SCE_ECL_IDENTIFIER=11 val SCE_ECL_STRINGEOL=12 val SCE_ECL_VERBATIM=13 val SCE_ECL_REGEX=14 val SCE_ECL_COMMENTLINEDOC=15 val SCE_ECL_WORD1=16 val SCE_ECL_COMMENTDOCKEYWORD=17 val SCE_ECL_COMMENTDOCKEYWORDERROR=18 val SCE_ECL_WORD2=19 val SCE_ECL_WORD3=20 val SCE_ECL_WORD4=21 val SCE_ECL_WORD5=22 val SCE_ECL_COMMENTDOC=23 val SCE_ECL_ADDED=24 val SCE_ECL_DELETED=25 val SCE_ECL_CHANGED=26 val SCE_ECL_MOVED=27 # Lexical states for SCLEX_OSCRIPT lex OScript=SCLEX_OSCRIPT SCE_OSCRIPT_ val SCE_OSCRIPT_DEFAULT=0 val SCE_OSCRIPT_LINE_COMMENT=1 val SCE_OSCRIPT_BLOCK_COMMENT=2 val SCE_OSCRIPT_DOC_COMMENT=3 val SCE_OSCRIPT_PREPROCESSOR=4 val SCE_OSCRIPT_NUMBER=5 val SCE_OSCRIPT_SINGLEQUOTE_STRING=6 val SCE_OSCRIPT_DOUBLEQUOTE_STRING=7 val SCE_OSCRIPT_CONSTANT=8 val SCE_OSCRIPT_IDENTIFIER=9 val SCE_OSCRIPT_GLOBAL=10 val SCE_OSCRIPT_KEYWORD=11 val SCE_OSCRIPT_OPERATOR=12 val SCE_OSCRIPT_LABEL=13 val SCE_OSCRIPT_TYPE=14 val SCE_OSCRIPT_FUNCTION=15 val SCE_OSCRIPT_OBJECT=16 val SCE_OSCRIPT_PROPERTY=17 val SCE_OSCRIPT_METHOD=18 # Lexical states for SCLEX_VISUALPROLOG lex VisualProlog=SCLEX_VISUALPROLOG SCE_VISUALPROLOG_ val SCE_VISUALPROLOG_DEFAULT=0 val SCE_VISUALPROLOG_KEY_MAJOR=1 val SCE_VISUALPROLOG_KEY_MINOR=2 val SCE_VISUALPROLOG_KEY_DIRECTIVE=3 val SCE_VISUALPROLOG_COMMENT_BLOCK=4 val SCE_VISUALPROLOG_COMMENT_LINE=5 val SCE_VISUALPROLOG_COMMENT_KEY=6 val SCE_VISUALPROLOG_COMMENT_KEY_ERROR=7 val SCE_VISUALPROLOG_IDENTIFIER=8 val SCE_VISUALPROLOG_VARIABLE=9 val SCE_VISUALPROLOG_ANONYMOUS=10 val SCE_VISUALPROLOG_NUMBER=11 val SCE_VISUALPROLOG_OPERATOR=12 val SCE_VISUALPROLOG_UNUSED1=13 val SCE_VISUALPROLOG_UNUSED2=14 val SCE_VISUALPROLOG_UNUSED3=15 val SCE_VISUALPROLOG_STRING_QUOTE=16 val SCE_VISUALPROLOG_STRING_ESCAPE=17 val SCE_VISUALPROLOG_STRING_ESCAPE_ERROR=18 val SCE_VISUALPROLOG_UNUSED4=19 val SCE_VISUALPROLOG_STRING=20 val SCE_VISUALPROLOG_UNUSED5=21 val SCE_VISUALPROLOG_STRING_EOL=22 val SCE_VISUALPROLOG_EMBEDDED=23 val SCE_VISUALPROLOG_PLACEHOLDER=24 # Lexical states for SCLEX_STTXT lex StructuredText=SCLEX_STTXT SCE_STTXT_ val SCE_STTXT_DEFAULT=0 val SCE_STTXT_COMMENT=1 val SCE_STTXT_COMMENTLINE=2 val SCE_STTXT_KEYWORD=3 val SCE_STTXT_TYPE=4 val SCE_STTXT_FUNCTION=5 val SCE_STTXT_FB=6 val SCE_STTXT_NUMBER=7 val SCE_STTXT_HEXNUMBER=8 val SCE_STTXT_PRAGMA=9 val SCE_STTXT_OPERATOR=10 val SCE_STTXT_CHARACTER=11 val SCE_STTXT_STRING1=12 val SCE_STTXT_STRING2=13 val SCE_STTXT_STRINGEOL=14 val SCE_STTXT_IDENTIFIER=15 val SCE_STTXT_DATETIME=16 val SCE_STTXT_VARS=17 val SCE_STTXT_PRAGMAS=18 # Lexical states for SCLEX_KVIRC lex KVIrc=SCLEX_KVIRC SCE_KVIRC_ val SCE_KVIRC_DEFAULT=0 val SCE_KVIRC_COMMENT=1 val SCE_KVIRC_COMMENTBLOCK=2 val SCE_KVIRC_STRING=3 val SCE_KVIRC_WORD=4 val SCE_KVIRC_KEYWORD=5 val SCE_KVIRC_FUNCTION_KEYWORD=6 val SCE_KVIRC_FUNCTION=7 val SCE_KVIRC_VARIABLE=8 val SCE_KVIRC_NUMBER=9 val SCE_KVIRC_OPERATOR=10 val SCE_KVIRC_STRING_FUNCTION=11 val SCE_KVIRC_STRING_VARIABLE=12 # Lexical states for SCLEX_RUST lex Rust=SCLEX_RUST SCE_RUST_ val SCE_RUST_DEFAULT=0 val SCE_RUST_COMMENTBLOCK=1 val SCE_RUST_COMMENTLINE=2 val SCE_RUST_COMMENTBLOCKDOC=3 val SCE_RUST_COMMENTLINEDOC=4 val SCE_RUST_NUMBER=5 val SCE_RUST_WORD=6 val SCE_RUST_WORD2=7 val SCE_RUST_WORD3=8 val SCE_RUST_WORD4=9 val SCE_RUST_WORD5=10 val SCE_RUST_WORD6=11 val SCE_RUST_WORD7=12 val SCE_RUST_STRING=13 val SCE_RUST_STRINGR=14 val SCE_RUST_CHARACTER=15 val SCE_RUST_OPERATOR=16 val SCE_RUST_IDENTIFIER=17 val SCE_RUST_LIFETIME=18 val SCE_RUST_MACRO=19 val SCE_RUST_LEXERROR=20 val SCE_RUST_BYTESTRING=21 val SCE_RUST_BYTESTRINGR=22 val SCE_RUST_BYTECHARACTER=23 # Lexical states for SCLEX_DMAP lex DMAP=SCLEX_DMAP SCE_DMAP_ val SCE_DMAP_DEFAULT=0 val SCE_DMAP_COMMENT=1 val SCE_DMAP_NUMBER=2 val SCE_DMAP_STRING1=3 val SCE_DMAP_STRING2=4 val SCE_DMAP_STRINGEOL=5 val SCE_DMAP_OPERATOR=6 val SCE_DMAP_IDENTIFIER=7 val SCE_DMAP_WORD=8 val SCE_DMAP_WORD2=9 val SCE_DMAP_WORD3=10 # Lexical states for SCLEX_DMIS lex DMIS=SCLEX_DMIS SCE_DMIS_ val SCE_DMIS_DEFAULT=0 val SCE_DMIS_COMMENT=1 val SCE_DMIS_STRING=2 val SCE_DMIS_NUMBER=3 val SCE_DMIS_KEYWORD=4 val SCE_DMIS_MAJORWORD=5 val SCE_DMIS_MINORWORD=6 val SCE_DMIS_UNSUPPORTED_MAJOR=7 val SCE_DMIS_UNSUPPORTED_MINOR=8 val SCE_DMIS_LABEL=9 # Lexical states for SCLEX_REGISTRY lex REG=SCLEX_REGISTRY SCE_REG_ val SCE_REG_DEFAULT=0 val SCE_REG_COMMENT=1 val SCE_REG_VALUENAME=2 val SCE_REG_STRING=3 val SCE_REG_HEXDIGIT=4 val SCE_REG_VALUETYPE=5 val SCE_REG_ADDEDKEY=6 val SCE_REG_DELETEDKEY=7 val SCE_REG_ESCAPED=8 val SCE_REG_KEYPATH_GUID=9 val SCE_REG_STRING_GUID=10 val SCE_REG_PARAMETER=11 val SCE_REG_OPERATOR=12 # Lexical state for SCLEX_BIBTEX lex BibTeX=SCLEX_BIBTEX SCE_BIBTEX_ val SCE_BIBTEX_DEFAULT=0 val SCE_BIBTEX_ENTRY=1 val SCE_BIBTEX_UNKNOWN_ENTRY=2 val SCE_BIBTEX_KEY=3 val SCE_BIBTEX_PARAMETER=4 val SCE_BIBTEX_VALUE=5 val SCE_BIBTEX_COMMENT=6 # Lexical state for SCLEX_SREC lex Srec=SCLEX_SREC SCE_HEX_ val SCE_HEX_DEFAULT=0 val SCE_HEX_RECSTART=1 val SCE_HEX_RECTYPE=2 val SCE_HEX_RECTYPE_UNKNOWN=3 val SCE_HEX_BYTECOUNT=4 val SCE_HEX_BYTECOUNT_WRONG=5 val SCE_HEX_NOADDRESS=6 val SCE_HEX_DATAADDRESS=7 val SCE_HEX_RECCOUNT=8 val SCE_HEX_STARTADDRESS=9 val SCE_HEX_ADDRESSFIELD_UNKNOWN=10 val SCE_HEX_EXTENDEDADDRESS=11 val SCE_HEX_DATA_ODD=12 val SCE_HEX_DATA_EVEN=13 val SCE_HEX_DATA_UNKNOWN=14 val SCE_HEX_DATA_EMPTY=15 val SCE_HEX_CHECKSUM=16 val SCE_HEX_CHECKSUM_WRONG=17 val SCE_HEX_GARBAGE=18 # Lexical state for SCLEX_IHEX (shared with Srec) lex IHex=SCLEX_IHEX SCE_HEX_ # Lexical state for SCLEX_TEHEX (shared with Srec) lex TEHex=SCLEX_TEHEX SCE_HEX_ # Lexical states for SCLEX_JSON lex JSON=SCLEX_JSON SCE_JSON_ val SCE_JSON_DEFAULT=0 val SCE_JSON_NUMBER=1 val SCE_JSON_STRING=2 val SCE_JSON_STRINGEOL=3 val SCE_JSON_PROPERTYNAME=4 val SCE_JSON_ESCAPESEQUENCE=5 val SCE_JSON_LINECOMMENT=6 val SCE_JSON_BLOCKCOMMENT=7 val SCE_JSON_OPERATOR=8 val SCE_JSON_URI=9 val SCE_JSON_COMPACTIRI=10 val SCE_JSON_KEYWORD=11 val SCE_JSON_LDKEYWORD=12 val SCE_JSON_ERROR=13 lex EDIFACT=SCLEX_EDIFACT SCE_EDI_ val SCE_EDI_DEFAULT=0 val SCE_EDI_SEGMENTSTART=1 val SCE_EDI_SEGMENTEND=2 val SCE_EDI_SEP_ELEMENT=3 val SCE_EDI_SEP_COMPOSITE=4 val SCE_EDI_SEP_RELEASE=5 val SCE_EDI_UNA=6 val SCE_EDI_UNH=7 val SCE_EDI_BADSEGMENT=8 # Lexical states for SCLEX_STATA lex STATA=SCLEX_STATA SCE_STATA_ val SCE_STATA_DEFAULT=0 val SCE_STATA_COMMENT=1 val SCE_STATA_COMMENTLINE=2 val SCE_STATA_COMMENTBLOCK=3 val SCE_STATA_NUMBER=4 val SCE_STATA_OPERATOR=5 val SCE_STATA_IDENTIFIER=6 val SCE_STATA_STRING=7 val SCE_STATA_TYPE=8 val SCE_STATA_WORD=9 val SCE_STATA_GLOBAL_MACRO=10 val SCE_STATA_MACRO=11 # Lexical states for SCLEX_SAS lex SAS=SCLEX_SAS SCE_SAS_ val SCE_SAS_DEFAULT=0 val SCE_SAS_COMMENT=1 val SCE_SAS_COMMENTLINE=2 val SCE_SAS_COMMENTBLOCK=3 val SCE_SAS_NUMBER=4 val SCE_SAS_OPERATOR=5 val SCE_SAS_IDENTIFIER=6 val SCE_SAS_STRING=7 val SCE_SAS_TYPE=8 val SCE_SAS_WORD=9 val SCE_SAS_GLOBAL_MACRO=10 val SCE_SAS_MACRO=11 val SCE_SAS_MACRO_KEYWORD=12 val SCE_SAS_BLOCK_KEYWORD=13 val SCE_SAS_MACRO_FUNCTION=14 val SCE_SAS_STATEMENT=15 # Lexical states for SCLEX_NIM lex Nim=SCLEX_NIM SCE_NIM_ val SCE_NIM_DEFAULT=0 val SCE_NIM_COMMENT=1 val SCE_NIM_COMMENTDOC=2 val SCE_NIM_COMMENTLINE=3 val SCE_NIM_COMMENTLINEDOC=4 val SCE_NIM_NUMBER=5 val SCE_NIM_STRING=6 val SCE_NIM_CHARACTER=7 val SCE_NIM_WORD=8 val SCE_NIM_TRIPLE=9 val SCE_NIM_TRIPLEDOUBLE=10 val SCE_NIM_BACKTICKS=11 val SCE_NIM_FUNCNAME=12 val SCE_NIM_STRINGEOL=13 val SCE_NIM_NUMERROR=14 val SCE_NIM_OPERATOR=15 val SCE_NIM_IDENTIFIER=16 # Lexical states for SCLEX_CIL lex CIL=SCLEX_CIL SCE_CIL_ val SCE_CIL_DEFAULT=0 val SCE_CIL_COMMENT=1 val SCE_CIL_COMMENTLINE=2 val SCE_CIL_WORD=3 val SCE_CIL_WORD2=4 val SCE_CIL_WORD3=5 val SCE_CIL_STRING=6 val SCE_CIL_LABEL=7 val SCE_CIL_OPERATOR=8 val SCE_CIL_IDENTIFIER=9 val SCE_CIL_STRINGEOL=10 # Lexical states for SCLEX_X12 lex X12=SCLEX_X12 SCE_X12_ val SCE_X12_DEFAULT=0 val SCE_X12_BAD=1 val SCE_X12_ENVELOPE=2 val SCE_X12_FUNCTIONGROUP=3 val SCE_X12_TRANSACTIONSET=4 val SCE_X12_SEGMENTHEADER=5 val SCE_X12_SEGMENTEND=6 val SCE_X12_SEP_ELEMENT=7 val SCE_X12_SEP_SUBELEMENT=8 # Lexical states for SCLEX_DATAFLEX lex Dataflex=SCLEX_DATAFLEX SCE_DF_ val SCE_DF_DEFAULT=0 val SCE_DF_IDENTIFIER=1 val SCE_DF_METATAG=2 val SCE_DF_IMAGE=3 val SCE_DF_COMMENTLINE=4 val SCE_DF_PREPROCESSOR=5 val SCE_DF_PREPROCESSOR2=6 val SCE_DF_NUMBER=7 val SCE_DF_HEXNUMBER=8 val SCE_DF_WORD=9 val SCE_DF_STRING=10 val SCE_DF_STRINGEOL=11 val SCE_DF_SCOPEWORD=12 val SCE_DF_OPERATOR=13 val SCE_DF_ICODE=14 # Lexical states for SCLEX_HOLLYWOOD lex Hollywood=SCLEX_HOLLYWOOD SCE_HOLLYWOOD_ val SCE_HOLLYWOOD_DEFAULT=0 val SCE_HOLLYWOOD_COMMENT=1 val SCE_HOLLYWOOD_COMMENTBLOCK=2 val SCE_HOLLYWOOD_NUMBER=3 val SCE_HOLLYWOOD_KEYWORD=4 val SCE_HOLLYWOOD_STDAPI=5 val SCE_HOLLYWOOD_PLUGINAPI=6 val SCE_HOLLYWOOD_PLUGINMETHOD=7 val SCE_HOLLYWOOD_STRING=8 val SCE_HOLLYWOOD_STRINGBLOCK=9 val SCE_HOLLYWOOD_PREPROCESSOR=10 val SCE_HOLLYWOOD_OPERATOR=11 val SCE_HOLLYWOOD_IDENTIFIER=12 val SCE_HOLLYWOOD_CONSTANT=13 val SCE_HOLLYWOOD_HEXNUMBER=14 # Lexical states for SCLEX_RAKU lex Raku=SCLEX_RAKU SCE_RAKU_ val SCE_RAKU_DEFAULT=0 val SCE_RAKU_ERROR=1 val SCE_RAKU_COMMENTLINE=2 val SCE_RAKU_COMMENTEMBED=3 val SCE_RAKU_POD=4 val SCE_RAKU_CHARACTER=5 val SCE_RAKU_HEREDOC_Q=6 val SCE_RAKU_HEREDOC_QQ=7 val SCE_RAKU_STRING=8 val SCE_RAKU_STRING_Q=9 val SCE_RAKU_STRING_QQ=10 val SCE_RAKU_STRING_Q_LANG=11 val SCE_RAKU_STRING_VAR=12 val SCE_RAKU_REGEX=13 val SCE_RAKU_REGEX_VAR=14 val SCE_RAKU_ADVERB=15 val SCE_RAKU_NUMBER=16 val SCE_RAKU_PREPROCESSOR=17 val SCE_RAKU_OPERATOR=18 val SCE_RAKU_WORD=19 val SCE_RAKU_FUNCTION=20 val SCE_RAKU_IDENTIFIER=21 val SCE_RAKU_TYPEDEF=22 val SCE_RAKU_MU=23 val SCE_RAKU_POSITIONAL=24 val SCE_RAKU_ASSOCIATIVE=25 val SCE_RAKU_CALLABLE=26 val SCE_RAKU_GRAMMAR=27 val SCE_RAKU_CLASS=28 # Lexical states for SCLEX_FSHARP lex FSharp=SCLEX_FSHARP SCE_FSHARP_ val SCE_FSHARP_DEFAULT=0 val SCE_FSHARP_KEYWORD=1 val SCE_FSHARP_KEYWORD2=2 val SCE_FSHARP_KEYWORD3=3 val SCE_FSHARP_KEYWORD4=4 val SCE_FSHARP_KEYWORD5=5 val SCE_FSHARP_IDENTIFIER=6 val SCE_FSHARP_QUOT_IDENTIFIER=7 val SCE_FSHARP_COMMENT=8 val SCE_FSHARP_COMMENTLINE=9 val SCE_FSHARP_PREPROCESSOR=10 val SCE_FSHARP_LINENUM=11 val SCE_FSHARP_OPERATOR=12 val SCE_FSHARP_NUMBER=13 val SCE_FSHARP_CHARACTER=14 val SCE_FSHARP_STRING=15 val SCE_FSHARP_VERBATIM=16 val SCE_FSHARP_QUOTATION=17 val SCE_FSHARP_ATTRIBUTE=18 val SCE_FSHARP_FORMAT_SPEC=19 # Lexical states for SCLEX_ASCIIDOC lex Asciidoc=SCLEX_ASCIIDOC SCE_ASCIIDOC_ val SCE_ASCIIDOC_DEFAULT=0 val SCE_ASCIIDOC_STRONG1=1 val SCE_ASCIIDOC_STRONG2=2 val SCE_ASCIIDOC_EM1=3 val SCE_ASCIIDOC_EM2=4 val SCE_ASCIIDOC_HEADER1=5 val SCE_ASCIIDOC_HEADER2=6 val SCE_ASCIIDOC_HEADER3=7 val SCE_ASCIIDOC_HEADER4=8 val SCE_ASCIIDOC_HEADER5=9 val SCE_ASCIIDOC_HEADER6=10 val SCE_ASCIIDOC_ULIST_ITEM=11 val SCE_ASCIIDOC_OLIST_ITEM=12 val SCE_ASCIIDOC_BLOCKQUOTE=13 val SCE_ASCIIDOC_LINK=14 val SCE_ASCIIDOC_CODEBK=15 val SCE_ASCIIDOC_PASSBK=16 val SCE_ASCIIDOC_COMMENT=17 val SCE_ASCIIDOC_COMMENTBK=18 val SCE_ASCIIDOC_LITERAL=19 val SCE_ASCIIDOC_LITERALBK=20 val SCE_ASCIIDOC_ATTRIB=21 val SCE_ASCIIDOC_ATTRIBVAL=22 val SCE_ASCIIDOC_MACRO=23 # Lexical states for SCLEX_GDSCRIPT lex GDScript=SCLEX_GDSCRIPT SCE_GD_ val SCE_GD_DEFAULT=0 val SCE_GD_COMMENTLINE=1 val SCE_GD_NUMBER=2 val SCE_GD_STRING=3 val SCE_GD_CHARACTER=4 val SCE_GD_WORD=5 val SCE_GD_TRIPLE=6 val SCE_GD_TRIPLEDOUBLE=7 val SCE_GD_CLASSNAME=8 val SCE_GD_FUNCNAME=9 val SCE_GD_OPERATOR=10 val SCE_GD_IDENTIFIER=11 val SCE_GD_COMMENTBLOCK=12 val SCE_GD_STRINGEOL=13 val SCE_GD_WORD2=14 val SCE_GD_ANNOTATION=15 val SCE_GD_NODEPATH=16 lexilla/include/SciLexer.h0000664000175000017500000016266314647367374014527 0ustar neilneil/* Scintilla source code edit control */ /** @file SciLexer.h ** Interface to the added lexer functions in the SciLexer version of the edit control. **/ /* Copyright 1998-2002 by Neil Hodgson * The License.txt file describes the conditions under which this software may be distributed. */ /* Most of this file is automatically generated from the Scintilla.iface interface definition * file which contains any comments about the definitions. HFacer.py does the generation. */ #ifndef SCILEXER_H #define SCILEXER_H /* SciLexer features - not in standard Scintilla */ /* ++Autogenerated -- start of section automatically generated from Scintilla.iface */ #define SCLEX_CONTAINER 0 #define SCLEX_NULL 1 #define SCLEX_PYTHON 2 #define SCLEX_CPP 3 #define SCLEX_HTML 4 #define SCLEX_XML 5 #define SCLEX_PERL 6 #define SCLEX_SQL 7 #define SCLEX_VB 8 #define SCLEX_PROPERTIES 9 #define SCLEX_ERRORLIST 10 #define SCLEX_MAKEFILE 11 #define SCLEX_BATCH 12 #define SCLEX_XCODE 13 #define SCLEX_LATEX 14 #define SCLEX_LUA 15 #define SCLEX_DIFF 16 #define SCLEX_CONF 17 #define SCLEX_PASCAL 18 #define SCLEX_AVE 19 #define SCLEX_ADA 20 #define SCLEX_LISP 21 #define SCLEX_RUBY 22 #define SCLEX_EIFFEL 23 #define SCLEX_EIFFELKW 24 #define SCLEX_TCL 25 #define SCLEX_NNCRONTAB 26 #define SCLEX_BULLANT 27 #define SCLEX_VBSCRIPT 28 #define SCLEX_BAAN 31 #define SCLEX_MATLAB 32 #define SCLEX_SCRIPTOL 33 #define SCLEX_ASM 34 #define SCLEX_CPPNOCASE 35 #define SCLEX_FORTRAN 36 #define SCLEX_F77 37 #define SCLEX_CSS 38 #define SCLEX_POV 39 #define SCLEX_LOUT 40 #define SCLEX_ESCRIPT 41 #define SCLEX_PS 42 #define SCLEX_NSIS 43 #define SCLEX_MMIXAL 44 #define SCLEX_CLW 45 #define SCLEX_CLWNOCASE 46 #define SCLEX_LOT 47 #define SCLEX_YAML 48 #define SCLEX_TEX 49 #define SCLEX_METAPOST 50 #define SCLEX_POWERBASIC 51 #define SCLEX_FORTH 52 #define SCLEX_ERLANG 53 #define SCLEX_OCTAVE 54 #define SCLEX_MSSQL 55 #define SCLEX_VERILOG 56 #define SCLEX_KIX 57 #define SCLEX_GUI4CLI 58 #define SCLEX_SPECMAN 59 #define SCLEX_AU3 60 #define SCLEX_APDL 61 #define SCLEX_BASH 62 #define SCLEX_ASN1 63 #define SCLEX_VHDL 64 #define SCLEX_CAML 65 #define SCLEX_BLITZBASIC 66 #define SCLEX_PUREBASIC 67 #define SCLEX_HASKELL 68 #define SCLEX_PHPSCRIPT 69 #define SCLEX_TADS3 70 #define SCLEX_REBOL 71 #define SCLEX_SMALLTALK 72 #define SCLEX_FLAGSHIP 73 #define SCLEX_CSOUND 74 #define SCLEX_FREEBASIC 75 #define SCLEX_INNOSETUP 76 #define SCLEX_OPAL 77 #define SCLEX_SPICE 78 #define SCLEX_D 79 #define SCLEX_CMAKE 80 #define SCLEX_GAP 81 #define SCLEX_PLM 82 #define SCLEX_PROGRESS 83 #define SCLEX_ABAQUS 84 #define SCLEX_ASYMPTOTE 85 #define SCLEX_R 86 #define SCLEX_MAGIK 87 #define SCLEX_POWERSHELL 88 #define SCLEX_MYSQL 89 #define SCLEX_PO 90 #define SCLEX_TAL 91 #define SCLEX_COBOL 92 #define SCLEX_TACL 93 #define SCLEX_SORCUS 94 #define SCLEX_POWERPRO 95 #define SCLEX_NIMROD 96 #define SCLEX_SML 97 #define SCLEX_MARKDOWN 98 #define SCLEX_TXT2TAGS 99 #define SCLEX_A68K 100 #define SCLEX_MODULA 101 #define SCLEX_COFFEESCRIPT 102 #define SCLEX_TCMD 103 #define SCLEX_AVS 104 #define SCLEX_ECL 105 #define SCLEX_OSCRIPT 106 #define SCLEX_VISUALPROLOG 107 #define SCLEX_LITERATEHASKELL 108 #define SCLEX_STTXT 109 #define SCLEX_KVIRC 110 #define SCLEX_RUST 111 #define SCLEX_DMAP 112 #define SCLEX_AS 113 #define SCLEX_DMIS 114 #define SCLEX_REGISTRY 115 #define SCLEX_BIBTEX 116 #define SCLEX_SREC 117 #define SCLEX_IHEX 118 #define SCLEX_TEHEX 119 #define SCLEX_JSON 120 #define SCLEX_EDIFACT 121 #define SCLEX_INDENT 122 #define SCLEX_MAXIMA 123 #define SCLEX_STATA 124 #define SCLEX_SAS 125 #define SCLEX_NIM 126 #define SCLEX_CIL 127 #define SCLEX_X12 128 #define SCLEX_DATAFLEX 129 #define SCLEX_HOLLYWOOD 130 #define SCLEX_RAKU 131 #define SCLEX_FSHARP 132 #define SCLEX_JULIA 133 #define SCLEX_ASCIIDOC 134 #define SCLEX_GDSCRIPT 135 #define SCLEX_AUTOMATIC 1000 #define SCE_P_DEFAULT 0 #define SCE_P_COMMENTLINE 1 #define SCE_P_NUMBER 2 #define SCE_P_STRING 3 #define SCE_P_CHARACTER 4 #define SCE_P_WORD 5 #define SCE_P_TRIPLE 6 #define SCE_P_TRIPLEDOUBLE 7 #define SCE_P_CLASSNAME 8 #define SCE_P_DEFNAME 9 #define SCE_P_OPERATOR 10 #define SCE_P_IDENTIFIER 11 #define SCE_P_COMMENTBLOCK 12 #define SCE_P_STRINGEOL 13 #define SCE_P_WORD2 14 #define SCE_P_DECORATOR 15 #define SCE_P_FSTRING 16 #define SCE_P_FCHARACTER 17 #define SCE_P_FTRIPLE 18 #define SCE_P_FTRIPLEDOUBLE 19 #define SCE_P_ATTRIBUTE 20 #define SCE_C_DEFAULT 0 #define SCE_C_COMMENT 1 #define SCE_C_COMMENTLINE 2 #define SCE_C_COMMENTDOC 3 #define SCE_C_NUMBER 4 #define SCE_C_WORD 5 #define SCE_C_STRING 6 #define SCE_C_CHARACTER 7 #define SCE_C_UUID 8 #define SCE_C_PREPROCESSOR 9 #define SCE_C_OPERATOR 10 #define SCE_C_IDENTIFIER 11 #define SCE_C_STRINGEOL 12 #define SCE_C_VERBATIM 13 #define SCE_C_REGEX 14 #define SCE_C_COMMENTLINEDOC 15 #define SCE_C_WORD2 16 #define SCE_C_COMMENTDOCKEYWORD 17 #define SCE_C_COMMENTDOCKEYWORDERROR 18 #define SCE_C_GLOBALCLASS 19 #define SCE_C_STRINGRAW 20 #define SCE_C_TRIPLEVERBATIM 21 #define SCE_C_HASHQUOTEDSTRING 22 #define SCE_C_PREPROCESSORCOMMENT 23 #define SCE_C_PREPROCESSORCOMMENTDOC 24 #define SCE_C_USERLITERAL 25 #define SCE_C_TASKMARKER 26 #define SCE_C_ESCAPESEQUENCE 27 #define SCE_D_DEFAULT 0 #define SCE_D_COMMENT 1 #define SCE_D_COMMENTLINE 2 #define SCE_D_COMMENTDOC 3 #define SCE_D_COMMENTNESTED 4 #define SCE_D_NUMBER 5 #define SCE_D_WORD 6 #define SCE_D_WORD2 7 #define SCE_D_WORD3 8 #define SCE_D_TYPEDEF 9 #define SCE_D_STRING 10 #define SCE_D_STRINGEOL 11 #define SCE_D_CHARACTER 12 #define SCE_D_OPERATOR 13 #define SCE_D_IDENTIFIER 14 #define SCE_D_COMMENTLINEDOC 15 #define SCE_D_COMMENTDOCKEYWORD 16 #define SCE_D_COMMENTDOCKEYWORDERROR 17 #define SCE_D_STRINGB 18 #define SCE_D_STRINGR 19 #define SCE_D_WORD5 20 #define SCE_D_WORD6 21 #define SCE_D_WORD7 22 #define SCE_TCL_DEFAULT 0 #define SCE_TCL_COMMENT 1 #define SCE_TCL_COMMENTLINE 2 #define SCE_TCL_NUMBER 3 #define SCE_TCL_WORD_IN_QUOTE 4 #define SCE_TCL_IN_QUOTE 5 #define SCE_TCL_OPERATOR 6 #define SCE_TCL_IDENTIFIER 7 #define SCE_TCL_SUBSTITUTION 8 #define SCE_TCL_SUB_BRACE 9 #define SCE_TCL_MODIFIER 10 #define SCE_TCL_EXPAND 11 #define SCE_TCL_WORD 12 #define SCE_TCL_WORD2 13 #define SCE_TCL_WORD3 14 #define SCE_TCL_WORD4 15 #define SCE_TCL_WORD5 16 #define SCE_TCL_WORD6 17 #define SCE_TCL_WORD7 18 #define SCE_TCL_WORD8 19 #define SCE_TCL_COMMENT_BOX 20 #define SCE_TCL_BLOCK_COMMENT 21 #define SCE_H_DEFAULT 0 #define SCE_H_TAG 1 #define SCE_H_TAGUNKNOWN 2 #define SCE_H_ATTRIBUTE 3 #define SCE_H_ATTRIBUTEUNKNOWN 4 #define SCE_H_NUMBER 5 #define SCE_H_DOUBLESTRING 6 #define SCE_H_SINGLESTRING 7 #define SCE_H_OTHER 8 #define SCE_H_COMMENT 9 #define SCE_H_ENTITY 10 #define SCE_H_TAGEND 11 #define SCE_H_XMLSTART 12 #define SCE_H_XMLEND 13 #define SCE_H_SCRIPT 14 #define SCE_H_ASP 15 #define SCE_H_ASPAT 16 #define SCE_H_CDATA 17 #define SCE_H_QUESTION 18 #define SCE_H_VALUE 19 #define SCE_H_XCCOMMENT 20 #define SCE_H_SGML_DEFAULT 21 #define SCE_H_SGML_COMMAND 22 #define SCE_H_SGML_1ST_PARAM 23 #define SCE_H_SGML_DOUBLESTRING 24 #define SCE_H_SGML_SIMPLESTRING 25 #define SCE_H_SGML_ERROR 26 #define SCE_H_SGML_SPECIAL 27 #define SCE_H_SGML_ENTITY 28 #define SCE_H_SGML_COMMENT 29 #define SCE_H_SGML_1ST_PARAM_COMMENT 30 #define SCE_H_SGML_BLOCK_DEFAULT 31 #define SCE_HJ_START 40 #define SCE_HJ_DEFAULT 41 #define SCE_HJ_COMMENT 42 #define SCE_HJ_COMMENTLINE 43 #define SCE_HJ_COMMENTDOC 44 #define SCE_HJ_NUMBER 45 #define SCE_HJ_WORD 46 #define SCE_HJ_KEYWORD 47 #define SCE_HJ_DOUBLESTRING 48 #define SCE_HJ_SINGLESTRING 49 #define SCE_HJ_SYMBOLS 50 #define SCE_HJ_STRINGEOL 51 #define SCE_HJ_REGEX 52 #define SCE_HJA_START 55 #define SCE_HJA_DEFAULT 56 #define SCE_HJA_COMMENT 57 #define SCE_HJA_COMMENTLINE 58 #define SCE_HJA_COMMENTDOC 59 #define SCE_HJA_NUMBER 60 #define SCE_HJA_WORD 61 #define SCE_HJA_KEYWORD 62 #define SCE_HJA_DOUBLESTRING 63 #define SCE_HJA_SINGLESTRING 64 #define SCE_HJA_SYMBOLS 65 #define SCE_HJA_STRINGEOL 66 #define SCE_HJA_REGEX 67 #define SCE_HB_START 70 #define SCE_HB_DEFAULT 71 #define SCE_HB_COMMENTLINE 72 #define SCE_HB_NUMBER 73 #define SCE_HB_WORD 74 #define SCE_HB_STRING 75 #define SCE_HB_IDENTIFIER 76 #define SCE_HB_STRINGEOL 77 #define SCE_HBA_START 80 #define SCE_HBA_DEFAULT 81 #define SCE_HBA_COMMENTLINE 82 #define SCE_HBA_NUMBER 83 #define SCE_HBA_WORD 84 #define SCE_HBA_STRING 85 #define SCE_HBA_IDENTIFIER 86 #define SCE_HBA_STRINGEOL 87 #define SCE_HP_START 90 #define SCE_HP_DEFAULT 91 #define SCE_HP_COMMENTLINE 92 #define SCE_HP_NUMBER 93 #define SCE_HP_STRING 94 #define SCE_HP_CHARACTER 95 #define SCE_HP_WORD 96 #define SCE_HP_TRIPLE 97 #define SCE_HP_TRIPLEDOUBLE 98 #define SCE_HP_CLASSNAME 99 #define SCE_HP_DEFNAME 100 #define SCE_HP_OPERATOR 101 #define SCE_HP_IDENTIFIER 102 #define SCE_HPHP_COMPLEX_VARIABLE 104 #define SCE_HPA_START 105 #define SCE_HPA_DEFAULT 106 #define SCE_HPA_COMMENTLINE 107 #define SCE_HPA_NUMBER 108 #define SCE_HPA_STRING 109 #define SCE_HPA_CHARACTER 110 #define SCE_HPA_WORD 111 #define SCE_HPA_TRIPLE 112 #define SCE_HPA_TRIPLEDOUBLE 113 #define SCE_HPA_CLASSNAME 114 #define SCE_HPA_DEFNAME 115 #define SCE_HPA_OPERATOR 116 #define SCE_HPA_IDENTIFIER 117 #define SCE_HPHP_DEFAULT 118 #define SCE_HPHP_HSTRING 119 #define SCE_HPHP_SIMPLESTRING 120 #define SCE_HPHP_WORD 121 #define SCE_HPHP_NUMBER 122 #define SCE_HPHP_VARIABLE 123 #define SCE_HPHP_COMMENT 124 #define SCE_HPHP_COMMENTLINE 125 #define SCE_HPHP_HSTRING_VARIABLE 126 #define SCE_HPHP_OPERATOR 127 #define SCE_PL_DEFAULT 0 #define SCE_PL_ERROR 1 #define SCE_PL_COMMENTLINE 2 #define SCE_PL_POD 3 #define SCE_PL_NUMBER 4 #define SCE_PL_WORD 5 #define SCE_PL_STRING 6 #define SCE_PL_CHARACTER 7 #define SCE_PL_PUNCTUATION 8 #define SCE_PL_PREPROCESSOR 9 #define SCE_PL_OPERATOR 10 #define SCE_PL_IDENTIFIER 11 #define SCE_PL_SCALAR 12 #define SCE_PL_ARRAY 13 #define SCE_PL_HASH 14 #define SCE_PL_SYMBOLTABLE 15 #define SCE_PL_VARIABLE_INDEXER 16 #define SCE_PL_REGEX 17 #define SCE_PL_REGSUBST 18 #define SCE_PL_LONGQUOTE 19 #define SCE_PL_BACKTICKS 20 #define SCE_PL_DATASECTION 21 #define SCE_PL_HERE_DELIM 22 #define SCE_PL_HERE_Q 23 #define SCE_PL_HERE_QQ 24 #define SCE_PL_HERE_QX 25 #define SCE_PL_STRING_Q 26 #define SCE_PL_STRING_QQ 27 #define SCE_PL_STRING_QX 28 #define SCE_PL_STRING_QR 29 #define SCE_PL_STRING_QW 30 #define SCE_PL_POD_VERB 31 #define SCE_PL_SUB_PROTOTYPE 40 #define SCE_PL_FORMAT_IDENT 41 #define SCE_PL_FORMAT 42 #define SCE_PL_STRING_VAR 43 #define SCE_PL_XLAT 44 #define SCE_PL_REGEX_VAR 54 #define SCE_PL_REGSUBST_VAR 55 #define SCE_PL_BACKTICKS_VAR 57 #define SCE_PL_HERE_QQ_VAR 61 #define SCE_PL_HERE_QX_VAR 62 #define SCE_PL_STRING_QQ_VAR 64 #define SCE_PL_STRING_QX_VAR 65 #define SCE_PL_STRING_QR_VAR 66 #define SCE_RB_DEFAULT 0 #define SCE_RB_ERROR 1 #define SCE_RB_COMMENTLINE 2 #define SCE_RB_POD 3 #define SCE_RB_NUMBER 4 #define SCE_RB_WORD 5 #define SCE_RB_STRING 6 #define SCE_RB_CHARACTER 7 #define SCE_RB_CLASSNAME 8 #define SCE_RB_DEFNAME 9 #define SCE_RB_OPERATOR 10 #define SCE_RB_IDENTIFIER 11 #define SCE_RB_REGEX 12 #define SCE_RB_GLOBAL 13 #define SCE_RB_SYMBOL 14 #define SCE_RB_MODULE_NAME 15 #define SCE_RB_INSTANCE_VAR 16 #define SCE_RB_CLASS_VAR 17 #define SCE_RB_BACKTICKS 18 #define SCE_RB_DATASECTION 19 #define SCE_RB_HERE_DELIM 20 #define SCE_RB_HERE_Q 21 #define SCE_RB_HERE_QQ 22 #define SCE_RB_HERE_QX 23 #define SCE_RB_STRING_Q 24 #define SCE_RB_STRING_QQ 25 #define SCE_RB_STRING_QX 26 #define SCE_RB_STRING_QR 27 #define SCE_RB_STRING_QW 28 #define SCE_RB_WORD_DEMOTED 29 #define SCE_RB_STDIN 30 #define SCE_RB_STDOUT 31 #define SCE_RB_STDERR 40 #define SCE_RB_STRING_W 41 #define SCE_RB_STRING_I 42 #define SCE_RB_STRING_QI 43 #define SCE_RB_STRING_QS 44 #define SCE_RB_UPPER_BOUND 45 #define SCE_B_DEFAULT 0 #define SCE_B_COMMENT 1 #define SCE_B_NUMBER 2 #define SCE_B_KEYWORD 3 #define SCE_B_STRING 4 #define SCE_B_PREPROCESSOR 5 #define SCE_B_OPERATOR 6 #define SCE_B_IDENTIFIER 7 #define SCE_B_DATE 8 #define SCE_B_STRINGEOL 9 #define SCE_B_KEYWORD2 10 #define SCE_B_KEYWORD3 11 #define SCE_B_KEYWORD4 12 #define SCE_B_CONSTANT 13 #define SCE_B_ASM 14 #define SCE_B_LABEL 15 #define SCE_B_ERROR 16 #define SCE_B_HEXNUMBER 17 #define SCE_B_BINNUMBER 18 #define SCE_B_COMMENTBLOCK 19 #define SCE_B_DOCLINE 20 #define SCE_B_DOCBLOCK 21 #define SCE_B_DOCKEYWORD 22 #define SCE_PROPS_DEFAULT 0 #define SCE_PROPS_COMMENT 1 #define SCE_PROPS_SECTION 2 #define SCE_PROPS_ASSIGNMENT 3 #define SCE_PROPS_DEFVAL 4 #define SCE_PROPS_KEY 5 #define SCE_L_DEFAULT 0 #define SCE_L_COMMAND 1 #define SCE_L_TAG 2 #define SCE_L_MATH 3 #define SCE_L_COMMENT 4 #define SCE_L_TAG2 5 #define SCE_L_MATH2 6 #define SCE_L_COMMENT2 7 #define SCE_L_VERBATIM 8 #define SCE_L_SHORTCMD 9 #define SCE_L_SPECIAL 10 #define SCE_L_CMDOPT 11 #define SCE_L_ERROR 12 #define SCE_LUA_DEFAULT 0 #define SCE_LUA_COMMENT 1 #define SCE_LUA_COMMENTLINE 2 #define SCE_LUA_COMMENTDOC 3 #define SCE_LUA_NUMBER 4 #define SCE_LUA_WORD 5 #define SCE_LUA_STRING 6 #define SCE_LUA_CHARACTER 7 #define SCE_LUA_LITERALSTRING 8 #define SCE_LUA_PREPROCESSOR 9 #define SCE_LUA_OPERATOR 10 #define SCE_LUA_IDENTIFIER 11 #define SCE_LUA_STRINGEOL 12 #define SCE_LUA_WORD2 13 #define SCE_LUA_WORD3 14 #define SCE_LUA_WORD4 15 #define SCE_LUA_WORD5 16 #define SCE_LUA_WORD6 17 #define SCE_LUA_WORD7 18 #define SCE_LUA_WORD8 19 #define SCE_LUA_LABEL 20 #define SCE_ERR_DEFAULT 0 #define SCE_ERR_PYTHON 1 #define SCE_ERR_GCC 2 #define SCE_ERR_MS 3 #define SCE_ERR_CMD 4 #define SCE_ERR_BORLAND 5 #define SCE_ERR_PERL 6 #define SCE_ERR_NET 7 #define SCE_ERR_LUA 8 #define SCE_ERR_CTAG 9 #define SCE_ERR_DIFF_CHANGED 10 #define SCE_ERR_DIFF_ADDITION 11 #define SCE_ERR_DIFF_DELETION 12 #define SCE_ERR_DIFF_MESSAGE 13 #define SCE_ERR_PHP 14 #define SCE_ERR_ELF 15 #define SCE_ERR_IFC 16 #define SCE_ERR_IFORT 17 #define SCE_ERR_ABSF 18 #define SCE_ERR_TIDY 19 #define SCE_ERR_JAVA_STACK 20 #define SCE_ERR_VALUE 21 #define SCE_ERR_GCC_INCLUDED_FROM 22 #define SCE_ERR_ESCSEQ 23 #define SCE_ERR_ESCSEQ_UNKNOWN 24 #define SCE_ERR_GCC_EXCERPT 25 #define SCE_ERR_BASH 26 #define SCE_ERR_ES_BLACK 40 #define SCE_ERR_ES_RED 41 #define SCE_ERR_ES_GREEN 42 #define SCE_ERR_ES_BROWN 43 #define SCE_ERR_ES_BLUE 44 #define SCE_ERR_ES_MAGENTA 45 #define SCE_ERR_ES_CYAN 46 #define SCE_ERR_ES_GRAY 47 #define SCE_ERR_ES_DARK_GRAY 48 #define SCE_ERR_ES_BRIGHT_RED 49 #define SCE_ERR_ES_BRIGHT_GREEN 50 #define SCE_ERR_ES_YELLOW 51 #define SCE_ERR_ES_BRIGHT_BLUE 52 #define SCE_ERR_ES_BRIGHT_MAGENTA 53 #define SCE_ERR_ES_BRIGHT_CYAN 54 #define SCE_ERR_ES_WHITE 55 #define SCE_BAT_DEFAULT 0 #define SCE_BAT_COMMENT 1 #define SCE_BAT_WORD 2 #define SCE_BAT_LABEL 3 #define SCE_BAT_HIDE 4 #define SCE_BAT_COMMAND 5 #define SCE_BAT_IDENTIFIER 6 #define SCE_BAT_OPERATOR 7 #define SCE_BAT_AFTER_LABEL 8 #define SCE_TCMD_DEFAULT 0 #define SCE_TCMD_COMMENT 1 #define SCE_TCMD_WORD 2 #define SCE_TCMD_LABEL 3 #define SCE_TCMD_HIDE 4 #define SCE_TCMD_COMMAND 5 #define SCE_TCMD_IDENTIFIER 6 #define SCE_TCMD_OPERATOR 7 #define SCE_TCMD_ENVIRONMENT 8 #define SCE_TCMD_EXPANSION 9 #define SCE_TCMD_CLABEL 10 #define SCE_MAKE_DEFAULT 0 #define SCE_MAKE_COMMENT 1 #define SCE_MAKE_PREPROCESSOR 2 #define SCE_MAKE_IDENTIFIER 3 #define SCE_MAKE_OPERATOR 4 #define SCE_MAKE_TARGET 5 #define SCE_MAKE_IDEOL 9 #define SCE_DIFF_DEFAULT 0 #define SCE_DIFF_COMMENT 1 #define SCE_DIFF_COMMAND 2 #define SCE_DIFF_HEADER 3 #define SCE_DIFF_POSITION 4 #define SCE_DIFF_DELETED 5 #define SCE_DIFF_ADDED 6 #define SCE_DIFF_CHANGED 7 #define SCE_DIFF_PATCH_ADD 8 #define SCE_DIFF_PATCH_DELETE 9 #define SCE_DIFF_REMOVED_PATCH_ADD 10 #define SCE_DIFF_REMOVED_PATCH_DELETE 11 #define SCE_CONF_DEFAULT 0 #define SCE_CONF_COMMENT 1 #define SCE_CONF_NUMBER 2 #define SCE_CONF_IDENTIFIER 3 #define SCE_CONF_EXTENSION 4 #define SCE_CONF_PARAMETER 5 #define SCE_CONF_STRING 6 #define SCE_CONF_OPERATOR 7 #define SCE_CONF_IP 8 #define SCE_CONF_DIRECTIVE 9 #define SCE_AVE_DEFAULT 0 #define SCE_AVE_COMMENT 1 #define SCE_AVE_NUMBER 2 #define SCE_AVE_WORD 3 #define SCE_AVE_STRING 6 #define SCE_AVE_ENUM 7 #define SCE_AVE_STRINGEOL 8 #define SCE_AVE_IDENTIFIER 9 #define SCE_AVE_OPERATOR 10 #define SCE_AVE_WORD1 11 #define SCE_AVE_WORD2 12 #define SCE_AVE_WORD3 13 #define SCE_AVE_WORD4 14 #define SCE_AVE_WORD5 15 #define SCE_AVE_WORD6 16 #define SCE_ADA_DEFAULT 0 #define SCE_ADA_WORD 1 #define SCE_ADA_IDENTIFIER 2 #define SCE_ADA_NUMBER 3 #define SCE_ADA_DELIMITER 4 #define SCE_ADA_CHARACTER 5 #define SCE_ADA_CHARACTEREOL 6 #define SCE_ADA_STRING 7 #define SCE_ADA_STRINGEOL 8 #define SCE_ADA_LABEL 9 #define SCE_ADA_COMMENTLINE 10 #define SCE_ADA_ILLEGAL 11 #define SCE_BAAN_DEFAULT 0 #define SCE_BAAN_COMMENT 1 #define SCE_BAAN_COMMENTDOC 2 #define SCE_BAAN_NUMBER 3 #define SCE_BAAN_WORD 4 #define SCE_BAAN_STRING 5 #define SCE_BAAN_PREPROCESSOR 6 #define SCE_BAAN_OPERATOR 7 #define SCE_BAAN_IDENTIFIER 8 #define SCE_BAAN_STRINGEOL 9 #define SCE_BAAN_WORD2 10 #define SCE_BAAN_WORD3 11 #define SCE_BAAN_WORD4 12 #define SCE_BAAN_WORD5 13 #define SCE_BAAN_WORD6 14 #define SCE_BAAN_WORD7 15 #define SCE_BAAN_WORD8 16 #define SCE_BAAN_WORD9 17 #define SCE_BAAN_TABLEDEF 18 #define SCE_BAAN_TABLESQL 19 #define SCE_BAAN_FUNCTION 20 #define SCE_BAAN_DOMDEF 21 #define SCE_BAAN_FUNCDEF 22 #define SCE_BAAN_OBJECTDEF 23 #define SCE_BAAN_DEFINEDEF 24 #define SCE_LISP_DEFAULT 0 #define SCE_LISP_COMMENT 1 #define SCE_LISP_NUMBER 2 #define SCE_LISP_KEYWORD 3 #define SCE_LISP_KEYWORD_KW 4 #define SCE_LISP_SYMBOL 5 #define SCE_LISP_STRING 6 #define SCE_LISP_STRINGEOL 8 #define SCE_LISP_IDENTIFIER 9 #define SCE_LISP_OPERATOR 10 #define SCE_LISP_SPECIAL 11 #define SCE_LISP_MULTI_COMMENT 12 #define SCE_EIFFEL_DEFAULT 0 #define SCE_EIFFEL_COMMENTLINE 1 #define SCE_EIFFEL_NUMBER 2 #define SCE_EIFFEL_WORD 3 #define SCE_EIFFEL_STRING 4 #define SCE_EIFFEL_CHARACTER 5 #define SCE_EIFFEL_OPERATOR 6 #define SCE_EIFFEL_IDENTIFIER 7 #define SCE_EIFFEL_STRINGEOL 8 #define SCE_NNCRONTAB_DEFAULT 0 #define SCE_NNCRONTAB_COMMENT 1 #define SCE_NNCRONTAB_TASK 2 #define SCE_NNCRONTAB_SECTION 3 #define SCE_NNCRONTAB_KEYWORD 4 #define SCE_NNCRONTAB_MODIFIER 5 #define SCE_NNCRONTAB_ASTERISK 6 #define SCE_NNCRONTAB_NUMBER 7 #define SCE_NNCRONTAB_STRING 8 #define SCE_NNCRONTAB_ENVIRONMENT 9 #define SCE_NNCRONTAB_IDENTIFIER 10 #define SCE_FORTH_DEFAULT 0 #define SCE_FORTH_COMMENT 1 #define SCE_FORTH_COMMENT_ML 2 #define SCE_FORTH_IDENTIFIER 3 #define SCE_FORTH_CONTROL 4 #define SCE_FORTH_KEYWORD 5 #define SCE_FORTH_DEFWORD 6 #define SCE_FORTH_PREWORD1 7 #define SCE_FORTH_PREWORD2 8 #define SCE_FORTH_NUMBER 9 #define SCE_FORTH_STRING 10 #define SCE_FORTH_LOCALE 11 #define SCE_MATLAB_DEFAULT 0 #define SCE_MATLAB_COMMENT 1 #define SCE_MATLAB_COMMAND 2 #define SCE_MATLAB_NUMBER 3 #define SCE_MATLAB_KEYWORD 4 #define SCE_MATLAB_STRING 5 #define SCE_MATLAB_OPERATOR 6 #define SCE_MATLAB_IDENTIFIER 7 #define SCE_MATLAB_DOUBLEQUOTESTRING 8 #define SCE_MAXIMA_OPERATOR 0 #define SCE_MAXIMA_COMMANDENDING 1 #define SCE_MAXIMA_COMMENT 2 #define SCE_MAXIMA_NUMBER 3 #define SCE_MAXIMA_STRING 4 #define SCE_MAXIMA_COMMAND 5 #define SCE_MAXIMA_VARIABLE 6 #define SCE_MAXIMA_UNKNOWN 7 #define SCE_SCRIPTOL_DEFAULT 0 #define SCE_SCRIPTOL_WHITE 1 #define SCE_SCRIPTOL_COMMENTLINE 2 #define SCE_SCRIPTOL_PERSISTENT 3 #define SCE_SCRIPTOL_CSTYLE 4 #define SCE_SCRIPTOL_COMMENTBLOCK 5 #define SCE_SCRIPTOL_NUMBER 6 #define SCE_SCRIPTOL_STRING 7 #define SCE_SCRIPTOL_CHARACTER 8 #define SCE_SCRIPTOL_STRINGEOL 9 #define SCE_SCRIPTOL_KEYWORD 10 #define SCE_SCRIPTOL_OPERATOR 11 #define SCE_SCRIPTOL_IDENTIFIER 12 #define SCE_SCRIPTOL_TRIPLE 13 #define SCE_SCRIPTOL_CLASSNAME 14 #define SCE_SCRIPTOL_PREPROCESSOR 15 #define SCE_ASM_DEFAULT 0 #define SCE_ASM_COMMENT 1 #define SCE_ASM_NUMBER 2 #define SCE_ASM_STRING 3 #define SCE_ASM_OPERATOR 4 #define SCE_ASM_IDENTIFIER 5 #define SCE_ASM_CPUINSTRUCTION 6 #define SCE_ASM_MATHINSTRUCTION 7 #define SCE_ASM_REGISTER 8 #define SCE_ASM_DIRECTIVE 9 #define SCE_ASM_DIRECTIVEOPERAND 10 #define SCE_ASM_COMMENTBLOCK 11 #define SCE_ASM_CHARACTER 12 #define SCE_ASM_STRINGEOL 13 #define SCE_ASM_EXTINSTRUCTION 14 #define SCE_ASM_COMMENTDIRECTIVE 15 #define SCE_F_DEFAULT 0 #define SCE_F_COMMENT 1 #define SCE_F_NUMBER 2 #define SCE_F_STRING1 3 #define SCE_F_STRING2 4 #define SCE_F_STRINGEOL 5 #define SCE_F_OPERATOR 6 #define SCE_F_IDENTIFIER 7 #define SCE_F_WORD 8 #define SCE_F_WORD2 9 #define SCE_F_WORD3 10 #define SCE_F_PREPROCESSOR 11 #define SCE_F_OPERATOR2 12 #define SCE_F_LABEL 13 #define SCE_F_CONTINUATION 14 #define SCE_CSS_DEFAULT 0 #define SCE_CSS_TAG 1 #define SCE_CSS_CLASS 2 #define SCE_CSS_PSEUDOCLASS 3 #define SCE_CSS_UNKNOWN_PSEUDOCLASS 4 #define SCE_CSS_OPERATOR 5 #define SCE_CSS_IDENTIFIER 6 #define SCE_CSS_UNKNOWN_IDENTIFIER 7 #define SCE_CSS_VALUE 8 #define SCE_CSS_COMMENT 9 #define SCE_CSS_ID 10 #define SCE_CSS_IMPORTANT 11 #define SCE_CSS_DIRECTIVE 12 #define SCE_CSS_DOUBLESTRING 13 #define SCE_CSS_SINGLESTRING 14 #define SCE_CSS_IDENTIFIER2 15 #define SCE_CSS_ATTRIBUTE 16 #define SCE_CSS_IDENTIFIER3 17 #define SCE_CSS_PSEUDOELEMENT 18 #define SCE_CSS_EXTENDED_IDENTIFIER 19 #define SCE_CSS_EXTENDED_PSEUDOCLASS 20 #define SCE_CSS_EXTENDED_PSEUDOELEMENT 21 #define SCE_CSS_GROUP_RULE 22 #define SCE_CSS_VARIABLE 23 #define SCE_POV_DEFAULT 0 #define SCE_POV_COMMENT 1 #define SCE_POV_COMMENTLINE 2 #define SCE_POV_NUMBER 3 #define SCE_POV_OPERATOR 4 #define SCE_POV_IDENTIFIER 5 #define SCE_POV_STRING 6 #define SCE_POV_STRINGEOL 7 #define SCE_POV_DIRECTIVE 8 #define SCE_POV_BADDIRECTIVE 9 #define SCE_POV_WORD2 10 #define SCE_POV_WORD3 11 #define SCE_POV_WORD4 12 #define SCE_POV_WORD5 13 #define SCE_POV_WORD6 14 #define SCE_POV_WORD7 15 #define SCE_POV_WORD8 16 #define SCE_LOUT_DEFAULT 0 #define SCE_LOUT_COMMENT 1 #define SCE_LOUT_NUMBER 2 #define SCE_LOUT_WORD 3 #define SCE_LOUT_WORD2 4 #define SCE_LOUT_WORD3 5 #define SCE_LOUT_WORD4 6 #define SCE_LOUT_STRING 7 #define SCE_LOUT_OPERATOR 8 #define SCE_LOUT_IDENTIFIER 9 #define SCE_LOUT_STRINGEOL 10 #define SCE_ESCRIPT_DEFAULT 0 #define SCE_ESCRIPT_COMMENT 1 #define SCE_ESCRIPT_COMMENTLINE 2 #define SCE_ESCRIPT_COMMENTDOC 3 #define SCE_ESCRIPT_NUMBER 4 #define SCE_ESCRIPT_WORD 5 #define SCE_ESCRIPT_STRING 6 #define SCE_ESCRIPT_OPERATOR 7 #define SCE_ESCRIPT_IDENTIFIER 8 #define SCE_ESCRIPT_BRACE 9 #define SCE_ESCRIPT_WORD2 10 #define SCE_ESCRIPT_WORD3 11 #define SCE_PS_DEFAULT 0 #define SCE_PS_COMMENT 1 #define SCE_PS_DSC_COMMENT 2 #define SCE_PS_DSC_VALUE 3 #define SCE_PS_NUMBER 4 #define SCE_PS_NAME 5 #define SCE_PS_KEYWORD 6 #define SCE_PS_LITERAL 7 #define SCE_PS_IMMEVAL 8 #define SCE_PS_PAREN_ARRAY 9 #define SCE_PS_PAREN_DICT 10 #define SCE_PS_PAREN_PROC 11 #define SCE_PS_TEXT 12 #define SCE_PS_HEXSTRING 13 #define SCE_PS_BASE85STRING 14 #define SCE_PS_BADSTRINGCHAR 15 #define SCE_NSIS_DEFAULT 0 #define SCE_NSIS_COMMENT 1 #define SCE_NSIS_STRINGDQ 2 #define SCE_NSIS_STRINGLQ 3 #define SCE_NSIS_STRINGRQ 4 #define SCE_NSIS_FUNCTION 5 #define SCE_NSIS_VARIABLE 6 #define SCE_NSIS_LABEL 7 #define SCE_NSIS_USERDEFINED 8 #define SCE_NSIS_SECTIONDEF 9 #define SCE_NSIS_SUBSECTIONDEF 10 #define SCE_NSIS_IFDEFINEDEF 11 #define SCE_NSIS_MACRODEF 12 #define SCE_NSIS_STRINGVAR 13 #define SCE_NSIS_NUMBER 14 #define SCE_NSIS_SECTIONGROUP 15 #define SCE_NSIS_PAGEEX 16 #define SCE_NSIS_FUNCTIONDEF 17 #define SCE_NSIS_COMMENTBOX 18 #define SCE_MMIXAL_LEADWS 0 #define SCE_MMIXAL_COMMENT 1 #define SCE_MMIXAL_LABEL 2 #define SCE_MMIXAL_OPCODE 3 #define SCE_MMIXAL_OPCODE_PRE 4 #define SCE_MMIXAL_OPCODE_VALID 5 #define SCE_MMIXAL_OPCODE_UNKNOWN 6 #define SCE_MMIXAL_OPCODE_POST 7 #define SCE_MMIXAL_OPERANDS 8 #define SCE_MMIXAL_NUMBER 9 #define SCE_MMIXAL_REF 10 #define SCE_MMIXAL_CHAR 11 #define SCE_MMIXAL_STRING 12 #define SCE_MMIXAL_REGISTER 13 #define SCE_MMIXAL_HEX 14 #define SCE_MMIXAL_OPERATOR 15 #define SCE_MMIXAL_SYMBOL 16 #define SCE_MMIXAL_INCLUDE 17 #define SCE_CLW_DEFAULT 0 #define SCE_CLW_LABEL 1 #define SCE_CLW_COMMENT 2 #define SCE_CLW_STRING 3 #define SCE_CLW_USER_IDENTIFIER 4 #define SCE_CLW_INTEGER_CONSTANT 5 #define SCE_CLW_REAL_CONSTANT 6 #define SCE_CLW_PICTURE_STRING 7 #define SCE_CLW_KEYWORD 8 #define SCE_CLW_COMPILER_DIRECTIVE 9 #define SCE_CLW_RUNTIME_EXPRESSIONS 10 #define SCE_CLW_BUILTIN_PROCEDURES_FUNCTION 11 #define SCE_CLW_STRUCTURE_DATA_TYPE 12 #define SCE_CLW_ATTRIBUTE 13 #define SCE_CLW_STANDARD_EQUATE 14 #define SCE_CLW_ERROR 15 #define SCE_CLW_DEPRECATED 16 #define SCE_LOT_DEFAULT 0 #define SCE_LOT_HEADER 1 #define SCE_LOT_BREAK 2 #define SCE_LOT_SET 3 #define SCE_LOT_PASS 4 #define SCE_LOT_FAIL 5 #define SCE_LOT_ABORT 6 #define SCE_YAML_DEFAULT 0 #define SCE_YAML_COMMENT 1 #define SCE_YAML_IDENTIFIER 2 #define SCE_YAML_KEYWORD 3 #define SCE_YAML_NUMBER 4 #define SCE_YAML_REFERENCE 5 #define SCE_YAML_DOCUMENT 6 #define SCE_YAML_TEXT 7 #define SCE_YAML_ERROR 8 #define SCE_YAML_OPERATOR 9 #define SCE_TEX_DEFAULT 0 #define SCE_TEX_SPECIAL 1 #define SCE_TEX_GROUP 2 #define SCE_TEX_SYMBOL 3 #define SCE_TEX_COMMAND 4 #define SCE_TEX_TEXT 5 #define SCE_METAPOST_DEFAULT 0 #define SCE_METAPOST_SPECIAL 1 #define SCE_METAPOST_GROUP 2 #define SCE_METAPOST_SYMBOL 3 #define SCE_METAPOST_COMMAND 4 #define SCE_METAPOST_TEXT 5 #define SCE_METAPOST_EXTRA 6 #define SCE_ERLANG_DEFAULT 0 #define SCE_ERLANG_COMMENT 1 #define SCE_ERLANG_VARIABLE 2 #define SCE_ERLANG_NUMBER 3 #define SCE_ERLANG_KEYWORD 4 #define SCE_ERLANG_STRING 5 #define SCE_ERLANG_OPERATOR 6 #define SCE_ERLANG_ATOM 7 #define SCE_ERLANG_FUNCTION_NAME 8 #define SCE_ERLANG_CHARACTER 9 #define SCE_ERLANG_MACRO 10 #define SCE_ERLANG_RECORD 11 #define SCE_ERLANG_PREPROC 12 #define SCE_ERLANG_NODE_NAME 13 #define SCE_ERLANG_COMMENT_FUNCTION 14 #define SCE_ERLANG_COMMENT_MODULE 15 #define SCE_ERLANG_COMMENT_DOC 16 #define SCE_ERLANG_COMMENT_DOC_MACRO 17 #define SCE_ERLANG_ATOM_QUOTED 18 #define SCE_ERLANG_MACRO_QUOTED 19 #define SCE_ERLANG_RECORD_QUOTED 20 #define SCE_ERLANG_NODE_NAME_QUOTED 21 #define SCE_ERLANG_BIFS 22 #define SCE_ERLANG_MODULES 23 #define SCE_ERLANG_MODULES_ATT 24 #define SCE_ERLANG_UNKNOWN 31 #define SCE_JULIA_DEFAULT 0 #define SCE_JULIA_COMMENT 1 #define SCE_JULIA_NUMBER 2 #define SCE_JULIA_KEYWORD1 3 #define SCE_JULIA_KEYWORD2 4 #define SCE_JULIA_KEYWORD3 5 #define SCE_JULIA_CHAR 6 #define SCE_JULIA_OPERATOR 7 #define SCE_JULIA_BRACKET 8 #define SCE_JULIA_IDENTIFIER 9 #define SCE_JULIA_STRING 10 #define SCE_JULIA_SYMBOL 11 #define SCE_JULIA_MACRO 12 #define SCE_JULIA_STRINGINTERP 13 #define SCE_JULIA_DOCSTRING 14 #define SCE_JULIA_STRINGLITERAL 15 #define SCE_JULIA_COMMAND 16 #define SCE_JULIA_COMMANDLITERAL 17 #define SCE_JULIA_TYPEANNOT 18 #define SCE_JULIA_LEXERROR 19 #define SCE_JULIA_KEYWORD4 20 #define SCE_JULIA_TYPEOPERATOR 21 #define SCE_MSSQL_DEFAULT 0 #define SCE_MSSQL_COMMENT 1 #define SCE_MSSQL_LINE_COMMENT 2 #define SCE_MSSQL_NUMBER 3 #define SCE_MSSQL_STRING 4 #define SCE_MSSQL_OPERATOR 5 #define SCE_MSSQL_IDENTIFIER 6 #define SCE_MSSQL_VARIABLE 7 #define SCE_MSSQL_COLUMN_NAME 8 #define SCE_MSSQL_STATEMENT 9 #define SCE_MSSQL_DATATYPE 10 #define SCE_MSSQL_SYSTABLE 11 #define SCE_MSSQL_GLOBAL_VARIABLE 12 #define SCE_MSSQL_FUNCTION 13 #define SCE_MSSQL_STORED_PROCEDURE 14 #define SCE_MSSQL_DEFAULT_PREF_DATATYPE 15 #define SCE_MSSQL_COLUMN_NAME_2 16 #define SCE_V_DEFAULT 0 #define SCE_V_COMMENT 1 #define SCE_V_COMMENTLINE 2 #define SCE_V_COMMENTLINEBANG 3 #define SCE_V_NUMBER 4 #define SCE_V_WORD 5 #define SCE_V_STRING 6 #define SCE_V_WORD2 7 #define SCE_V_WORD3 8 #define SCE_V_PREPROCESSOR 9 #define SCE_V_OPERATOR 10 #define SCE_V_IDENTIFIER 11 #define SCE_V_STRINGEOL 12 #define SCE_V_USER 19 #define SCE_V_COMMENT_WORD 20 #define SCE_V_INPUT 21 #define SCE_V_OUTPUT 22 #define SCE_V_INOUT 23 #define SCE_V_PORT_CONNECT 24 #define SCE_KIX_DEFAULT 0 #define SCE_KIX_COMMENT 1 #define SCE_KIX_STRING1 2 #define SCE_KIX_STRING2 3 #define SCE_KIX_NUMBER 4 #define SCE_KIX_VAR 5 #define SCE_KIX_MACRO 6 #define SCE_KIX_KEYWORD 7 #define SCE_KIX_FUNCTIONS 8 #define SCE_KIX_OPERATOR 9 #define SCE_KIX_COMMENTSTREAM 10 #define SCE_KIX_IDENTIFIER 31 #define SCE_GC_DEFAULT 0 #define SCE_GC_COMMENTLINE 1 #define SCE_GC_COMMENTBLOCK 2 #define SCE_GC_GLOBAL 3 #define SCE_GC_EVENT 4 #define SCE_GC_ATTRIBUTE 5 #define SCE_GC_CONTROL 6 #define SCE_GC_COMMAND 7 #define SCE_GC_STRING 8 #define SCE_GC_OPERATOR 9 #define SCE_SN_DEFAULT 0 #define SCE_SN_CODE 1 #define SCE_SN_COMMENTLINE 2 #define SCE_SN_COMMENTLINEBANG 3 #define SCE_SN_NUMBER 4 #define SCE_SN_WORD 5 #define SCE_SN_STRING 6 #define SCE_SN_WORD2 7 #define SCE_SN_WORD3 8 #define SCE_SN_PREPROCESSOR 9 #define SCE_SN_OPERATOR 10 #define SCE_SN_IDENTIFIER 11 #define SCE_SN_STRINGEOL 12 #define SCE_SN_REGEXTAG 13 #define SCE_SN_SIGNAL 14 #define SCE_SN_USER 19 #define SCE_AU3_DEFAULT 0 #define SCE_AU3_COMMENT 1 #define SCE_AU3_COMMENTBLOCK 2 #define SCE_AU3_NUMBER 3 #define SCE_AU3_FUNCTION 4 #define SCE_AU3_KEYWORD 5 #define SCE_AU3_MACRO 6 #define SCE_AU3_STRING 7 #define SCE_AU3_OPERATOR 8 #define SCE_AU3_VARIABLE 9 #define SCE_AU3_SENT 10 #define SCE_AU3_PREPROCESSOR 11 #define SCE_AU3_SPECIAL 12 #define SCE_AU3_EXPAND 13 #define SCE_AU3_COMOBJ 14 #define SCE_AU3_UDF 15 #define SCE_APDL_DEFAULT 0 #define SCE_APDL_COMMENT 1 #define SCE_APDL_COMMENTBLOCK 2 #define SCE_APDL_NUMBER 3 #define SCE_APDL_STRING 4 #define SCE_APDL_OPERATOR 5 #define SCE_APDL_WORD 6 #define SCE_APDL_PROCESSOR 7 #define SCE_APDL_COMMAND 8 #define SCE_APDL_SLASHCOMMAND 9 #define SCE_APDL_STARCOMMAND 10 #define SCE_APDL_ARGUMENT 11 #define SCE_APDL_FUNCTION 12 #define SCE_SH_DEFAULT 0 #define SCE_SH_ERROR 1 #define SCE_SH_COMMENTLINE 2 #define SCE_SH_NUMBER 3 #define SCE_SH_WORD 4 #define SCE_SH_STRING 5 #define SCE_SH_CHARACTER 6 #define SCE_SH_OPERATOR 7 #define SCE_SH_IDENTIFIER 8 #define SCE_SH_SCALAR 9 #define SCE_SH_PARAM 10 #define SCE_SH_BACKTICKS 11 #define SCE_SH_HERE_DELIM 12 #define SCE_SH_HERE_Q 13 #define SCE_ASN1_DEFAULT 0 #define SCE_ASN1_COMMENT 1 #define SCE_ASN1_IDENTIFIER 2 #define SCE_ASN1_STRING 3 #define SCE_ASN1_OID 4 #define SCE_ASN1_SCALAR 5 #define SCE_ASN1_KEYWORD 6 #define SCE_ASN1_ATTRIBUTE 7 #define SCE_ASN1_DESCRIPTOR 8 #define SCE_ASN1_TYPE 9 #define SCE_ASN1_OPERATOR 10 #define SCE_VHDL_DEFAULT 0 #define SCE_VHDL_COMMENT 1 #define SCE_VHDL_COMMENTLINEBANG 2 #define SCE_VHDL_NUMBER 3 #define SCE_VHDL_STRING 4 #define SCE_VHDL_OPERATOR 5 #define SCE_VHDL_IDENTIFIER 6 #define SCE_VHDL_STRINGEOL 7 #define SCE_VHDL_KEYWORD 8 #define SCE_VHDL_STDOPERATOR 9 #define SCE_VHDL_ATTRIBUTE 10 #define SCE_VHDL_STDFUNCTION 11 #define SCE_VHDL_STDPACKAGE 12 #define SCE_VHDL_STDTYPE 13 #define SCE_VHDL_USERWORD 14 #define SCE_VHDL_BLOCK_COMMENT 15 #define SCE_CAML_DEFAULT 0 #define SCE_CAML_IDENTIFIER 1 #define SCE_CAML_TAGNAME 2 #define SCE_CAML_KEYWORD 3 #define SCE_CAML_KEYWORD2 4 #define SCE_CAML_KEYWORD3 5 #define SCE_CAML_LINENUM 6 #define SCE_CAML_OPERATOR 7 #define SCE_CAML_NUMBER 8 #define SCE_CAML_CHAR 9 #define SCE_CAML_WHITE 10 #define SCE_CAML_STRING 11 #define SCE_CAML_COMMENT 12 #define SCE_CAML_COMMENT1 13 #define SCE_CAML_COMMENT2 14 #define SCE_CAML_COMMENT3 15 #define SCE_HA_DEFAULT 0 #define SCE_HA_IDENTIFIER 1 #define SCE_HA_KEYWORD 2 #define SCE_HA_NUMBER 3 #define SCE_HA_STRING 4 #define SCE_HA_CHARACTER 5 #define SCE_HA_CLASS 6 #define SCE_HA_MODULE 7 #define SCE_HA_CAPITAL 8 #define SCE_HA_DATA 9 #define SCE_HA_IMPORT 10 #define SCE_HA_OPERATOR 11 #define SCE_HA_INSTANCE 12 #define SCE_HA_COMMENTLINE 13 #define SCE_HA_COMMENTBLOCK 14 #define SCE_HA_COMMENTBLOCK2 15 #define SCE_HA_COMMENTBLOCK3 16 #define SCE_HA_PRAGMA 17 #define SCE_HA_PREPROCESSOR 18 #define SCE_HA_STRINGEOL 19 #define SCE_HA_RESERVED_OPERATOR 20 #define SCE_HA_LITERATE_COMMENT 21 #define SCE_HA_LITERATE_CODEDELIM 22 #define SCE_T3_DEFAULT 0 #define SCE_T3_X_DEFAULT 1 #define SCE_T3_PREPROCESSOR 2 #define SCE_T3_BLOCK_COMMENT 3 #define SCE_T3_LINE_COMMENT 4 #define SCE_T3_OPERATOR 5 #define SCE_T3_KEYWORD 6 #define SCE_T3_NUMBER 7 #define SCE_T3_IDENTIFIER 8 #define SCE_T3_S_STRING 9 #define SCE_T3_D_STRING 10 #define SCE_T3_X_STRING 11 #define SCE_T3_LIB_DIRECTIVE 12 #define SCE_T3_MSG_PARAM 13 #define SCE_T3_HTML_TAG 14 #define SCE_T3_HTML_DEFAULT 15 #define SCE_T3_HTML_STRING 16 #define SCE_T3_USER1 17 #define SCE_T3_USER2 18 #define SCE_T3_USER3 19 #define SCE_T3_BRACE 20 #define SCE_REBOL_DEFAULT 0 #define SCE_REBOL_COMMENTLINE 1 #define SCE_REBOL_COMMENTBLOCK 2 #define SCE_REBOL_PREFACE 3 #define SCE_REBOL_OPERATOR 4 #define SCE_REBOL_CHARACTER 5 #define SCE_REBOL_QUOTEDSTRING 6 #define SCE_REBOL_BRACEDSTRING 7 #define SCE_REBOL_NUMBER 8 #define SCE_REBOL_PAIR 9 #define SCE_REBOL_TUPLE 10 #define SCE_REBOL_BINARY 11 #define SCE_REBOL_MONEY 12 #define SCE_REBOL_ISSUE 13 #define SCE_REBOL_TAG 14 #define SCE_REBOL_FILE 15 #define SCE_REBOL_EMAIL 16 #define SCE_REBOL_URL 17 #define SCE_REBOL_DATE 18 #define SCE_REBOL_TIME 19 #define SCE_REBOL_IDENTIFIER 20 #define SCE_REBOL_WORD 21 #define SCE_REBOL_WORD2 22 #define SCE_REBOL_WORD3 23 #define SCE_REBOL_WORD4 24 #define SCE_REBOL_WORD5 25 #define SCE_REBOL_WORD6 26 #define SCE_REBOL_WORD7 27 #define SCE_REBOL_WORD8 28 #define SCE_SQL_DEFAULT 0 #define SCE_SQL_COMMENT 1 #define SCE_SQL_COMMENTLINE 2 #define SCE_SQL_COMMENTDOC 3 #define SCE_SQL_NUMBER 4 #define SCE_SQL_WORD 5 #define SCE_SQL_STRING 6 #define SCE_SQL_CHARACTER 7 #define SCE_SQL_SQLPLUS 8 #define SCE_SQL_SQLPLUS_PROMPT 9 #define SCE_SQL_OPERATOR 10 #define SCE_SQL_IDENTIFIER 11 #define SCE_SQL_SQLPLUS_COMMENT 13 #define SCE_SQL_COMMENTLINEDOC 15 #define SCE_SQL_WORD2 16 #define SCE_SQL_COMMENTDOCKEYWORD 17 #define SCE_SQL_COMMENTDOCKEYWORDERROR 18 #define SCE_SQL_USER1 19 #define SCE_SQL_USER2 20 #define SCE_SQL_USER3 21 #define SCE_SQL_USER4 22 #define SCE_SQL_QUOTEDIDENTIFIER 23 #define SCE_SQL_QOPERATOR 24 #define SCE_ST_DEFAULT 0 #define SCE_ST_STRING 1 #define SCE_ST_NUMBER 2 #define SCE_ST_COMMENT 3 #define SCE_ST_SYMBOL 4 #define SCE_ST_BINARY 5 #define SCE_ST_BOOL 6 #define SCE_ST_SELF 7 #define SCE_ST_SUPER 8 #define SCE_ST_NIL 9 #define SCE_ST_GLOBAL 10 #define SCE_ST_RETURN 11 #define SCE_ST_SPECIAL 12 #define SCE_ST_KWSEND 13 #define SCE_ST_ASSIGN 14 #define SCE_ST_CHARACTER 15 #define SCE_ST_SPEC_SEL 16 #define SCE_FS_DEFAULT 0 #define SCE_FS_COMMENT 1 #define SCE_FS_COMMENTLINE 2 #define SCE_FS_COMMENTDOC 3 #define SCE_FS_COMMENTLINEDOC 4 #define SCE_FS_COMMENTDOCKEYWORD 5 #define SCE_FS_COMMENTDOCKEYWORDERROR 6 #define SCE_FS_KEYWORD 7 #define SCE_FS_KEYWORD2 8 #define SCE_FS_KEYWORD3 9 #define SCE_FS_KEYWORD4 10 #define SCE_FS_NUMBER 11 #define SCE_FS_STRING 12 #define SCE_FS_PREPROCESSOR 13 #define SCE_FS_OPERATOR 14 #define SCE_FS_IDENTIFIER 15 #define SCE_FS_DATE 16 #define SCE_FS_STRINGEOL 17 #define SCE_FS_CONSTANT 18 #define SCE_FS_WORDOPERATOR 19 #define SCE_FS_DISABLEDCODE 20 #define SCE_FS_DEFAULT_C 21 #define SCE_FS_COMMENTDOC_C 22 #define SCE_FS_COMMENTLINEDOC_C 23 #define SCE_FS_KEYWORD_C 24 #define SCE_FS_KEYWORD2_C 25 #define SCE_FS_NUMBER_C 26 #define SCE_FS_STRING_C 27 #define SCE_FS_PREPROCESSOR_C 28 #define SCE_FS_OPERATOR_C 29 #define SCE_FS_IDENTIFIER_C 30 #define SCE_FS_STRINGEOL_C 31 #define SCE_CSOUND_DEFAULT 0 #define SCE_CSOUND_COMMENT 1 #define SCE_CSOUND_NUMBER 2 #define SCE_CSOUND_OPERATOR 3 #define SCE_CSOUND_INSTR 4 #define SCE_CSOUND_IDENTIFIER 5 #define SCE_CSOUND_OPCODE 6 #define SCE_CSOUND_HEADERSTMT 7 #define SCE_CSOUND_USERKEYWORD 8 #define SCE_CSOUND_COMMENTBLOCK 9 #define SCE_CSOUND_PARAM 10 #define SCE_CSOUND_ARATE_VAR 11 #define SCE_CSOUND_KRATE_VAR 12 #define SCE_CSOUND_IRATE_VAR 13 #define SCE_CSOUND_GLOBAL_VAR 14 #define SCE_CSOUND_STRINGEOL 15 #define SCE_INNO_DEFAULT 0 #define SCE_INNO_COMMENT 1 #define SCE_INNO_KEYWORD 2 #define SCE_INNO_PARAMETER 3 #define SCE_INNO_SECTION 4 #define SCE_INNO_PREPROC 5 #define SCE_INNO_INLINE_EXPANSION 6 #define SCE_INNO_COMMENT_PASCAL 7 #define SCE_INNO_KEYWORD_PASCAL 8 #define SCE_INNO_KEYWORD_USER 9 #define SCE_INNO_STRING_DOUBLE 10 #define SCE_INNO_STRING_SINGLE 11 #define SCE_INNO_IDENTIFIER 12 #define SCE_OPAL_SPACE 0 #define SCE_OPAL_COMMENT_BLOCK 1 #define SCE_OPAL_COMMENT_LINE 2 #define SCE_OPAL_INTEGER 3 #define SCE_OPAL_KEYWORD 4 #define SCE_OPAL_SORT 5 #define SCE_OPAL_STRING 6 #define SCE_OPAL_PAR 7 #define SCE_OPAL_BOOL_CONST 8 #define SCE_OPAL_DEFAULT 32 #define SCE_SPICE_DEFAULT 0 #define SCE_SPICE_IDENTIFIER 1 #define SCE_SPICE_KEYWORD 2 #define SCE_SPICE_KEYWORD2 3 #define SCE_SPICE_KEYWORD3 4 #define SCE_SPICE_NUMBER 5 #define SCE_SPICE_DELIMITER 6 #define SCE_SPICE_VALUE 7 #define SCE_SPICE_COMMENTLINE 8 #define SCE_CMAKE_DEFAULT 0 #define SCE_CMAKE_COMMENT 1 #define SCE_CMAKE_STRINGDQ 2 #define SCE_CMAKE_STRINGLQ 3 #define SCE_CMAKE_STRINGRQ 4 #define SCE_CMAKE_COMMANDS 5 #define SCE_CMAKE_PARAMETERS 6 #define SCE_CMAKE_VARIABLE 7 #define SCE_CMAKE_USERDEFINED 8 #define SCE_CMAKE_WHILEDEF 9 #define SCE_CMAKE_FOREACHDEF 10 #define SCE_CMAKE_IFDEFINEDEF 11 #define SCE_CMAKE_MACRODEF 12 #define SCE_CMAKE_STRINGVAR 13 #define SCE_CMAKE_NUMBER 14 #define SCE_GAP_DEFAULT 0 #define SCE_GAP_IDENTIFIER 1 #define SCE_GAP_KEYWORD 2 #define SCE_GAP_KEYWORD2 3 #define SCE_GAP_KEYWORD3 4 #define SCE_GAP_KEYWORD4 5 #define SCE_GAP_STRING 6 #define SCE_GAP_CHAR 7 #define SCE_GAP_OPERATOR 8 #define SCE_GAP_COMMENT 9 #define SCE_GAP_NUMBER 10 #define SCE_GAP_STRINGEOL 11 #define SCE_PLM_DEFAULT 0 #define SCE_PLM_COMMENT 1 #define SCE_PLM_STRING 2 #define SCE_PLM_NUMBER 3 #define SCE_PLM_IDENTIFIER 4 #define SCE_PLM_OPERATOR 5 #define SCE_PLM_CONTROL 6 #define SCE_PLM_KEYWORD 7 #define SCE_ABL_DEFAULT 0 #define SCE_ABL_NUMBER 1 #define SCE_ABL_WORD 2 #define SCE_ABL_STRING 3 #define SCE_ABL_CHARACTER 4 #define SCE_ABL_PREPROCESSOR 5 #define SCE_ABL_OPERATOR 6 #define SCE_ABL_IDENTIFIER 7 #define SCE_ABL_BLOCK 8 #define SCE_ABL_END 9 #define SCE_ABL_COMMENT 10 #define SCE_ABL_TASKMARKER 11 #define SCE_ABL_LINECOMMENT 12 #define SCE_ABAQUS_DEFAULT 0 #define SCE_ABAQUS_COMMENT 1 #define SCE_ABAQUS_COMMENTBLOCK 2 #define SCE_ABAQUS_NUMBER 3 #define SCE_ABAQUS_STRING 4 #define SCE_ABAQUS_OPERATOR 5 #define SCE_ABAQUS_WORD 6 #define SCE_ABAQUS_PROCESSOR 7 #define SCE_ABAQUS_COMMAND 8 #define SCE_ABAQUS_SLASHCOMMAND 9 #define SCE_ABAQUS_STARCOMMAND 10 #define SCE_ABAQUS_ARGUMENT 11 #define SCE_ABAQUS_FUNCTION 12 #define SCE_ASY_DEFAULT 0 #define SCE_ASY_COMMENT 1 #define SCE_ASY_COMMENTLINE 2 #define SCE_ASY_NUMBER 3 #define SCE_ASY_WORD 4 #define SCE_ASY_STRING 5 #define SCE_ASY_CHARACTER 6 #define SCE_ASY_OPERATOR 7 #define SCE_ASY_IDENTIFIER 8 #define SCE_ASY_STRINGEOL 9 #define SCE_ASY_COMMENTLINEDOC 10 #define SCE_ASY_WORD2 11 #define SCE_R_DEFAULT 0 #define SCE_R_COMMENT 1 #define SCE_R_KWORD 2 #define SCE_R_BASEKWORD 3 #define SCE_R_OTHERKWORD 4 #define SCE_R_NUMBER 5 #define SCE_R_STRING 6 #define SCE_R_STRING2 7 #define SCE_R_OPERATOR 8 #define SCE_R_IDENTIFIER 9 #define SCE_R_INFIX 10 #define SCE_R_INFIXEOL 11 #define SCE_R_BACKTICKS 12 #define SCE_R_RAWSTRING 13 #define SCE_R_RAWSTRING2 14 #define SCE_R_ESCAPESEQUENCE 15 #define SCE_MAGIK_DEFAULT 0 #define SCE_MAGIK_COMMENT 1 #define SCE_MAGIK_HYPER_COMMENT 16 #define SCE_MAGIK_STRING 2 #define SCE_MAGIK_CHARACTER 3 #define SCE_MAGIK_NUMBER 4 #define SCE_MAGIK_IDENTIFIER 5 #define SCE_MAGIK_OPERATOR 6 #define SCE_MAGIK_FLOW 7 #define SCE_MAGIK_CONTAINER 8 #define SCE_MAGIK_BRACKET_BLOCK 9 #define SCE_MAGIK_BRACE_BLOCK 10 #define SCE_MAGIK_SQBRACKET_BLOCK 11 #define SCE_MAGIK_UNKNOWN_KEYWORD 12 #define SCE_MAGIK_KEYWORD 13 #define SCE_MAGIK_PRAGMA 14 #define SCE_MAGIK_SYMBOL 15 #define SCE_POWERSHELL_DEFAULT 0 #define SCE_POWERSHELL_COMMENT 1 #define SCE_POWERSHELL_STRING 2 #define SCE_POWERSHELL_CHARACTER 3 #define SCE_POWERSHELL_NUMBER 4 #define SCE_POWERSHELL_VARIABLE 5 #define SCE_POWERSHELL_OPERATOR 6 #define SCE_POWERSHELL_IDENTIFIER 7 #define SCE_POWERSHELL_KEYWORD 8 #define SCE_POWERSHELL_CMDLET 9 #define SCE_POWERSHELL_ALIAS 10 #define SCE_POWERSHELL_FUNCTION 11 #define SCE_POWERSHELL_USER1 12 #define SCE_POWERSHELL_COMMENTSTREAM 13 #define SCE_POWERSHELL_HERE_STRING 14 #define SCE_POWERSHELL_HERE_CHARACTER 15 #define SCE_POWERSHELL_COMMENTDOCKEYWORD 16 #define SCE_MYSQL_DEFAULT 0 #define SCE_MYSQL_COMMENT 1 #define SCE_MYSQL_COMMENTLINE 2 #define SCE_MYSQL_VARIABLE 3 #define SCE_MYSQL_SYSTEMVARIABLE 4 #define SCE_MYSQL_KNOWNSYSTEMVARIABLE 5 #define SCE_MYSQL_NUMBER 6 #define SCE_MYSQL_MAJORKEYWORD 7 #define SCE_MYSQL_KEYWORD 8 #define SCE_MYSQL_DATABASEOBJECT 9 #define SCE_MYSQL_PROCEDUREKEYWORD 10 #define SCE_MYSQL_STRING 11 #define SCE_MYSQL_SQSTRING 12 #define SCE_MYSQL_DQSTRING 13 #define SCE_MYSQL_OPERATOR 14 #define SCE_MYSQL_FUNCTION 15 #define SCE_MYSQL_IDENTIFIER 16 #define SCE_MYSQL_QUOTEDIDENTIFIER 17 #define SCE_MYSQL_USER1 18 #define SCE_MYSQL_USER2 19 #define SCE_MYSQL_USER3 20 #define SCE_MYSQL_HIDDENCOMMAND 21 #define SCE_MYSQL_PLACEHOLDER 22 #define SCE_PO_DEFAULT 0 #define SCE_PO_COMMENT 1 #define SCE_PO_MSGID 2 #define SCE_PO_MSGID_TEXT 3 #define SCE_PO_MSGSTR 4 #define SCE_PO_MSGSTR_TEXT 5 #define SCE_PO_MSGCTXT 6 #define SCE_PO_MSGCTXT_TEXT 7 #define SCE_PO_FUZZY 8 #define SCE_PO_PROGRAMMER_COMMENT 9 #define SCE_PO_REFERENCE 10 #define SCE_PO_FLAGS 11 #define SCE_PO_MSGID_TEXT_EOL 12 #define SCE_PO_MSGSTR_TEXT_EOL 13 #define SCE_PO_MSGCTXT_TEXT_EOL 14 #define SCE_PO_ERROR 15 #define SCE_PAS_DEFAULT 0 #define SCE_PAS_IDENTIFIER 1 #define SCE_PAS_COMMENT 2 #define SCE_PAS_COMMENT2 3 #define SCE_PAS_COMMENTLINE 4 #define SCE_PAS_PREPROCESSOR 5 #define SCE_PAS_PREPROCESSOR2 6 #define SCE_PAS_NUMBER 7 #define SCE_PAS_HEXNUMBER 8 #define SCE_PAS_WORD 9 #define SCE_PAS_STRING 10 #define SCE_PAS_STRINGEOL 11 #define SCE_PAS_CHARACTER 12 #define SCE_PAS_OPERATOR 13 #define SCE_PAS_ASM 14 #define SCE_SORCUS_DEFAULT 0 #define SCE_SORCUS_COMMAND 1 #define SCE_SORCUS_PARAMETER 2 #define SCE_SORCUS_COMMENTLINE 3 #define SCE_SORCUS_STRING 4 #define SCE_SORCUS_STRINGEOL 5 #define SCE_SORCUS_IDENTIFIER 6 #define SCE_SORCUS_OPERATOR 7 #define SCE_SORCUS_NUMBER 8 #define SCE_SORCUS_CONSTANT 9 #define SCE_POWERPRO_DEFAULT 0 #define SCE_POWERPRO_COMMENTBLOCK 1 #define SCE_POWERPRO_COMMENTLINE 2 #define SCE_POWERPRO_NUMBER 3 #define SCE_POWERPRO_WORD 4 #define SCE_POWERPRO_WORD2 5 #define SCE_POWERPRO_WORD3 6 #define SCE_POWERPRO_WORD4 7 #define SCE_POWERPRO_DOUBLEQUOTEDSTRING 8 #define SCE_POWERPRO_SINGLEQUOTEDSTRING 9 #define SCE_POWERPRO_LINECONTINUE 10 #define SCE_POWERPRO_OPERATOR 11 #define SCE_POWERPRO_IDENTIFIER 12 #define SCE_POWERPRO_STRINGEOL 13 #define SCE_POWERPRO_VERBATIM 14 #define SCE_POWERPRO_ALTQUOTE 15 #define SCE_POWERPRO_FUNCTION 16 #define SCE_SML_DEFAULT 0 #define SCE_SML_IDENTIFIER 1 #define SCE_SML_TAGNAME 2 #define SCE_SML_KEYWORD 3 #define SCE_SML_KEYWORD2 4 #define SCE_SML_KEYWORD3 5 #define SCE_SML_LINENUM 6 #define SCE_SML_OPERATOR 7 #define SCE_SML_NUMBER 8 #define SCE_SML_CHAR 9 #define SCE_SML_STRING 11 #define SCE_SML_COMMENT 12 #define SCE_SML_COMMENT1 13 #define SCE_SML_COMMENT2 14 #define SCE_SML_COMMENT3 15 #define SCE_MARKDOWN_DEFAULT 0 #define SCE_MARKDOWN_LINE_BEGIN 1 #define SCE_MARKDOWN_STRONG1 2 #define SCE_MARKDOWN_STRONG2 3 #define SCE_MARKDOWN_EM1 4 #define SCE_MARKDOWN_EM2 5 #define SCE_MARKDOWN_HEADER1 6 #define SCE_MARKDOWN_HEADER2 7 #define SCE_MARKDOWN_HEADER3 8 #define SCE_MARKDOWN_HEADER4 9 #define SCE_MARKDOWN_HEADER5 10 #define SCE_MARKDOWN_HEADER6 11 #define SCE_MARKDOWN_PRECHAR 12 #define SCE_MARKDOWN_ULIST_ITEM 13 #define SCE_MARKDOWN_OLIST_ITEM 14 #define SCE_MARKDOWN_BLOCKQUOTE 15 #define SCE_MARKDOWN_STRIKEOUT 16 #define SCE_MARKDOWN_HRULE 17 #define SCE_MARKDOWN_LINK 18 #define SCE_MARKDOWN_CODE 19 #define SCE_MARKDOWN_CODE2 20 #define SCE_MARKDOWN_CODEBK 21 #define SCE_TXT2TAGS_DEFAULT 0 #define SCE_TXT2TAGS_LINE_BEGIN 1 #define SCE_TXT2TAGS_STRONG1 2 #define SCE_TXT2TAGS_STRONG2 3 #define SCE_TXT2TAGS_EM1 4 #define SCE_TXT2TAGS_EM2 5 #define SCE_TXT2TAGS_HEADER1 6 #define SCE_TXT2TAGS_HEADER2 7 #define SCE_TXT2TAGS_HEADER3 8 #define SCE_TXT2TAGS_HEADER4 9 #define SCE_TXT2TAGS_HEADER5 10 #define SCE_TXT2TAGS_HEADER6 11 #define SCE_TXT2TAGS_PRECHAR 12 #define SCE_TXT2TAGS_ULIST_ITEM 13 #define SCE_TXT2TAGS_OLIST_ITEM 14 #define SCE_TXT2TAGS_BLOCKQUOTE 15 #define SCE_TXT2TAGS_STRIKEOUT 16 #define SCE_TXT2TAGS_HRULE 17 #define SCE_TXT2TAGS_LINK 18 #define SCE_TXT2TAGS_CODE 19 #define SCE_TXT2TAGS_CODE2 20 #define SCE_TXT2TAGS_CODEBK 21 #define SCE_TXT2TAGS_COMMENT 22 #define SCE_TXT2TAGS_OPTION 23 #define SCE_TXT2TAGS_PREPROC 24 #define SCE_TXT2TAGS_POSTPROC 25 #define SCE_A68K_DEFAULT 0 #define SCE_A68K_COMMENT 1 #define SCE_A68K_NUMBER_DEC 2 #define SCE_A68K_NUMBER_BIN 3 #define SCE_A68K_NUMBER_HEX 4 #define SCE_A68K_STRING1 5 #define SCE_A68K_OPERATOR 6 #define SCE_A68K_CPUINSTRUCTION 7 #define SCE_A68K_EXTINSTRUCTION 8 #define SCE_A68K_REGISTER 9 #define SCE_A68K_DIRECTIVE 10 #define SCE_A68K_MACRO_ARG 11 #define SCE_A68K_LABEL 12 #define SCE_A68K_STRING2 13 #define SCE_A68K_IDENTIFIER 14 #define SCE_A68K_MACRO_DECLARATION 15 #define SCE_A68K_COMMENT_WORD 16 #define SCE_A68K_COMMENT_SPECIAL 17 #define SCE_A68K_COMMENT_DOXYGEN 18 #define SCE_MODULA_DEFAULT 0 #define SCE_MODULA_COMMENT 1 #define SCE_MODULA_DOXYCOMM 2 #define SCE_MODULA_DOXYKEY 3 #define SCE_MODULA_KEYWORD 4 #define SCE_MODULA_RESERVED 5 #define SCE_MODULA_NUMBER 6 #define SCE_MODULA_BASENUM 7 #define SCE_MODULA_FLOAT 8 #define SCE_MODULA_STRING 9 #define SCE_MODULA_STRSPEC 10 #define SCE_MODULA_CHAR 11 #define SCE_MODULA_CHARSPEC 12 #define SCE_MODULA_PROC 13 #define SCE_MODULA_PRAGMA 14 #define SCE_MODULA_PRGKEY 15 #define SCE_MODULA_OPERATOR 16 #define SCE_MODULA_BADSTR 17 #define SCE_COFFEESCRIPT_DEFAULT 0 #define SCE_COFFEESCRIPT_COMMENT 1 #define SCE_COFFEESCRIPT_COMMENTLINE 2 #define SCE_COFFEESCRIPT_COMMENTDOC 3 #define SCE_COFFEESCRIPT_NUMBER 4 #define SCE_COFFEESCRIPT_WORD 5 #define SCE_COFFEESCRIPT_STRING 6 #define SCE_COFFEESCRIPT_CHARACTER 7 #define SCE_COFFEESCRIPT_UUID 8 #define SCE_COFFEESCRIPT_PREPROCESSOR 9 #define SCE_COFFEESCRIPT_OPERATOR 10 #define SCE_COFFEESCRIPT_IDENTIFIER 11 #define SCE_COFFEESCRIPT_STRINGEOL 12 #define SCE_COFFEESCRIPT_VERBATIM 13 #define SCE_COFFEESCRIPT_REGEX 14 #define SCE_COFFEESCRIPT_COMMENTLINEDOC 15 #define SCE_COFFEESCRIPT_WORD2 16 #define SCE_COFFEESCRIPT_COMMENTDOCKEYWORD 17 #define SCE_COFFEESCRIPT_COMMENTDOCKEYWORDERROR 18 #define SCE_COFFEESCRIPT_GLOBALCLASS 19 #define SCE_COFFEESCRIPT_STRINGRAW 20 #define SCE_COFFEESCRIPT_TRIPLEVERBATIM 21 #define SCE_COFFEESCRIPT_COMMENTBLOCK 22 #define SCE_COFFEESCRIPT_VERBOSE_REGEX 23 #define SCE_COFFEESCRIPT_VERBOSE_REGEX_COMMENT 24 #define SCE_COFFEESCRIPT_INSTANCEPROPERTY 25 #define SCE_AVS_DEFAULT 0 #define SCE_AVS_COMMENTBLOCK 1 #define SCE_AVS_COMMENTBLOCKN 2 #define SCE_AVS_COMMENTLINE 3 #define SCE_AVS_NUMBER 4 #define SCE_AVS_OPERATOR 5 #define SCE_AVS_IDENTIFIER 6 #define SCE_AVS_STRING 7 #define SCE_AVS_TRIPLESTRING 8 #define SCE_AVS_KEYWORD 9 #define SCE_AVS_FILTER 10 #define SCE_AVS_PLUGIN 11 #define SCE_AVS_FUNCTION 12 #define SCE_AVS_CLIPPROP 13 #define SCE_AVS_USERDFN 14 #define SCE_ECL_DEFAULT 0 #define SCE_ECL_COMMENT 1 #define SCE_ECL_COMMENTLINE 2 #define SCE_ECL_NUMBER 3 #define SCE_ECL_STRING 4 #define SCE_ECL_WORD0 5 #define SCE_ECL_OPERATOR 6 #define SCE_ECL_CHARACTER 7 #define SCE_ECL_UUID 8 #define SCE_ECL_PREPROCESSOR 9 #define SCE_ECL_UNKNOWN 10 #define SCE_ECL_IDENTIFIER 11 #define SCE_ECL_STRINGEOL 12 #define SCE_ECL_VERBATIM 13 #define SCE_ECL_REGEX 14 #define SCE_ECL_COMMENTLINEDOC 15 #define SCE_ECL_WORD1 16 #define SCE_ECL_COMMENTDOCKEYWORD 17 #define SCE_ECL_COMMENTDOCKEYWORDERROR 18 #define SCE_ECL_WORD2 19 #define SCE_ECL_WORD3 20 #define SCE_ECL_WORD4 21 #define SCE_ECL_WORD5 22 #define SCE_ECL_COMMENTDOC 23 #define SCE_ECL_ADDED 24 #define SCE_ECL_DELETED 25 #define SCE_ECL_CHANGED 26 #define SCE_ECL_MOVED 27 #define SCE_OSCRIPT_DEFAULT 0 #define SCE_OSCRIPT_LINE_COMMENT 1 #define SCE_OSCRIPT_BLOCK_COMMENT 2 #define SCE_OSCRIPT_DOC_COMMENT 3 #define SCE_OSCRIPT_PREPROCESSOR 4 #define SCE_OSCRIPT_NUMBER 5 #define SCE_OSCRIPT_SINGLEQUOTE_STRING 6 #define SCE_OSCRIPT_DOUBLEQUOTE_STRING 7 #define SCE_OSCRIPT_CONSTANT 8 #define SCE_OSCRIPT_IDENTIFIER 9 #define SCE_OSCRIPT_GLOBAL 10 #define SCE_OSCRIPT_KEYWORD 11 #define SCE_OSCRIPT_OPERATOR 12 #define SCE_OSCRIPT_LABEL 13 #define SCE_OSCRIPT_TYPE 14 #define SCE_OSCRIPT_FUNCTION 15 #define SCE_OSCRIPT_OBJECT 16 #define SCE_OSCRIPT_PROPERTY 17 #define SCE_OSCRIPT_METHOD 18 #define SCE_VISUALPROLOG_DEFAULT 0 #define SCE_VISUALPROLOG_KEY_MAJOR 1 #define SCE_VISUALPROLOG_KEY_MINOR 2 #define SCE_VISUALPROLOG_KEY_DIRECTIVE 3 #define SCE_VISUALPROLOG_COMMENT_BLOCK 4 #define SCE_VISUALPROLOG_COMMENT_LINE 5 #define SCE_VISUALPROLOG_COMMENT_KEY 6 #define SCE_VISUALPROLOG_COMMENT_KEY_ERROR 7 #define SCE_VISUALPROLOG_IDENTIFIER 8 #define SCE_VISUALPROLOG_VARIABLE 9 #define SCE_VISUALPROLOG_ANONYMOUS 10 #define SCE_VISUALPROLOG_NUMBER 11 #define SCE_VISUALPROLOG_OPERATOR 12 #define SCE_VISUALPROLOG_UNUSED1 13 #define SCE_VISUALPROLOG_UNUSED2 14 #define SCE_VISUALPROLOG_UNUSED3 15 #define SCE_VISUALPROLOG_STRING_QUOTE 16 #define SCE_VISUALPROLOG_STRING_ESCAPE 17 #define SCE_VISUALPROLOG_STRING_ESCAPE_ERROR 18 #define SCE_VISUALPROLOG_UNUSED4 19 #define SCE_VISUALPROLOG_STRING 20 #define SCE_VISUALPROLOG_UNUSED5 21 #define SCE_VISUALPROLOG_STRING_EOL 22 #define SCE_VISUALPROLOG_EMBEDDED 23 #define SCE_VISUALPROLOG_PLACEHOLDER 24 #define SCE_STTXT_DEFAULT 0 #define SCE_STTXT_COMMENT 1 #define SCE_STTXT_COMMENTLINE 2 #define SCE_STTXT_KEYWORD 3 #define SCE_STTXT_TYPE 4 #define SCE_STTXT_FUNCTION 5 #define SCE_STTXT_FB 6 #define SCE_STTXT_NUMBER 7 #define SCE_STTXT_HEXNUMBER 8 #define SCE_STTXT_PRAGMA 9 #define SCE_STTXT_OPERATOR 10 #define SCE_STTXT_CHARACTER 11 #define SCE_STTXT_STRING1 12 #define SCE_STTXT_STRING2 13 #define SCE_STTXT_STRINGEOL 14 #define SCE_STTXT_IDENTIFIER 15 #define SCE_STTXT_DATETIME 16 #define SCE_STTXT_VARS 17 #define SCE_STTXT_PRAGMAS 18 #define SCE_KVIRC_DEFAULT 0 #define SCE_KVIRC_COMMENT 1 #define SCE_KVIRC_COMMENTBLOCK 2 #define SCE_KVIRC_STRING 3 #define SCE_KVIRC_WORD 4 #define SCE_KVIRC_KEYWORD 5 #define SCE_KVIRC_FUNCTION_KEYWORD 6 #define SCE_KVIRC_FUNCTION 7 #define SCE_KVIRC_VARIABLE 8 #define SCE_KVIRC_NUMBER 9 #define SCE_KVIRC_OPERATOR 10 #define SCE_KVIRC_STRING_FUNCTION 11 #define SCE_KVIRC_STRING_VARIABLE 12 #define SCE_RUST_DEFAULT 0 #define SCE_RUST_COMMENTBLOCK 1 #define SCE_RUST_COMMENTLINE 2 #define SCE_RUST_COMMENTBLOCKDOC 3 #define SCE_RUST_COMMENTLINEDOC 4 #define SCE_RUST_NUMBER 5 #define SCE_RUST_WORD 6 #define SCE_RUST_WORD2 7 #define SCE_RUST_WORD3 8 #define SCE_RUST_WORD4 9 #define SCE_RUST_WORD5 10 #define SCE_RUST_WORD6 11 #define SCE_RUST_WORD7 12 #define SCE_RUST_STRING 13 #define SCE_RUST_STRINGR 14 #define SCE_RUST_CHARACTER 15 #define SCE_RUST_OPERATOR 16 #define SCE_RUST_IDENTIFIER 17 #define SCE_RUST_LIFETIME 18 #define SCE_RUST_MACRO 19 #define SCE_RUST_LEXERROR 20 #define SCE_RUST_BYTESTRING 21 #define SCE_RUST_BYTESTRINGR 22 #define SCE_RUST_BYTECHARACTER 23 #define SCE_DMAP_DEFAULT 0 #define SCE_DMAP_COMMENT 1 #define SCE_DMAP_NUMBER 2 #define SCE_DMAP_STRING1 3 #define SCE_DMAP_STRING2 4 #define SCE_DMAP_STRINGEOL 5 #define SCE_DMAP_OPERATOR 6 #define SCE_DMAP_IDENTIFIER 7 #define SCE_DMAP_WORD 8 #define SCE_DMAP_WORD2 9 #define SCE_DMAP_WORD3 10 #define SCE_DMIS_DEFAULT 0 #define SCE_DMIS_COMMENT 1 #define SCE_DMIS_STRING 2 #define SCE_DMIS_NUMBER 3 #define SCE_DMIS_KEYWORD 4 #define SCE_DMIS_MAJORWORD 5 #define SCE_DMIS_MINORWORD 6 #define SCE_DMIS_UNSUPPORTED_MAJOR 7 #define SCE_DMIS_UNSUPPORTED_MINOR 8 #define SCE_DMIS_LABEL 9 #define SCE_REG_DEFAULT 0 #define SCE_REG_COMMENT 1 #define SCE_REG_VALUENAME 2 #define SCE_REG_STRING 3 #define SCE_REG_HEXDIGIT 4 #define SCE_REG_VALUETYPE 5 #define SCE_REG_ADDEDKEY 6 #define SCE_REG_DELETEDKEY 7 #define SCE_REG_ESCAPED 8 #define SCE_REG_KEYPATH_GUID 9 #define SCE_REG_STRING_GUID 10 #define SCE_REG_PARAMETER 11 #define SCE_REG_OPERATOR 12 #define SCE_BIBTEX_DEFAULT 0 #define SCE_BIBTEX_ENTRY 1 #define SCE_BIBTEX_UNKNOWN_ENTRY 2 #define SCE_BIBTEX_KEY 3 #define SCE_BIBTEX_PARAMETER 4 #define SCE_BIBTEX_VALUE 5 #define SCE_BIBTEX_COMMENT 6 #define SCE_HEX_DEFAULT 0 #define SCE_HEX_RECSTART 1 #define SCE_HEX_RECTYPE 2 #define SCE_HEX_RECTYPE_UNKNOWN 3 #define SCE_HEX_BYTECOUNT 4 #define SCE_HEX_BYTECOUNT_WRONG 5 #define SCE_HEX_NOADDRESS 6 #define SCE_HEX_DATAADDRESS 7 #define SCE_HEX_RECCOUNT 8 #define SCE_HEX_STARTADDRESS 9 #define SCE_HEX_ADDRESSFIELD_UNKNOWN 10 #define SCE_HEX_EXTENDEDADDRESS 11 #define SCE_HEX_DATA_ODD 12 #define SCE_HEX_DATA_EVEN 13 #define SCE_HEX_DATA_UNKNOWN 14 #define SCE_HEX_DATA_EMPTY 15 #define SCE_HEX_CHECKSUM 16 #define SCE_HEX_CHECKSUM_WRONG 17 #define SCE_HEX_GARBAGE 18 #define SCE_JSON_DEFAULT 0 #define SCE_JSON_NUMBER 1 #define SCE_JSON_STRING 2 #define SCE_JSON_STRINGEOL 3 #define SCE_JSON_PROPERTYNAME 4 #define SCE_JSON_ESCAPESEQUENCE 5 #define SCE_JSON_LINECOMMENT 6 #define SCE_JSON_BLOCKCOMMENT 7 #define SCE_JSON_OPERATOR 8 #define SCE_JSON_URI 9 #define SCE_JSON_COMPACTIRI 10 #define SCE_JSON_KEYWORD 11 #define SCE_JSON_LDKEYWORD 12 #define SCE_JSON_ERROR 13 #define SCE_EDI_DEFAULT 0 #define SCE_EDI_SEGMENTSTART 1 #define SCE_EDI_SEGMENTEND 2 #define SCE_EDI_SEP_ELEMENT 3 #define SCE_EDI_SEP_COMPOSITE 4 #define SCE_EDI_SEP_RELEASE 5 #define SCE_EDI_UNA 6 #define SCE_EDI_UNH 7 #define SCE_EDI_BADSEGMENT 8 #define SCE_STATA_DEFAULT 0 #define SCE_STATA_COMMENT 1 #define SCE_STATA_COMMENTLINE 2 #define SCE_STATA_COMMENTBLOCK 3 #define SCE_STATA_NUMBER 4 #define SCE_STATA_OPERATOR 5 #define SCE_STATA_IDENTIFIER 6 #define SCE_STATA_STRING 7 #define SCE_STATA_TYPE 8 #define SCE_STATA_WORD 9 #define SCE_STATA_GLOBAL_MACRO 10 #define SCE_STATA_MACRO 11 #define SCE_SAS_DEFAULT 0 #define SCE_SAS_COMMENT 1 #define SCE_SAS_COMMENTLINE 2 #define SCE_SAS_COMMENTBLOCK 3 #define SCE_SAS_NUMBER 4 #define SCE_SAS_OPERATOR 5 #define SCE_SAS_IDENTIFIER 6 #define SCE_SAS_STRING 7 #define SCE_SAS_TYPE 8 #define SCE_SAS_WORD 9 #define SCE_SAS_GLOBAL_MACRO 10 #define SCE_SAS_MACRO 11 #define SCE_SAS_MACRO_KEYWORD 12 #define SCE_SAS_BLOCK_KEYWORD 13 #define SCE_SAS_MACRO_FUNCTION 14 #define SCE_SAS_STATEMENT 15 #define SCE_NIM_DEFAULT 0 #define SCE_NIM_COMMENT 1 #define SCE_NIM_COMMENTDOC 2 #define SCE_NIM_COMMENTLINE 3 #define SCE_NIM_COMMENTLINEDOC 4 #define SCE_NIM_NUMBER 5 #define SCE_NIM_STRING 6 #define SCE_NIM_CHARACTER 7 #define SCE_NIM_WORD 8 #define SCE_NIM_TRIPLE 9 #define SCE_NIM_TRIPLEDOUBLE 10 #define SCE_NIM_BACKTICKS 11 #define SCE_NIM_FUNCNAME 12 #define SCE_NIM_STRINGEOL 13 #define SCE_NIM_NUMERROR 14 #define SCE_NIM_OPERATOR 15 #define SCE_NIM_IDENTIFIER 16 #define SCE_CIL_DEFAULT 0 #define SCE_CIL_COMMENT 1 #define SCE_CIL_COMMENTLINE 2 #define SCE_CIL_WORD 3 #define SCE_CIL_WORD2 4 #define SCE_CIL_WORD3 5 #define SCE_CIL_STRING 6 #define SCE_CIL_LABEL 7 #define SCE_CIL_OPERATOR 8 #define SCE_CIL_IDENTIFIER 9 #define SCE_CIL_STRINGEOL 10 #define SCE_X12_DEFAULT 0 #define SCE_X12_BAD 1 #define SCE_X12_ENVELOPE 2 #define SCE_X12_FUNCTIONGROUP 3 #define SCE_X12_TRANSACTIONSET 4 #define SCE_X12_SEGMENTHEADER 5 #define SCE_X12_SEGMENTEND 6 #define SCE_X12_SEP_ELEMENT 7 #define SCE_X12_SEP_SUBELEMENT 8 #define SCE_DF_DEFAULT 0 #define SCE_DF_IDENTIFIER 1 #define SCE_DF_METATAG 2 #define SCE_DF_IMAGE 3 #define SCE_DF_COMMENTLINE 4 #define SCE_DF_PREPROCESSOR 5 #define SCE_DF_PREPROCESSOR2 6 #define SCE_DF_NUMBER 7 #define SCE_DF_HEXNUMBER 8 #define SCE_DF_WORD 9 #define SCE_DF_STRING 10 #define SCE_DF_STRINGEOL 11 #define SCE_DF_SCOPEWORD 12 #define SCE_DF_OPERATOR 13 #define SCE_DF_ICODE 14 #define SCE_HOLLYWOOD_DEFAULT 0 #define SCE_HOLLYWOOD_COMMENT 1 #define SCE_HOLLYWOOD_COMMENTBLOCK 2 #define SCE_HOLLYWOOD_NUMBER 3 #define SCE_HOLLYWOOD_KEYWORD 4 #define SCE_HOLLYWOOD_STDAPI 5 #define SCE_HOLLYWOOD_PLUGINAPI 6 #define SCE_HOLLYWOOD_PLUGINMETHOD 7 #define SCE_HOLLYWOOD_STRING 8 #define SCE_HOLLYWOOD_STRINGBLOCK 9 #define SCE_HOLLYWOOD_PREPROCESSOR 10 #define SCE_HOLLYWOOD_OPERATOR 11 #define SCE_HOLLYWOOD_IDENTIFIER 12 #define SCE_HOLLYWOOD_CONSTANT 13 #define SCE_HOLLYWOOD_HEXNUMBER 14 #define SCE_RAKU_DEFAULT 0 #define SCE_RAKU_ERROR 1 #define SCE_RAKU_COMMENTLINE 2 #define SCE_RAKU_COMMENTEMBED 3 #define SCE_RAKU_POD 4 #define SCE_RAKU_CHARACTER 5 #define SCE_RAKU_HEREDOC_Q 6 #define SCE_RAKU_HEREDOC_QQ 7 #define SCE_RAKU_STRING 8 #define SCE_RAKU_STRING_Q 9 #define SCE_RAKU_STRING_QQ 10 #define SCE_RAKU_STRING_Q_LANG 11 #define SCE_RAKU_STRING_VAR 12 #define SCE_RAKU_REGEX 13 #define SCE_RAKU_REGEX_VAR 14 #define SCE_RAKU_ADVERB 15 #define SCE_RAKU_NUMBER 16 #define SCE_RAKU_PREPROCESSOR 17 #define SCE_RAKU_OPERATOR 18 #define SCE_RAKU_WORD 19 #define SCE_RAKU_FUNCTION 20 #define SCE_RAKU_IDENTIFIER 21 #define SCE_RAKU_TYPEDEF 22 #define SCE_RAKU_MU 23 #define SCE_RAKU_POSITIONAL 24 #define SCE_RAKU_ASSOCIATIVE 25 #define SCE_RAKU_CALLABLE 26 #define SCE_RAKU_GRAMMAR 27 #define SCE_RAKU_CLASS 28 #define SCE_FSHARP_DEFAULT 0 #define SCE_FSHARP_KEYWORD 1 #define SCE_FSHARP_KEYWORD2 2 #define SCE_FSHARP_KEYWORD3 3 #define SCE_FSHARP_KEYWORD4 4 #define SCE_FSHARP_KEYWORD5 5 #define SCE_FSHARP_IDENTIFIER 6 #define SCE_FSHARP_QUOT_IDENTIFIER 7 #define SCE_FSHARP_COMMENT 8 #define SCE_FSHARP_COMMENTLINE 9 #define SCE_FSHARP_PREPROCESSOR 10 #define SCE_FSHARP_LINENUM 11 #define SCE_FSHARP_OPERATOR 12 #define SCE_FSHARP_NUMBER 13 #define SCE_FSHARP_CHARACTER 14 #define SCE_FSHARP_STRING 15 #define SCE_FSHARP_VERBATIM 16 #define SCE_FSHARP_QUOTATION 17 #define SCE_FSHARP_ATTRIBUTE 18 #define SCE_FSHARP_FORMAT_SPEC 19 #define SCE_ASCIIDOC_DEFAULT 0 #define SCE_ASCIIDOC_STRONG1 1 #define SCE_ASCIIDOC_STRONG2 2 #define SCE_ASCIIDOC_EM1 3 #define SCE_ASCIIDOC_EM2 4 #define SCE_ASCIIDOC_HEADER1 5 #define SCE_ASCIIDOC_HEADER2 6 #define SCE_ASCIIDOC_HEADER3 7 #define SCE_ASCIIDOC_HEADER4 8 #define SCE_ASCIIDOC_HEADER5 9 #define SCE_ASCIIDOC_HEADER6 10 #define SCE_ASCIIDOC_ULIST_ITEM 11 #define SCE_ASCIIDOC_OLIST_ITEM 12 #define SCE_ASCIIDOC_BLOCKQUOTE 13 #define SCE_ASCIIDOC_LINK 14 #define SCE_ASCIIDOC_CODEBK 15 #define SCE_ASCIIDOC_PASSBK 16 #define SCE_ASCIIDOC_COMMENT 17 #define SCE_ASCIIDOC_COMMENTBK 18 #define SCE_ASCIIDOC_LITERAL 19 #define SCE_ASCIIDOC_LITERALBK 20 #define SCE_ASCIIDOC_ATTRIB 21 #define SCE_ASCIIDOC_ATTRIBVAL 22 #define SCE_ASCIIDOC_MACRO 23 #define SCE_GD_DEFAULT 0 #define SCE_GD_COMMENTLINE 1 #define SCE_GD_NUMBER 2 #define SCE_GD_STRING 3 #define SCE_GD_CHARACTER 4 #define SCE_GD_WORD 5 #define SCE_GD_TRIPLE 6 #define SCE_GD_TRIPLEDOUBLE 7 #define SCE_GD_CLASSNAME 8 #define SCE_GD_FUNCNAME 9 #define SCE_GD_OPERATOR 10 #define SCE_GD_IDENTIFIER 11 #define SCE_GD_COMMENTBLOCK 12 #define SCE_GD_STRINGEOL 13 #define SCE_GD_WORD2 14 #define SCE_GD_ANNOTATION 15 #define SCE_GD_NODEPATH 16 /* --Autogenerated -- end of section automatically generated from Scintilla.iface */ #endif lexilla/lexers/0000775000175000017500000000000014647367374012501 5ustar neilneillexilla/lexers/LexVB.cxx0000664000175000017500000002374614647367374014221 0ustar neilneil// Scintilla source code edit control /** @file LexVB.cxx ** Lexer for Visual Basic and VBScript. **/ // Copyright 1998-2005 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; namespace { // Internal state, highlighted as number constexpr int SCE_B_FILENUMBER = SCE_B_DEFAULT + 100; bool IsVBComment(Accessor &styler, Sci_Position pos, Sci_Position len) { return len > 0 && styler[pos] == '\''; } constexpr bool IsTypeCharacter(int ch) noexcept { return ch == '%' || ch == '&' || ch == '@' || ch == '!' || ch == '#' || ch == '$'; } // Extended to accept accented characters bool IsAWordChar(int ch) noexcept { return ch >= 0x80 || (isalnum(ch) || ch == '.' || ch == '_'); } bool IsAWordStart(int ch) noexcept { return ch >= 0x80 || (isalpha(ch) || ch == '_'); } bool IsANumberChar(int ch) noexcept { // Not exactly following number definition (several dots are seen as OK, etc.) // but probably enough in most cases. return (ch < 0x80) && (isdigit(ch) || toupper(ch) == 'E' || ch == '.' || ch == '-' || ch == '+' || ch == '_'); } void ColouriseVBDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler, bool vbScriptSyntax) { const WordList &keywords = *keywordlists[0]; const WordList &keywords2 = *keywordlists[1]; const WordList &keywords3 = *keywordlists[2]; const WordList &keywords4 = *keywordlists[3]; styler.StartAt(startPos); int visibleChars = 0; int fileNbDigits = 0; // property lexer.vb.strings.multiline // Set to 1 to allow strings to continue over line ends. const bool allowMultilineStr = styler.GetPropertyInt("lexer.vb.strings.multiline", 0) != 0; // Do not leak onto next line if (initStyle == SCE_B_STRINGEOL || initStyle == SCE_B_COMMENT || initStyle == SCE_B_PREPROCESSOR) { initStyle = SCE_B_DEFAULT; } StyleContext sc(startPos, length, initStyle, styler); for (; sc.More(); sc.Forward()) { if (sc.state == SCE_B_OPERATOR) { sc.SetState(SCE_B_DEFAULT); } else if (sc.state == SCE_B_IDENTIFIER) { if (!IsAWordChar(sc.ch)) { // In Basic (except VBScript), a variable name or a function name // can end with a special character indicating the type of the value // held or returned. bool skipType = false; if (!vbScriptSyntax && IsTypeCharacter(sc.ch)) { sc.Forward(); // Skip it skipType = true; } if (sc.ch == ']') { sc.Forward(); } char s[100]; sc.GetCurrentLowered(s, sizeof(s)); if (skipType) { s[strlen(s) - 1] = '\0'; } if (strcmp(s, "rem") == 0) { sc.ChangeState(SCE_B_COMMENT); } else { if (keywords.InList(s)) { sc.ChangeState(SCE_B_KEYWORD); } else if (keywords2.InList(s)) { sc.ChangeState(SCE_B_KEYWORD2); } else if (keywords3.InList(s)) { sc.ChangeState(SCE_B_KEYWORD3); } else if (keywords4.InList(s)) { sc.ChangeState(SCE_B_KEYWORD4); } // Else, it is really an identifier... sc.SetState(SCE_B_DEFAULT); } } } else if (sc.state == SCE_B_NUMBER) { // We stop the number definition on non-numerical non-dot non-eE non-sign char // Also accepts A-F for hex. numbers if (!IsANumberChar(sc.ch) && !(tolower(sc.ch) >= 'a' && tolower(sc.ch) <= 'f')) { sc.SetState(SCE_B_DEFAULT); } } else if (sc.state == SCE_B_STRING) { // VB doubles quotes to preserve them, so just end this string // state now as a following quote will start again if (sc.ch == '\"') { if (sc.chNext == '\"') { sc.Forward(); } else { if (tolower(sc.chNext) == 'c') { sc.Forward(); } sc.ForwardSetState(SCE_B_DEFAULT); } } else if (sc.atLineEnd && !allowMultilineStr) { visibleChars = 0; sc.ChangeState(SCE_B_STRINGEOL); sc.ForwardSetState(SCE_B_DEFAULT); } } else if (sc.state == SCE_B_COMMENT) { if (sc.atLineEnd) { visibleChars = 0; sc.ForwardSetState(SCE_B_DEFAULT); } } else if (sc.state == SCE_B_PREPROCESSOR) { if (sc.atLineEnd) { visibleChars = 0; sc.ForwardSetState(SCE_B_DEFAULT); } } else if (sc.state == SCE_B_FILENUMBER) { if (IsADigit(sc.ch)) { fileNbDigits++; if (fileNbDigits > 3) { sc.ChangeState(SCE_B_DATE); } } else if (sc.ch == '\r' || sc.ch == '\n' || sc.ch == ',') { // Regular uses: Close #1; Put #1, ...; Get #1, ... etc. // Too bad if date is format #27, Oct, 2003# or something like that... // Use regular number state sc.ChangeState(SCE_B_NUMBER); sc.SetState(SCE_B_DEFAULT); } else if (sc.ch == '#') { sc.ChangeState(SCE_B_DATE); sc.ForwardSetState(SCE_B_DEFAULT); } else { sc.ChangeState(SCE_B_DATE); } if (sc.state != SCE_B_FILENUMBER) { fileNbDigits = 0; } } else if (sc.state == SCE_B_DATE) { if (sc.atLineEnd) { visibleChars = 0; sc.ChangeState(SCE_B_STRINGEOL); sc.ForwardSetState(SCE_B_DEFAULT); } else if (sc.ch == '#') { sc.ForwardSetState(SCE_B_DEFAULT); } } if (sc.state == SCE_B_DEFAULT) { if (sc.ch == '\'') { sc.SetState(SCE_B_COMMENT); } else if (sc.ch == '\"') { sc.SetState(SCE_B_STRING); } else if (sc.ch == '#' && visibleChars == 0) { // Preprocessor commands are alone on their line sc.SetState(SCE_B_PREPROCESSOR); } else if (sc.ch == '#') { // It can be a date literal, ending with #, or a file number, from 1 to 511 // The date literal depends on the locale, so anything can go between #'s. // Can be #January 1, 1993# or #1 Jan 93# or #05/11/2003#, etc. // So we set the FILENUMBER state, and switch to DATE if it isn't a file number sc.SetState(SCE_B_FILENUMBER); } else if (sc.ch == '&' && tolower(sc.chNext) == 'h') { // Hexadecimal number sc.SetState(SCE_B_NUMBER); sc.Forward(); } else if (sc.ch == '&' && tolower(sc.chNext) == 'o') { // Octal number sc.SetState(SCE_B_NUMBER); sc.Forward(); } else if (sc.ch == '&' && tolower(sc.chNext) == 'b') { // Binary number sc.SetState(SCE_B_NUMBER); sc.Forward(); } else if (IsADigit(sc.ch) || (sc.ch == '.' && IsADigit(sc.chNext))) { sc.SetState(SCE_B_NUMBER); } else if (IsAWordStart(sc.ch) || (sc.ch == '[')) { sc.SetState(SCE_B_IDENTIFIER); } else if (isoperator(sc.ch) || (sc.ch == '\\')) { // Integer division sc.SetState(SCE_B_OPERATOR); } } if (sc.atLineEnd) { visibleChars = 0; } if (!IsASpace(sc.ch)) { visibleChars++; } } if (sc.state == SCE_B_IDENTIFIER && !IsAWordChar(sc.ch)) { // In Basic (except VBScript), a variable name or a function name // can end with a special character indicating the type of the value // held or returned. bool skipType = false; if (!vbScriptSyntax && IsTypeCharacter(sc.ch)) { sc.Forward(); // Skip it skipType = true; } if (sc.ch == ']') { sc.Forward(); } char s[100]; sc.GetCurrentLowered(s, sizeof(s)); if (skipType) { s[strlen(s) - 1] = '\0'; } if (strcmp(s, "rem") == 0) { sc.ChangeState(SCE_B_COMMENT); } else { if (keywords.InList(s)) { sc.ChangeState(SCE_B_KEYWORD); } else if (keywords2.InList(s)) { sc.ChangeState(SCE_B_KEYWORD2); } else if (keywords3.InList(s)) { sc.ChangeState(SCE_B_KEYWORD3); } else if (keywords4.InList(s)) { sc.ChangeState(SCE_B_KEYWORD4); } // Else, it is really an identifier... sc.SetState(SCE_B_DEFAULT); } } sc.Complete(); } void FoldVBDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { const Sci_Position endPos = startPos + length; // Backtrack to previous line in case need to fix its fold status Sci_Position lineCurrent = styler.GetLine(startPos); if (startPos > 0) { if (lineCurrent > 0) { lineCurrent--; startPos = styler.LineStart(lineCurrent); } } int spaceFlags = 0; int indentCurrent = styler.IndentAmount(lineCurrent, &spaceFlags, IsVBComment); char chNext = styler[startPos]; for (Sci_Position i = startPos; i < endPos; i++) { const char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); if ((ch == '\r' && chNext != '\n') || (ch == '\n') || (i == endPos)) { int lev = indentCurrent; const int indentNext = styler.IndentAmount(lineCurrent + 1, &spaceFlags, IsVBComment); if (!(indentCurrent & SC_FOLDLEVELWHITEFLAG)) { // Only non whitespace lines can be headers if ((indentCurrent & SC_FOLDLEVELNUMBERMASK) < (indentNext & SC_FOLDLEVELNUMBERMASK)) { lev |= SC_FOLDLEVELHEADERFLAG; } else if (indentNext & SC_FOLDLEVELWHITEFLAG) { // Line after is blank so check the next - maybe should continue further? int spaceFlags2 = 0; const int indentNext2 = styler.IndentAmount(lineCurrent + 2, &spaceFlags2, IsVBComment); if ((indentCurrent & SC_FOLDLEVELNUMBERMASK) < (indentNext2 & SC_FOLDLEVELNUMBERMASK)) { lev |= SC_FOLDLEVELHEADERFLAG; } } } indentCurrent = indentNext; styler.SetLevel(lineCurrent, lev); lineCurrent++; } } } void ColouriseVBNetDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { ColouriseVBDoc(startPos, length, initStyle, keywordlists, styler, false); } void ColouriseVBScriptDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { ColouriseVBDoc(startPos, length, initStyle, keywordlists, styler, true); } const char * const vbWordListDesc[] = { "Keywords", "user1", "user2", "user3", nullptr }; } LexerModule lmVB(SCLEX_VB, ColouriseVBNetDoc, "vb", FoldVBDoc, vbWordListDesc); LexerModule lmVBScript(SCLEX_VBSCRIPT, ColouriseVBScriptDoc, "vbscript", FoldVBDoc, vbWordListDesc); lexilla/lexers/LexPerl.cxx0000664000175000017500000017247214647367374014615 0ustar neilneil// Scintilla source code edit control /** @file LexPerl.cxx ** Lexer for Perl. ** Converted to lexer object by "Udo Lechner" **/ // Copyright 1998-2008 by Neil Hodgson // Lexical analysis fixes by Kein-Hong Man // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" #include "OptionSet.h" #include "DefaultLexer.h" using namespace Scintilla; using namespace Lexilla; namespace { // Info for HERE document handling from perldata.pod (reformatted): // ---------------------------------------------------------------- // A line-oriented form of quoting is based on the shell ``here-doc'' syntax. // Following a << you specify a string to terminate the quoted material, and // all lines following the current line down to the terminating string are // the value of the item. // Prefixing the terminating string with a "~" specifies that you want to // use "Indented Here-docs" (see below). // * The terminating string may be either an identifier (a word), or some // quoted text. // * If quoted, the type of quotes you use determines the treatment of the // text, just as in regular quoting. // * An unquoted identifier works like double quotes. // * There must be no space between the << and the identifier. // (If you put a space it will be treated as a null identifier, // which is valid, and matches the first empty line.) // (This is deprecated, -w warns of this syntax) // * The terminating string must appear by itself (unquoted and // with no surrounding whitespace) on the terminating line. // // Indented Here-docs // ------------------ // The here-doc modifier "~" allows you to indent your here-docs to // make the code more readable. // The delimiter is used to determine the exact whitespace to remove // from the beginning of each line. All lines must have at least the // same starting whitespace (except lines only containing a newline) // or perl will croak. Tabs and spaces can be mixed, but are matched // exactly. One tab will not be equal to 8 spaces! // Additional beginning whitespace (beyond what preceded the // delimiter) will be preserved. #define HERE_DELIM_MAX 256 // maximum length of HERE doc delimiter #define PERLNUM_BINARY 1 // order is significant: 1-3 cannot have a dot #define PERLNUM_OCTAL 2 #define PERLNUM_FLOAT_EXP 3 // exponent part only #define PERLNUM_HEX 4 // may be a hex float #define PERLNUM_DECIMAL 5 // 1-5 are numbers; 6-7 are strings #define PERLNUM_VECTOR 6 #define PERLNUM_V_VECTOR 7 #define PERLNUM_BAD 8 #define BACK_NONE 0 // lookback state for bareword disambiguation: #define BACK_OPERATOR 1 // whitespace/comments are insignificant #define BACK_KEYWORD 2 // operators/keywords are needed for disambiguation #define SUB_BEGIN 0 // states for subroutine prototype scan: #define SUB_HAS_PROTO 1 // only 'prototype' attribute allows prototypes #define SUB_HAS_ATTRIB 2 // other attributes can exist leftward #define SUB_HAS_MODULE 3 // sub name can have a ::identifier part #define SUB_HAS_SUB 4 // 'sub' keyword // all interpolated styles are different from their parent styles by a constant difference // we also assume SCE_PL_STRING_VAR is the interpolated style with the smallest value #define INTERPOLATE_SHIFT (SCE_PL_STRING_VAR - SCE_PL_STRING) bool isPerlKeyword(Sci_PositionU start, Sci_PositionU end, WordList &keywords, LexAccessor &styler) { // old-style keyword matcher; needed because GetCurrent() needs // current segment to be committed, but we may abandon early... char s[100]; Sci_PositionU i, len = end - start; if (len > 30) { len = 30; } for (i = 0; i < len; i++, start++) s[i] = styler[start]; s[i] = '\0'; return keywords.InList(s); } int disambiguateBareword(LexAccessor &styler, Sci_PositionU bk, Sci_PositionU fw, int backFlag, Sci_PositionU backPos, Sci_PositionU endPos) { // identifiers are recognized by Perl as barewords under some // conditions, the following attempts to do the disambiguation // by looking backward and forward; result in 2 LSB int result = 0; bool moreback = false; // true if passed newline/comments bool brace = false; // true if opening brace found // if BACK_NONE, neither operator nor keyword, so skip test if (backFlag == BACK_NONE) return result; // first look backwards past whitespace/comments to set EOL flag // (some disambiguation patterns must be on a single line) if (backPos <= static_cast(styler.LineStart(styler.GetLine(bk)))) moreback = true; // look backwards at last significant lexed item for disambiguation bk = backPos - 1; int ch = static_cast(styler.SafeGetCharAt(bk)); if (ch == '{' && !moreback) { // {bareword: possible variable spec brace = true; } else if ((ch == '&' && styler.SafeGetCharAt(bk - 1) != '&') // &bareword: subroutine call || styler.Match(bk - 1, "->") // ->bareword: part of variable spec || styler.Match(bk - 1, "::") // ::bareword: part of module spec || styler.Match(bk - 2, "sub")) { // sub bareword: subroutine declaration // (implied BACK_KEYWORD, no keywords end in 'sub'!) result |= 1; } // next, scan forward after word past tab/spaces only; // if ch isn't one of '[{(,' we can skip the test if ((ch == '{' || ch == '(' || ch == '['|| ch == ',') && fw < endPos) { while (IsASpaceOrTab(ch = static_cast(styler.SafeGetCharAt(fw))) && fw < endPos) { fw++; } if ((ch == '}' && brace) // {bareword}: variable spec || styler.Match(fw, "=>")) { // [{(, bareword=>: hash literal result |= 2; } } return result; } void skipWhitespaceComment(LexAccessor &styler, Sci_PositionU &p) { // when backtracking, we need to skip whitespace and comments while (p > 0) { const int style = styler.StyleAt(p); if (style != SCE_PL_DEFAULT && style != SCE_PL_COMMENTLINE) break; p--; } } int findPrevLexeme(LexAccessor &styler, Sci_PositionU &bk, int &style) { // scan backward past whitespace and comments to find a lexeme skipWhitespaceComment(styler, bk); if (bk == 0) return 0; int sz = 1; style = styler.StyleAt(bk); while (bk > 0) { // find extent of lexeme if (styler.StyleAt(bk - 1) == style) { bk--; sz++; } else break; } return sz; } int styleBeforeBracePair(LexAccessor &styler, Sci_PositionU bk) { // backtrack to find open '{' corresponding to a '}', balanced // return significant style to be tested for '/' disambiguation int braceCount = 1; if (bk == 0) return SCE_PL_DEFAULT; while (--bk > 0) { if (styler.StyleAt(bk) == SCE_PL_OPERATOR) { int bkch = static_cast(styler.SafeGetCharAt(bk)); if (bkch == ';') { // early out break; } else if (bkch == '}') { braceCount++; } else if (bkch == '{') { if (--braceCount == 0) break; } } } if (bk > 0 && braceCount == 0) { // balanced { found, bk > 0, skip more whitespace/comments bk--; skipWhitespaceComment(styler, bk); return styler.StyleAt(bk); } return SCE_PL_DEFAULT; } int styleCheckIdentifier(LexAccessor &styler, Sci_PositionU bk) { // backtrack to classify sub-styles of identifier under test // return sub-style to be tested for '/' disambiguation if (styler.SafeGetCharAt(bk) == '>') // inputsymbol, like return 1; // backtrack to check for possible "->" or "::" before identifier while (bk > 0 && styler.StyleAt(bk) == SCE_PL_IDENTIFIER) { bk--; } while (bk > 0) { int bkstyle = styler.StyleAt(bk); if (bkstyle == SCE_PL_DEFAULT || bkstyle == SCE_PL_COMMENTLINE) { // skip whitespace, comments } else if (bkstyle == SCE_PL_OPERATOR) { // test for "->" and "::" if (styler.Match(bk - 1, "->") || styler.Match(bk - 1, "::")) return 2; } else return 3; // bare identifier bk--; } return 0; } int podLineScan(LexAccessor &styler, Sci_PositionU &pos, Sci_PositionU endPos) { // forward scan the current line to classify line for POD style int state = -1; while (pos < endPos) { int ch = static_cast(styler.SafeGetCharAt(pos)); if (ch == '\n' || ch == '\r') { if (ch == '\r' && styler.SafeGetCharAt(pos + 1) == '\n') pos++; break; } if (IsASpaceOrTab(ch)) { // whitespace, take note if (state == -1) state = SCE_PL_DEFAULT; } else if (state == SCE_PL_DEFAULT) { // verbatim POD line state = SCE_PL_POD_VERB; } else if (state != SCE_PL_POD_VERB) { // regular POD line state = SCE_PL_POD; } pos++; } if (state == -1) state = SCE_PL_DEFAULT; return state; } bool styleCheckSubPrototype(LexAccessor &styler, Sci_PositionU bk) { // backtrack to identify if we're starting a subroutine prototype // we also need to ignore whitespace/comments, format is like: // sub abc::pqr :const :prototype(...) // lexemes are tested in pairs, e.g. '::'+'pqr', ':'+'const', etc. // and a state machine generates legal subroutine syntax matches styler.Flush(); int state = SUB_BEGIN; do { // find two lexemes, lexeme 2 follows lexeme 1 int style2 = SCE_PL_DEFAULT; Sci_PositionU pos2 = bk; int len2 = findPrevLexeme(styler, pos2, style2); int style1 = SCE_PL_DEFAULT; Sci_PositionU pos1 = pos2; if (pos1 > 0) pos1--; int len1 = findPrevLexeme(styler, pos1, style1); if (len1 == 0 || len2 == 0) // lexeme pair must exist break; // match parts of syntax, if invalid subroutine syntax, break off if (style1 == SCE_PL_OPERATOR && len1 == 1 && styler.SafeGetCharAt(pos1) == ':') { // ':' if (style2 == SCE_PL_IDENTIFIER || style2 == SCE_PL_WORD) { if (len2 == 9 && styler.Match(pos2, "prototype")) { // ':' 'prototype' if (state == SUB_BEGIN) { state = SUB_HAS_PROTO; } else break; } else { // ':' if (state == SUB_HAS_PROTO || state == SUB_HAS_ATTRIB) { state = SUB_HAS_ATTRIB; } else break; } } else break; } else if (style1 == SCE_PL_OPERATOR && len1 == 2 && styler.Match(pos1, "::")) { // '::' if (style2 == SCE_PL_IDENTIFIER) { // '::' state = SUB_HAS_MODULE; } else break; } else if (style1 == SCE_PL_WORD && len1 == 3 && styler.Match(pos1, "sub")) { // 'sub' if (style2 == SCE_PL_IDENTIFIER) { // 'sub' state = SUB_HAS_SUB; } else break; } else break; bk = pos1; // set position for finding next lexeme pair if (bk > 0) bk--; } while (state != SUB_HAS_SUB); return (state == SUB_HAS_SUB); } int actualNumStyle(int numberStyle) { if (numberStyle == PERLNUM_VECTOR || numberStyle == PERLNUM_V_VECTOR) { return SCE_PL_STRING; } else if (numberStyle == PERLNUM_BAD) { return SCE_PL_ERROR; } return SCE_PL_NUMBER; } int opposite(int ch) { if (ch == '(') return ')'; if (ch == '[') return ']'; if (ch == '{') return '}'; if (ch == '<') return '>'; return ch; } bool IsCommentLine(Sci_Position line, LexAccessor &styler) { Sci_Position pos = styler.LineStart(line); Sci_Position eol_pos = styler.LineStart(line + 1) - 1; for (Sci_Position i = pos; i < eol_pos; i++) { char ch = styler[i]; int style = styler.StyleAt(i); if (ch == '#' && style == SCE_PL_COMMENTLINE) return true; else if (!IsASpaceOrTab(ch)) return false; } return false; } bool IsPackageLine(Sci_Position line, LexAccessor &styler) { Sci_Position pos = styler.LineStart(line); int style = styler.StyleAt(pos); if (style == SCE_PL_WORD && styler.Match(pos, "package")) { return true; } return false; } int PodHeadingLevel(Sci_Position pos, LexAccessor &styler) { int lvl = static_cast(styler.SafeGetCharAt(pos + 5)); if (lvl >= '1' && lvl <= '4') { return lvl - '0'; } return 0; } // An individual named option for use in an OptionSet // Options used for LexerPerl struct OptionsPerl { bool fold; bool foldComment; bool foldCompact; // Custom folding of POD and packages bool foldPOD; // fold.perl.pod // Enable folding Pod blocks when using the Perl lexer. bool foldPackage; // fold.perl.package // Enable folding packages when using the Perl lexer. bool foldCommentExplicit; bool foldAtElse; OptionsPerl() { fold = false; foldComment = false; foldCompact = true; foldPOD = true; foldPackage = true; foldCommentExplicit = true; foldAtElse = false; } }; const char *const perlWordListDesc[] = { "Keywords", 0 }; struct OptionSetPerl : public OptionSet { OptionSetPerl() { DefineProperty("fold", &OptionsPerl::fold); DefineProperty("fold.comment", &OptionsPerl::foldComment); DefineProperty("fold.compact", &OptionsPerl::foldCompact); DefineProperty("fold.perl.pod", &OptionsPerl::foldPOD, "Set to 0 to disable folding Pod blocks when using the Perl lexer."); DefineProperty("fold.perl.package", &OptionsPerl::foldPackage, "Set to 0 to disable folding packages when using the Perl lexer."); DefineProperty("fold.perl.comment.explicit", &OptionsPerl::foldCommentExplicit, "Set to 0 to disable explicit folding."); DefineProperty("fold.perl.at.else", &OptionsPerl::foldAtElse, "This option enables Perl folding on a \"} else {\" line of an if statement."); DefineWordListSets(perlWordListDesc); } }; const LexicalClass lexicalClasses[] = { // Lexer perl SCLEX_PERL SCE_PL_: 0, "SCE_PL_DEFAULT", "default", "white space", 1, "SCE_PL_ERROR", "error", "error", 2, "SCE_PL_COMMENTLINE", "comment line", "comment", 3, "SCE_PL_POD", "data", "pod: = at beginning of line", 4, "SCE_PL_NUMBER", "literal numeric", "number", 5, "SCE_PL_WORD", "keyword", "keyword", 6, "SCE_PL_STRING", "literal string interpolated", "double quoted string", 7, "SCE_PL_CHARACTER", "literal string", "single quoted string", 8, "SCE_PL_PUNCTUATION", "operator", "symbols / punctuation. currently not used", 9, "SCE_PL_PREPROCESSOR", "preprocessor unused", "preprocessor. currently not used", 10, "SCE_PL_OPERATOR", "operator", "operators", 11, "SCE_PL_IDENTIFIER", "identifier", "identifiers (functions, etc.)", 12, "SCE_PL_SCALAR", "identifier", "scalars: $var", 13, "SCE_PL_ARRAY", "identifier", "array: @var", 14, "SCE_PL_HASH", "identifier", "hash: %var", 15, "SCE_PL_SYMBOLTABLE", "identifier", "symbol table: *var", 16, "SCE_PL_VARIABLE_INDEXER", "identifier unused", "sce_pl_variable_indexer allocated but unused", 17, "SCE_PL_REGEX", "literal regex", "regex: /re/ or m{re}", 18, "SCE_PL_REGSUBST", "literal regex", "substitution: s/re/ore/", 19, "SCE_PL_LONGQUOTE", "literal string", "long quote (qq, qr, qw, qx) -- obsolete: replaced by qq, qx, qr, qw", 20, "SCE_PL_BACKTICKS", "literal string interpolated", "back ticks", 21, "SCE_PL_DATASECTION", "data", "data section: __data__ or __end__ at beginning of line", 22, "SCE_PL_HERE_DELIM", "here-doc literal string", "here-doc (delimiter)", 23, "SCE_PL_HERE_Q", "here-doc literal string", "here-doc (single quoted, q)", 24, "SCE_PL_HERE_QQ", "here-doc literal string interpolated", "here-doc (double quoted, qq)", 25, "SCE_PL_HERE_QX", "here-doc literal interpolated", "here-doc (back ticks, qx)", 26, "SCE_PL_STRING_Q", "literal string", "single quoted string, generic", 27, "SCE_PL_STRING_QQ", "literal string interpolated", "qq = double quoted string", 28, "SCE_PL_STRING_QX", "literal string interpolated", "qx = back ticks", 29, "SCE_PL_STRING_QR", "literal regex", "qr = regex", 30, "SCE_PL_STRING_QW", "literal string interpolated", "qw = array", 31, "SCE_PL_POD_VERB", "data", "pod: verbatim paragraphs", 40, "SCE_PL_SUB_PROTOTYPE", "identifier", "subroutine prototype", 41, "SCE_PL_FORMAT_IDENT", "identifier", "format identifier", 42, "SCE_PL_FORMAT", "literal string", "format body", 43, "SCE_PL_STRING_VAR", "identifier interpolated", "double quoted string (interpolated variable)", 44, "SCE_PL_XLAT", "literal string", "translation: tr{}{} y{}{}", 54, "SCE_PL_REGEX_VAR", "identifier interpolated", "regex: /re/ or m{re} (interpolated variable)", 55, "SCE_PL_REGSUBST_VAR", "identifier interpolated", "substitution: s/re/ore/ (interpolated variable)", 57, "SCE_PL_BACKTICKS_VAR", "identifier interpolated", "back ticks (interpolated variable)", 61, "SCE_PL_HERE_QQ_VAR", "identifier interpolated", "here-doc (double quoted, qq) (interpolated variable)", 62, "SCE_PL_HERE_QX_VAR", "identifier interpolated", "here-doc (back ticks, qx) (interpolated variable)", 64, "SCE_PL_STRING_QQ_VAR", "identifier interpolated", "qq = double quoted string (interpolated variable)", 65, "SCE_PL_STRING_QX_VAR", "identifier interpolated", "qx = back ticks (interpolated variable)", 66, "SCE_PL_STRING_QR_VAR", "identifier interpolated", "qr = regex (interpolated variable)", }; class LexerPerl : public DefaultLexer { CharacterSet setWordStart; CharacterSet setWord; CharacterSet setSpecialVar; CharacterSet setControlVar; WordList keywords; OptionsPerl options; OptionSetPerl osPerl; public: LexerPerl() : DefaultLexer("perl", SCLEX_PERL, lexicalClasses, std::size(lexicalClasses)), setWordStart(CharacterSet::setAlpha, "_", 0x80, true), setWord(CharacterSet::setAlphaNum, "_", 0x80, true), setSpecialVar(CharacterSet::setNone, "\"$;<>&`'+,./\\%:=~!?@[]"), setControlVar(CharacterSet::setNone, "ACDEFHILMNOPRSTVWX") { } virtual ~LexerPerl() { } void SCI_METHOD Release() override { delete this; } int SCI_METHOD Version() const override { return lvRelease5; } const char *SCI_METHOD PropertyNames() override { return osPerl.PropertyNames(); } int SCI_METHOD PropertyType(const char *name) override { return osPerl.PropertyType(name); } const char *SCI_METHOD DescribeProperty(const char *name) override { return osPerl.DescribeProperty(name); } Sci_Position SCI_METHOD PropertySet(const char *key, const char *val) override; const char * SCI_METHOD PropertyGet(const char *key) override { return osPerl.PropertyGet(key); } const char *SCI_METHOD DescribeWordListSets() override { return osPerl.DescribeWordListSets(); } Sci_Position SCI_METHOD WordListSet(int n, const char *wl) override; void SCI_METHOD Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void SCI_METHOD Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void *SCI_METHOD PrivateCall(int, void *) override { return 0; } static ILexer5 *LexerFactoryPerl() { return new LexerPerl(); } int InputSymbolScan(StyleContext &sc); void InterpolateSegment(StyleContext &sc, int maxSeg, bool isPattern=false); }; Sci_Position SCI_METHOD LexerPerl::PropertySet(const char *key, const char *val) { if (osPerl.PropertySet(&options, key, val)) { return 0; } return -1; } Sci_Position SCI_METHOD LexerPerl::WordListSet(int n, const char *wl) { WordList *wordListN = 0; switch (n) { case 0: wordListN = &keywords; break; } Sci_Position firstModification = -1; if (wordListN) { if (wordListN->Set(wl)) { firstModification = 0; } } return firstModification; } int LexerPerl::InputSymbolScan(StyleContext &sc) { // forward scan for matching > on same line; file handles int c, sLen = 0; while ((c = sc.GetRelativeCharacter(++sLen)) != 0) { if (c == '\r' || c == '\n') { return 0; } else if (c == '>') { if (sc.Match("<=>")) // '<=>' case return 0; return sLen; } } return 0; } void LexerPerl::InterpolateSegment(StyleContext &sc, int maxSeg, bool isPattern) { // interpolate a segment (with no active backslashes or delimiters within) // switch in or out of an interpolation style or continue current style // commit variable patterns if found, trim segment, repeat until done while (maxSeg > 0) { bool isVar = false; int sLen = 0; if ((maxSeg > 1) && (sc.ch == '$' || sc.ch == '@')) { // $#[$]*word [$@][$]*word (where word or {word} is always present) bool braces = false; sLen = 1; if (sc.ch == '$' && sc.chNext == '#') { // starts with $# sLen++; } while ((maxSeg > sLen) && (sc.GetRelativeCharacter(sLen) == '$')) // >0 $ dereference within sLen++; if ((maxSeg > sLen) && (sc.GetRelativeCharacter(sLen) == '{')) { // { start for {word} sLen++; braces = true; } if (maxSeg > sLen) { int c = sc.GetRelativeCharacter(sLen); if (setWordStart.Contains(c)) { // word (various) sLen++; isVar = true; while (maxSeg > sLen) { if (!setWord.Contains(sc.GetRelativeCharacter(sLen))) break; sLen++; } } else if (braces && IsADigit(c) && (sLen == 2)) { // digit for ${digit} sLen++; isVar = true; } } if (braces) { if ((maxSeg > sLen) && (sc.GetRelativeCharacter(sLen) == '}')) { // } end for {word} sLen++; } else isVar = false; } } if (!isVar && (maxSeg > 1)) { // $- or @-specific variable patterns int c = sc.chNext; if (sc.ch == '$') { sLen = 1; if (IsADigit(c)) { // $[0-9] and slurp trailing digits sLen++; isVar = true; while ((maxSeg > sLen) && IsADigit(sc.GetRelativeCharacter(sLen))) sLen++; } else if (setSpecialVar.Contains(c)) { // $ special variables sLen++; isVar = true; } else if (!isPattern && ((c == '(') || (c == ')') || (c == '|'))) { // $ additional sLen++; isVar = true; } else if (c == '^') { // $^A control-char style sLen++; if ((maxSeg > sLen) && setControlVar.Contains(sc.GetRelativeCharacter(sLen))) { sLen++; isVar = true; } } } else if (sc.ch == '@') { sLen = 1; if (!isPattern && ((c == '+') || (c == '-'))) { // @ specials non-pattern sLen++; isVar = true; } } } if (isVar) { // commit as interpolated variable or normal character if (sc.state < SCE_PL_STRING_VAR) sc.SetState(sc.state + INTERPOLATE_SHIFT); sc.Forward(sLen); maxSeg -= sLen; } else { if (sc.state >= SCE_PL_STRING_VAR) sc.SetState(sc.state - INTERPOLATE_SHIFT); sc.Forward(); maxSeg--; } } if (sc.state >= SCE_PL_STRING_VAR) sc.SetState(sc.state - INTERPOLATE_SHIFT); } void SCI_METHOD LexerPerl::Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { LexAccessor styler(pAccess); // keywords that forces /PATTERN/ at all times; should track vim's behaviour WordList reWords; reWords.Set("elsif if split while"); // charset classes CharacterSet setSingleCharOp(CharacterSet::setNone, "rwxoRWXOezsfdlpSbctugkTBMAC"); // lexing of "%*,?!.~"); CharacterSet setQDelim(CharacterSet::setNone, "qrwx"); CharacterSet setModifiers(CharacterSet::setAlpha); CharacterSet setPreferRE(CharacterSet::setNone, "*/<%"); // setArray and setHash also accepts chars for special vars like $_, // which are then truncated when the next char does not match setVar CharacterSet setVar(CharacterSet::setAlphaNum, "#$_'", 0x80, true); CharacterSet setArray(CharacterSet::setAlpha, "#$_+-", 0x80, true); CharacterSet setHash(CharacterSet::setAlpha, "#$_!^+-", 0x80, true); CharacterSet &setPOD = setModifiers; CharacterSet setNonHereDoc(CharacterSet::setDigits, "=$@"); CharacterSet setHereDocDelim(CharacterSet::setAlphaNum, "_"); CharacterSet setSubPrototype(CharacterSet::setNone, "\\[$@%&*+];_ \t"); CharacterSet setRepetition(CharacterSet::setDigits, ")\"'"); // for format identifiers CharacterSet setFormatStart(CharacterSet::setAlpha, "_="); CharacterSet &setFormat = setHereDocDelim; // Lexer for perl often has to backtrack to start of current style to determine // which characters are being used as quotes, how deeply nested is the // start position and what the termination string is for HERE documents. class HereDocCls { // Class to manage HERE doc sequence public: int State; // 0: '<<' encountered // 1: collect the delimiter // 2: here doc text (lines after the delimiter) int Quote; // the char after '<<' bool Quoted; // true if Quote in ('\'','"','`') bool StripIndent; // true if '<<~' requested to strip leading whitespace int DelimiterLength; // strlen(Delimiter) char Delimiter[HERE_DELIM_MAX]; // the Delimiter HereDocCls() { State = 0; Quote = 0; Quoted = false; StripIndent = false; DelimiterLength = 0; Delimiter[0] = '\0'; } void Append(int ch) { Delimiter[DelimiterLength++] = static_cast(ch); Delimiter[DelimiterLength] = '\0'; } ~HereDocCls() { } }; HereDocCls HereDoc; // TODO: FIFO for stacked here-docs class QuoteCls { // Class to manage quote pairs public: int Rep; int Count; int Up, Down; QuoteCls() { New(1); } void New(int r = 1) { Rep = r; Count = 0; Up = '\0'; Down = '\0'; } void Open(int u) { Count++; Up = u; Down = opposite(Up); } }; QuoteCls Quote; // additional state for number lexing int numState = PERLNUM_DECIMAL; int dotCount = 0; Sci_PositionU endPos = startPos + length; // Backtrack to beginning of style if required... // If in a long distance lexical state, backtrack to find quote characters. // Includes strings (may be multi-line), numbers (additional state), format // bodies, as well as POD sections. if (initStyle == SCE_PL_HERE_Q || initStyle == SCE_PL_HERE_QQ || initStyle == SCE_PL_HERE_QX || initStyle == SCE_PL_FORMAT || initStyle == SCE_PL_HERE_QQ_VAR || initStyle == SCE_PL_HERE_QX_VAR ) { // backtrack through multiple styles to reach the delimiter start int delim = (initStyle == SCE_PL_FORMAT) ? SCE_PL_FORMAT_IDENT:SCE_PL_HERE_DELIM; while ((startPos > 1) && (styler.StyleAt(startPos) != delim)) { startPos--; } startPos = styler.LineStart(styler.GetLine(startPos)); initStyle = styler.StyleAt(startPos - 1); } if (initStyle == SCE_PL_STRING || initStyle == SCE_PL_STRING_QQ || initStyle == SCE_PL_BACKTICKS || initStyle == SCE_PL_STRING_QX || initStyle == SCE_PL_REGEX || initStyle == SCE_PL_STRING_QR || initStyle == SCE_PL_REGSUBST || initStyle == SCE_PL_STRING_VAR || initStyle == SCE_PL_STRING_QQ_VAR || initStyle == SCE_PL_BACKTICKS_VAR || initStyle == SCE_PL_STRING_QX_VAR || initStyle == SCE_PL_REGEX_VAR || initStyle == SCE_PL_STRING_QR_VAR || initStyle == SCE_PL_REGSUBST_VAR ) { // for interpolation, must backtrack through a mix of two different styles int otherStyle = (initStyle >= SCE_PL_STRING_VAR) ? initStyle - INTERPOLATE_SHIFT : initStyle + INTERPOLATE_SHIFT; while (startPos > 1) { int st = styler.StyleAt(startPos - 1); if ((st != initStyle) && (st != otherStyle)) break; startPos--; } initStyle = SCE_PL_DEFAULT; } else if (initStyle == SCE_PL_STRING_Q || initStyle == SCE_PL_STRING_QW || initStyle == SCE_PL_XLAT || initStyle == SCE_PL_CHARACTER || initStyle == SCE_PL_NUMBER || initStyle == SCE_PL_IDENTIFIER || initStyle == SCE_PL_ERROR || initStyle == SCE_PL_SUB_PROTOTYPE ) { while ((startPos > 1) && (styler.StyleAt(startPos - 1) == initStyle)) { startPos--; } initStyle = SCE_PL_DEFAULT; } else if (initStyle == SCE_PL_POD || initStyle == SCE_PL_POD_VERB ) { // POD backtracking finds preceding blank lines and goes back past them Sci_Position ln = styler.GetLine(startPos); if (ln > 0) { initStyle = styler.StyleAt(styler.LineStart(--ln)); if (initStyle == SCE_PL_POD || initStyle == SCE_PL_POD_VERB) { while (ln > 0 && styler.GetLineState(ln) == SCE_PL_DEFAULT) ln--; } startPos = styler.LineStart(++ln); initStyle = styler.StyleAt(startPos - 1); } else { startPos = 0; initStyle = SCE_PL_DEFAULT; } } // backFlag, backPos are additional state to aid identifier corner cases. // Look backwards past whitespace and comments in order to detect either // operator or keyword. Later updated as we go along. int backFlag = BACK_NONE; Sci_PositionU backPos = startPos; if (backPos > 0) { backPos--; skipWhitespaceComment(styler, backPos); if (styler.StyleAt(backPos) == SCE_PL_OPERATOR) backFlag = BACK_OPERATOR; else if (styler.StyleAt(backPos) == SCE_PL_WORD) backFlag = BACK_KEYWORD; backPos++; } StyleContext sc(startPos, endPos - startPos, initStyle, styler); for (; sc.More(); sc.Forward()) { // Determine if the current state should terminate. switch (sc.state) { case SCE_PL_OPERATOR: sc.SetState(SCE_PL_DEFAULT); backFlag = BACK_OPERATOR; backPos = sc.currentPos; break; case SCE_PL_IDENTIFIER: // identifier, bareword, inputsymbol if ((!setWord.Contains(sc.ch) && sc.ch != '\'') || sc.Match('.', '.') || sc.chPrev == '>') { // end of inputsymbol sc.SetState(SCE_PL_DEFAULT); } break; case SCE_PL_WORD: // keyword, plus special cases if (!setWord.Contains(sc.ch)) { char s[100]; sc.GetCurrent(s, sizeof(s)); if ((strcmp(s, "__DATA__") == 0) || (strcmp(s, "__END__") == 0)) { sc.ChangeState(SCE_PL_DATASECTION); } else { if ((strcmp(s, "format") == 0)) { sc.SetState(SCE_PL_FORMAT_IDENT); HereDoc.State = 0; } else { sc.SetState(SCE_PL_DEFAULT); } backFlag = BACK_KEYWORD; backPos = sc.currentPos; } } break; case SCE_PL_SCALAR: case SCE_PL_ARRAY: case SCE_PL_HASH: case SCE_PL_SYMBOLTABLE: if (sc.Match(':', ':')) { // skip :: sc.Forward(); } else if (!setVar.Contains(sc.ch)) { if (sc.LengthCurrent() == 1) { // Special variable: $(, $_ etc. sc.Forward(); } sc.SetState(SCE_PL_DEFAULT); } break; case SCE_PL_NUMBER: // if no early break, number style is terminated at "(go through)" if (sc.ch == '.') { if (sc.chNext == '.') { // double dot is always an operator (go through) } else if (numState <= PERLNUM_FLOAT_EXP) { // non-decimal number or float exponent, consume next dot sc.SetState(SCE_PL_OPERATOR); break; } else { // decimal or vectors allows dots dotCount++; if (numState == PERLNUM_DECIMAL) { if (dotCount <= 1) // number with one dot in it break; if (IsADigit(sc.chNext)) { // really a vector numState = PERLNUM_VECTOR; break; } // number then dot (go through) } else if (numState == PERLNUM_HEX) { if (dotCount <= 1 && IsADigit(sc.chNext, 16)) { break; // hex with one dot is a hex float } else { sc.SetState(SCE_PL_OPERATOR); break; } // hex then dot (go through) } else if (IsADigit(sc.chNext)) // vectors break; // vector then dot (go through) } } else if (sc.ch == '_') { // permissive underscoring for number and vector literals break; } else if (numState == PERLNUM_DECIMAL) { if (sc.ch == 'E' || sc.ch == 'e') { // exponent, sign numState = PERLNUM_FLOAT_EXP; if (sc.chNext == '+' || sc.chNext == '-') { sc.Forward(); } break; } else if (IsADigit(sc.ch)) break; // number then word (go through) } else if (numState == PERLNUM_HEX) { if (sc.ch == 'P' || sc.ch == 'p') { // hex float exponent, sign numState = PERLNUM_FLOAT_EXP; if (sc.chNext == '+' || sc.chNext == '-') { sc.Forward(); } break; } else if (IsADigit(sc.ch, 16)) break; // hex or hex float then word (go through) } else if (numState == PERLNUM_VECTOR || numState == PERLNUM_V_VECTOR) { if (IsADigit(sc.ch)) // vector break; if (setWord.Contains(sc.ch) && dotCount == 0) { // change to word sc.ChangeState(SCE_PL_IDENTIFIER); break; } // vector then word (go through) } else if (IsADigit(sc.ch)) { if (numState == PERLNUM_FLOAT_EXP) { break; } else if (numState == PERLNUM_OCTAL) { if (sc.ch <= '7') break; } else if (numState == PERLNUM_BINARY) { if (sc.ch <= '1') break; } // mark invalid octal, binary numbers (go through) numState = PERLNUM_BAD; break; } // complete current number or vector sc.ChangeState(actualNumStyle(numState)); sc.SetState(SCE_PL_DEFAULT); break; case SCE_PL_COMMENTLINE: if (sc.atLineStart) { sc.SetState(SCE_PL_DEFAULT); } break; case SCE_PL_HERE_DELIM: if (HereDoc.State == 0) { // '<<' encountered int delim_ch = sc.chNext; Sci_Position ws_skip = 0; HereDoc.State = 1; // pre-init HERE doc class HereDoc.Quote = sc.chNext; HereDoc.Quoted = false; HereDoc.StripIndent = false; HereDoc.DelimiterLength = 0; HereDoc.Delimiter[HereDoc.DelimiterLength] = '\0'; if (delim_ch == '~') { // was actually '<<~' sc.Forward(); HereDoc.StripIndent = true; HereDoc.Quote = delim_ch = sc.chNext; } if (IsASpaceOrTab(delim_ch)) { // skip whitespace; legal only for quoted delimiters Sci_PositionU i = sc.currentPos + 1; while ((i < endPos) && IsASpaceOrTab(delim_ch)) { i++; delim_ch = static_cast(styler.SafeGetCharAt(i)); } ws_skip = i - sc.currentPos - 1; } if (delim_ch == '\'' || delim_ch == '"' || delim_ch == '`') { // a quoted here-doc delimiter; skip any whitespace sc.Forward(ws_skip + 1); HereDoc.Quote = delim_ch; HereDoc.Quoted = true; } else if ((ws_skip == 0 && setNonHereDoc.Contains(sc.chNext)) || ws_skip > 0) { // left shift << or <<= operator cases // restore position if operator sc.ChangeState(SCE_PL_OPERATOR); sc.ForwardSetState(SCE_PL_DEFAULT); backFlag = BACK_OPERATOR; backPos = sc.currentPos; HereDoc.State = 0; } else { // specially handle initial '\' for identifier if (ws_skip == 0 && HereDoc.Quote == '\\') sc.Forward(); // an unquoted here-doc delimiter, no special handling // (cannot be prefixed by spaces/tabs), or // symbols terminates; deprecated zero-length delimiter } } else if (HereDoc.State == 1) { // collect the delimiter backFlag = BACK_NONE; if (HereDoc.Quoted) { // a quoted here-doc delimiter if (sc.ch == HereDoc.Quote) { // closing quote => end of delimiter sc.ForwardSetState(SCE_PL_DEFAULT); } else if (!sc.atLineEnd) { if (sc.Match('\\', static_cast(HereDoc.Quote))) { // escaped quote sc.Forward(); } if (sc.ch != '\r') { // skip CR if CRLF int i = 0; // else append char, possibly an extended char while (i < sc.width) { HereDoc.Append(static_cast(styler.SafeGetCharAt(sc.currentPos + i))); i++; } } } } else { // an unquoted here-doc delimiter, no extended charsets if (setHereDocDelim.Contains(sc.ch)) { HereDoc.Append(sc.ch); } else { sc.SetState(SCE_PL_DEFAULT); } } if (HereDoc.DelimiterLength >= HERE_DELIM_MAX - 1) { sc.SetState(SCE_PL_ERROR); HereDoc.State = 0; } } break; case SCE_PL_HERE_Q: case SCE_PL_HERE_QQ: case SCE_PL_HERE_QX: // also implies HereDoc.State == 2 sc.Complete(); if (HereDoc.StripIndent) { // skip whitespace while (IsASpaceOrTab(sc.ch) && !sc.atLineEnd) sc.Forward(); } if (HereDoc.DelimiterLength == 0 || sc.Match(HereDoc.Delimiter)) { int c = sc.GetRelative(HereDoc.DelimiterLength); if (c == '\r' || c == '\n') { // peek first, do not consume match sc.ForwardBytes(HereDoc.DelimiterLength); sc.SetState(SCE_PL_DEFAULT); backFlag = BACK_NONE; HereDoc.State = 0; if (!sc.atLineEnd) sc.Forward(); break; } } if (sc.state == SCE_PL_HERE_Q) { // \EOF and 'EOF' non-interpolated while (!sc.atLineEnd) sc.Forward(); break; } while (!sc.atLineEnd) { // "EOF" and `EOF` interpolated int c, sLen = 0, endType = 0; while ((c = sc.GetRelativeCharacter(sLen)) != 0) { // scan to break string into segments if (c == '\\') { endType = 1; break; } else if (c == '\r' || c == '\n') { endType = 2; break; } sLen++; } if (sLen > 0) // process non-empty segments InterpolateSegment(sc, sLen); if (endType == 1) { sc.Forward(); // \ at end-of-line does not appear to have any effect, skip if (sc.ch != '\r' && sc.ch != '\n') sc.Forward(); } else if (endType == 2) { if (!sc.atLineEnd) sc.Forward(); } } break; case SCE_PL_POD: case SCE_PL_POD_VERB: { Sci_PositionU fw = sc.currentPos; Sci_Position ln = styler.GetLine(fw); if (sc.atLineStart && sc.Match("=cut")) { // end of POD sc.SetState(SCE_PL_POD); sc.Forward(4); sc.SetState(SCE_PL_DEFAULT); styler.SetLineState(ln, SCE_PL_POD); break; } int pod = podLineScan(styler, fw, endPos); // classify POD line styler.SetLineState(ln, pod); if (pod == SCE_PL_DEFAULT) { if (sc.state == SCE_PL_POD_VERB) { Sci_PositionU fw2 = fw; while (fw2 < (endPos - 1) && pod == SCE_PL_DEFAULT) { fw = fw2++; // penultimate line (last blank line) pod = podLineScan(styler, fw2, endPos); styler.SetLineState(styler.GetLine(fw2), pod); } if (pod == SCE_PL_POD) { // truncate verbatim POD early sc.SetState(SCE_PL_POD); } else fw = fw2; } } else { if (pod == SCE_PL_POD_VERB // still part of current paragraph && (styler.GetLineState(ln - 1) == SCE_PL_POD)) { pod = SCE_PL_POD; styler.SetLineState(ln, pod); } else if (pod == SCE_PL_POD && (styler.GetLineState(ln - 1) == SCE_PL_POD_VERB)) { pod = SCE_PL_POD_VERB; styler.SetLineState(ln, pod); } sc.SetState(pod); } sc.ForwardBytes(fw - sc.currentPos); // commit style } break; case SCE_PL_REGEX: case SCE_PL_STRING_QR: if (Quote.Rep <= 0) { if (!setModifiers.Contains(sc.ch)) sc.SetState(SCE_PL_DEFAULT); } else if (!Quote.Up && !IsASpace(sc.ch)) { Quote.Open(sc.ch); } else { int c, sLen = 0, endType = 0; while ((c = sc.GetRelativeCharacter(sLen)) != 0) { // scan to break string into segments if (IsASpace(c)) { break; } else if (c == '\\' && Quote.Up != '\\') { endType = 1; break; } else if (c == Quote.Down) { Quote.Count--; if (Quote.Count == 0) { Quote.Rep--; break; } } else if (c == Quote.Up) Quote.Count++; sLen++; } if (sLen > 0) { // process non-empty segments if (Quote.Up != '\'') { InterpolateSegment(sc, sLen, true); } else // non-interpolated path sc.Forward(sLen); } if (endType == 1) sc.Forward(); } break; case SCE_PL_REGSUBST: case SCE_PL_XLAT: if (Quote.Rep <= 0) { if (!setModifiers.Contains(sc.ch)) sc.SetState(SCE_PL_DEFAULT); } else if (!Quote.Up && !IsASpace(sc.ch)) { Quote.Open(sc.ch); } else { int c, sLen = 0, endType = 0; bool isPattern = (Quote.Rep == 2); while ((c = sc.GetRelativeCharacter(sLen)) != 0) { // scan to break string into segments if (c == '\\' && Quote.Up != '\\') { endType = 2; break; } else if (Quote.Count == 0 && Quote.Rep == 1) { // We matched something like s(...) or tr{...}, Perl 5.10 // appears to allow almost any character for use as the // next delimiters. Whitespace and comments are accepted in // between, but we'll limit to whitespace here. // For '#', if no whitespace in between, it's a delimiter. if (IsASpace(c)) { // Keep going } else if (c == '#' && IsASpaceOrTab(sc.GetRelativeCharacter(sLen - 1))) { endType = 3; } else Quote.Open(c); break; } else if (c == Quote.Down) { Quote.Count--; if (Quote.Count == 0) { Quote.Rep--; endType = 1; } if (Quote.Up == Quote.Down) Quote.Count++; if (endType == 1) break; } else if (c == Quote.Up) { Quote.Count++; } else if (IsASpace(c)) break; sLen++; } if (sLen > 0) { // process non-empty segments if (sc.state == SCE_PL_REGSUBST && Quote.Up != '\'') { InterpolateSegment(sc, sLen, isPattern); } else // non-interpolated path sc.Forward(sLen); } if (endType == 2) { sc.Forward(); } else if (endType == 3) sc.SetState(SCE_PL_DEFAULT); } break; case SCE_PL_STRING_Q: case SCE_PL_STRING_QQ: case SCE_PL_STRING_QX: case SCE_PL_STRING_QW: case SCE_PL_STRING: case SCE_PL_CHARACTER: case SCE_PL_BACKTICKS: if (!Quote.Down && !IsASpace(sc.ch)) { Quote.Open(sc.ch); } else { int c, sLen = 0, endType = 0; while ((c = sc.GetRelativeCharacter(sLen)) != 0) { // scan to break string into segments if (IsASpace(c)) { break; } else if (c == '\\' && Quote.Up != '\\') { endType = 2; break; } else if (c == Quote.Down) { Quote.Count--; if (Quote.Count == 0) { endType = 3; break; } } else if (c == Quote.Up) Quote.Count++; sLen++; } if (sLen > 0) { // process non-empty segments switch (sc.state) { case SCE_PL_STRING: case SCE_PL_STRING_QQ: case SCE_PL_BACKTICKS: InterpolateSegment(sc, sLen); break; case SCE_PL_STRING_QX: if (Quote.Up != '\'') { InterpolateSegment(sc, sLen); break; } // (continued for ' delim) // Falls through. default: // non-interpolated path sc.Forward(sLen); } } if (endType == 2) { sc.Forward(); } else if (endType == 3) sc.ForwardSetState(SCE_PL_DEFAULT); } break; case SCE_PL_SUB_PROTOTYPE: { int i = 0; // forward scan; must all be valid proto characters while (setSubPrototype.Contains(sc.GetRelative(i))) i++; if (sc.GetRelative(i) == ')') { // valid sub prototype sc.ForwardBytes(i); sc.ForwardSetState(SCE_PL_DEFAULT); } else { // abandon prototype, restart from '(' sc.ChangeState(SCE_PL_OPERATOR); sc.SetState(SCE_PL_DEFAULT); } } break; case SCE_PL_FORMAT: { sc.Complete(); if (sc.Match('.')) { sc.Forward(); if (sc.atLineEnd || ((sc.ch == '\r' && sc.chNext == '\n'))) sc.SetState(SCE_PL_DEFAULT); } while (!sc.atLineEnd) sc.Forward(); } break; case SCE_PL_ERROR: break; } // Needed for specific continuation styles (one follows the other) switch (sc.state) { // continued from SCE_PL_WORD case SCE_PL_FORMAT_IDENT: // occupies HereDoc state 3 to avoid clashing with HERE docs if (IsASpaceOrTab(sc.ch)) { // skip whitespace sc.ChangeState(SCE_PL_DEFAULT); while (IsASpaceOrTab(sc.ch) && !sc.atLineEnd) sc.Forward(); sc.SetState(SCE_PL_FORMAT_IDENT); } if (setFormatStart.Contains(sc.ch)) { // identifier or '=' if (sc.ch != '=') { do { sc.Forward(); } while (setFormat.Contains(sc.ch)); } while (IsASpaceOrTab(sc.ch) && !sc.atLineEnd) sc.Forward(); if (sc.ch == '=') { sc.ForwardSetState(SCE_PL_DEFAULT); HereDoc.State = 3; } else { // invalid identifier; inexact fallback, but hey sc.ChangeState(SCE_PL_IDENTIFIER); sc.SetState(SCE_PL_DEFAULT); } } else { sc.ChangeState(SCE_PL_DEFAULT); // invalid identifier } backFlag = BACK_NONE; break; } // Must check end of HereDoc states here before default state is handled if (HereDoc.State == 1 && sc.atLineEnd) { // Begin of here-doc (the line after the here-doc delimiter): // Lexically, the here-doc starts from the next line after the >>, but the // first line of here-doc seem to follow the style of the last EOL sequence int st_new = SCE_PL_HERE_QQ; HereDoc.State = 2; if (HereDoc.Quoted) { if (sc.state == SCE_PL_HERE_DELIM) { // Missing quote at end of string! We are stricter than perl. // Colour here-doc anyway while marking this bit as an error. sc.ChangeState(SCE_PL_ERROR); } switch (HereDoc.Quote) { case '\'': st_new = SCE_PL_HERE_Q; break; case '"' : st_new = SCE_PL_HERE_QQ; break; case '`' : st_new = SCE_PL_HERE_QX; break; } } else { if (HereDoc.Quote == '\\') st_new = SCE_PL_HERE_Q; } sc.SetState(st_new); } if (HereDoc.State == 3 && sc.atLineEnd) { // Start of format body. HereDoc.State = 0; sc.SetState(SCE_PL_FORMAT); } // Determine if a new state should be entered. if (sc.state == SCE_PL_DEFAULT) { if (IsADigit(sc.ch) || (IsADigit(sc.chNext) && (sc.ch == '.' || sc.ch == 'v'))) { sc.SetState(SCE_PL_NUMBER); backFlag = BACK_NONE; numState = PERLNUM_DECIMAL; dotCount = 0; if (sc.ch == '0') { // hex,bin,octal if (sc.chNext == 'x' || sc.chNext == 'X') { numState = PERLNUM_HEX; } else if (sc.chNext == 'b' || sc.chNext == 'B') { numState = PERLNUM_BINARY; } else if (IsADigit(sc.chNext)) { numState = PERLNUM_OCTAL; } if (numState != PERLNUM_DECIMAL) { sc.Forward(); } } else if (sc.ch == 'v') { // vector numState = PERLNUM_V_VECTOR; } } else if (setWord.Contains(sc.ch)) { // if immediately prefixed by '::', always a bareword sc.SetState(SCE_PL_WORD); if (sc.chPrev == ':' && sc.GetRelative(-2) == ':') { sc.ChangeState(SCE_PL_IDENTIFIER); } Sci_PositionU bk = sc.currentPos; Sci_PositionU fw = sc.currentPos + 1; // first check for possible quote-like delimiter if (sc.ch == 's' && !setWord.Contains(sc.chNext)) { sc.ChangeState(SCE_PL_REGSUBST); Quote.New(2); } else if (sc.ch == 'm' && !setWord.Contains(sc.chNext)) { sc.ChangeState(SCE_PL_REGEX); Quote.New(); } else if (sc.ch == 'q' && !setWord.Contains(sc.chNext)) { sc.ChangeState(SCE_PL_STRING_Q); Quote.New(); } else if (sc.ch == 'y' && !setWord.Contains(sc.chNext)) { sc.ChangeState(SCE_PL_XLAT); Quote.New(2); } else if (sc.Match('t', 'r') && !setWord.Contains(sc.GetRelative(2))) { sc.ChangeState(SCE_PL_XLAT); Quote.New(2); sc.Forward(); fw++; } else if (sc.ch == 'q' && setQDelim.Contains(sc.chNext) && !setWord.Contains(sc.GetRelative(2))) { if (sc.chNext == 'q') sc.ChangeState(SCE_PL_STRING_QQ); else if (sc.chNext == 'x') sc.ChangeState(SCE_PL_STRING_QX); else if (sc.chNext == 'r') sc.ChangeState(SCE_PL_STRING_QR); else sc.ChangeState(SCE_PL_STRING_QW); // sc.chNext == 'w' Quote.New(); sc.Forward(); fw++; } else if (sc.ch == 'x' && (sc.chNext == '=' || // repetition !setWord.Contains(sc.chNext) || (setRepetition.Contains(sc.chPrev) && IsADigit(sc.chNext)))) { sc.ChangeState(SCE_PL_OPERATOR); } // if potentially a keyword, scan forward and grab word, then check // if it's really one; if yes, disambiguation test is performed // otherwise it is always a bareword and we skip a lot of scanning if (sc.state == SCE_PL_WORD) { while (setWord.Contains(static_cast(styler.SafeGetCharAt(fw)))) fw++; if (!isPerlKeyword(styler.GetStartSegment(), fw, keywords, styler)) { sc.ChangeState(SCE_PL_IDENTIFIER); } } // if already SCE_PL_IDENTIFIER, then no ambiguity, skip this // for quote-like delimiters/keywords, attempt to disambiguate // to select for bareword, change state -> SCE_PL_IDENTIFIER if (sc.state != SCE_PL_IDENTIFIER && bk > 0) { if (disambiguateBareword(styler, bk, fw, backFlag, backPos, endPos)) sc.ChangeState(SCE_PL_IDENTIFIER); } backFlag = BACK_NONE; } else if (sc.ch == '#') { sc.SetState(SCE_PL_COMMENTLINE); } else if (sc.ch == '\"') { sc.SetState(SCE_PL_STRING); Quote.New(); Quote.Open(sc.ch); backFlag = BACK_NONE; } else if (sc.ch == '\'') { if (sc.chPrev == '&' && setWordStart.Contains(sc.chNext)) { // Archaic call sc.SetState(SCE_PL_IDENTIFIER); } else { sc.SetState(SCE_PL_CHARACTER); Quote.New(); Quote.Open(sc.ch); } backFlag = BACK_NONE; } else if (sc.ch == '`') { sc.SetState(SCE_PL_BACKTICKS); Quote.New(); Quote.Open(sc.ch); backFlag = BACK_NONE; } else if (sc.ch == '$') { sc.SetState(SCE_PL_SCALAR); if (sc.chNext == '{') { sc.ForwardSetState(SCE_PL_OPERATOR); } else if (IsASpace(sc.chNext)) { sc.ForwardSetState(SCE_PL_DEFAULT); } else { sc.Forward(); if (sc.Match('`', '`') || sc.Match(':', ':')) { sc.Forward(); } } backFlag = BACK_NONE; } else if (sc.ch == '@') { sc.SetState(SCE_PL_ARRAY); if (setArray.Contains(sc.chNext)) { // no special treatment } else if (sc.chNext == ':' && sc.GetRelative(2) == ':') { sc.ForwardBytes(2); } else if (sc.chNext == '{' || sc.chNext == '[') { sc.ForwardSetState(SCE_PL_OPERATOR); } else { sc.ChangeState(SCE_PL_OPERATOR); } backFlag = BACK_NONE; } else if (setPreferRE.Contains(sc.ch)) { // Explicit backward peeking to set a consistent preferRE for // any slash found, so no longer need to track preferRE state. // Find first previous significant lexed element and interpret. // A few symbols shares this code for disambiguation. bool preferRE = false; bool isHereDoc = sc.Match('<', '<'); bool hereDocSpace = false; // for: SCALAR [whitespace] '<<' Sci_PositionU bk = (sc.currentPos > 0) ? sc.currentPos - 1: 0; sc.Complete(); styler.Flush(); if (styler.StyleAt(bk) == SCE_PL_DEFAULT) hereDocSpace = true; skipWhitespaceComment(styler, bk); if (bk == 0) { // avoid backward scanning breakage preferRE = true; } else { int bkstyle = styler.StyleAt(bk); int bkch = static_cast(styler.SafeGetCharAt(bk)); switch (bkstyle) { case SCE_PL_OPERATOR: preferRE = true; if (bkch == ')' || bkch == ']') { preferRE = false; } else if (bkch == '}') { // backtrack by counting balanced brace pairs // needed to test for variables like ${}, @{} etc. bkstyle = styleBeforeBracePair(styler, bk); if (bkstyle == SCE_PL_SCALAR || bkstyle == SCE_PL_ARRAY || bkstyle == SCE_PL_HASH || bkstyle == SCE_PL_SYMBOLTABLE || bkstyle == SCE_PL_OPERATOR) { preferRE = false; } } else if (bkch == '+' || bkch == '-') { if (bkch == static_cast(styler.SafeGetCharAt(bk - 1)) && bkch != static_cast(styler.SafeGetCharAt(bk - 2))) // exceptions for operators: unary suffixes ++, -- preferRE = false; } break; case SCE_PL_IDENTIFIER: preferRE = true; bkstyle = styleCheckIdentifier(styler, bk); if ((bkstyle == 1) || (bkstyle == 2)) { // inputsymbol or var with "->" or "::" before identifier preferRE = false; } else if (bkstyle == 3) { // bare identifier, test cases follows: if (sc.ch == '/') { // if '/', /PATTERN/ unless digit/space immediately after '/' // if '//', always expect defined-or operator to follow identifier if (IsASpace(sc.chNext) || IsADigit(sc.chNext) || sc.chNext == '/') preferRE = false; } else if (sc.ch == '*' || sc.ch == '%') { if (IsASpace(sc.chNext) || IsADigit(sc.chNext) || sc.Match('*', '*')) preferRE = false; } else if (sc.ch == '<') { if (IsASpace(sc.chNext) || sc.chNext == '=') preferRE = false; } } break; case SCE_PL_SCALAR: // for $var<< case: if (isHereDoc && hereDocSpace) // if SCALAR whitespace '<<', *always* a HERE doc preferRE = true; break; case SCE_PL_WORD: preferRE = true; // for HERE docs, always true if (sc.ch == '/') { // adopt heuristics similar to vim-style rules: // keywords always forced as /PATTERN/: split, if, elsif, while // everything else /PATTERN/ unless digit/space immediately after '/' // for '//', defined-or favoured unless special keywords Sci_PositionU bkend = bk + 1; while (bk > 0 && styler.StyleAt(bk - 1) == SCE_PL_WORD) { bk--; } if (isPerlKeyword(bk, bkend, reWords, styler)) break; if (IsASpace(sc.chNext) || IsADigit(sc.chNext) || sc.chNext == '/') preferRE = false; } else if (sc.ch == '*' || sc.ch == '%') { if (IsASpace(sc.chNext) || IsADigit(sc.chNext) || sc.Match('*', '*')) preferRE = false; } else if (sc.ch == '<') { if (IsASpace(sc.chNext) || sc.chNext == '=') preferRE = false; } break; // other styles uses the default, preferRE=false case SCE_PL_POD: case SCE_PL_HERE_Q: case SCE_PL_HERE_QQ: case SCE_PL_HERE_QX: preferRE = true; break; } } backFlag = BACK_NONE; if (isHereDoc) { // handle '<<', HERE doc if (sc.Match("<<>>")) { // double-diamond operator (5.22) sc.SetState(SCE_PL_OPERATOR); sc.Forward(3); } else if (preferRE) { sc.SetState(SCE_PL_HERE_DELIM); HereDoc.State = 0; } else { // << operator sc.SetState(SCE_PL_OPERATOR); sc.Forward(); } } else if (sc.ch == '*') { // handle '*', typeglob if (preferRE) { sc.SetState(SCE_PL_SYMBOLTABLE); if (sc.chNext == ':' && sc.GetRelative(2) == ':') { sc.ForwardBytes(2); } else if (sc.chNext == '{') { sc.ForwardSetState(SCE_PL_OPERATOR); } else { sc.Forward(); } } else { sc.SetState(SCE_PL_OPERATOR); if (sc.chNext == '*') // exponentiation sc.Forward(); } } else if (sc.ch == '%') { // handle '%', hash if (preferRE) { sc.SetState(SCE_PL_HASH); if (setHash.Contains(sc.chNext)) { sc.Forward(); } else if (sc.chNext == ':' && sc.GetRelative(2) == ':') { sc.ForwardBytes(2); } else if (sc.chNext == '{') { sc.ForwardSetState(SCE_PL_OPERATOR); } else { sc.ChangeState(SCE_PL_OPERATOR); } } else { sc.SetState(SCE_PL_OPERATOR); } } else if (sc.ch == '<') { // handle '<', inputsymbol if (preferRE) { // forward scan int i = InputSymbolScan(sc); if (i > 0) { sc.SetState(SCE_PL_IDENTIFIER); sc.Forward(i); } else { sc.SetState(SCE_PL_OPERATOR); } } else { sc.SetState(SCE_PL_OPERATOR); } } else { // handle '/', regexp if (preferRE) { sc.SetState(SCE_PL_REGEX); Quote.New(); Quote.Open(sc.ch); } else { // / and // operators sc.SetState(SCE_PL_OPERATOR); if (sc.chNext == '/') { sc.Forward(); } } } } else if (sc.ch == '=' // POD && setPOD.Contains(sc.chNext) && sc.atLineStart) { sc.SetState(SCE_PL_POD); backFlag = BACK_NONE; } else if (sc.ch == '-' && setWordStart.Contains(sc.chNext)) { // extended '-' cases Sci_PositionU bk = sc.currentPos; Sci_PositionU fw = 2; if (setSingleCharOp.Contains(sc.chNext) && // file test operators !setWord.Contains(sc.GetRelative(2))) { sc.SetState(SCE_PL_WORD); } else { // nominally a minus and bareword; find extent of bareword while (setWord.Contains(sc.GetRelative(fw))) fw++; sc.SetState(SCE_PL_OPERATOR); } // force to bareword for hash key => or {variable literal} cases if (disambiguateBareword(styler, bk, bk + fw, backFlag, backPos, endPos) & 2) { sc.ChangeState(SCE_PL_IDENTIFIER); } backFlag = BACK_NONE; } else if (sc.ch == '(' && sc.currentPos > 0) { // '(' or subroutine prototype sc.Complete(); if (styleCheckSubPrototype(styler, sc.currentPos - 1)) { sc.SetState(SCE_PL_SUB_PROTOTYPE); backFlag = BACK_NONE; } else { sc.SetState(SCE_PL_OPERATOR); } } else if (setPerlOperator.Contains(sc.ch)) { // operators sc.SetState(SCE_PL_OPERATOR); if (sc.Match('.', '.')) { // .. and ... sc.Forward(); if (sc.chNext == '.') sc.Forward(); } } else if (sc.ch == 4 || sc.ch == 26) { // ^D and ^Z ends valid perl source sc.SetState(SCE_PL_DATASECTION); } else { // keep colouring defaults sc.Complete(); } } } sc.Complete(); if (sc.state == SCE_PL_HERE_Q || sc.state == SCE_PL_HERE_QQ || sc.state == SCE_PL_HERE_QX || sc.state == SCE_PL_FORMAT) { styler.ChangeLexerState(sc.currentPos, styler.Length()); } sc.Complete(); } #define PERL_HEADFOLD_SHIFT 4 #define PERL_HEADFOLD_MASK 0xF0 void SCI_METHOD LexerPerl::Fold(Sci_PositionU startPos, Sci_Position length, int /* initStyle */, IDocument *pAccess) { if (!options.fold) return; LexAccessor styler(pAccess); Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); // Backtrack to previous line in case need to fix its fold status if (startPos > 0) { if (lineCurrent > 0) { lineCurrent--; startPos = styler.LineStart(lineCurrent); } } int levelPrev = SC_FOLDLEVELBASE; if (lineCurrent > 0) levelPrev = styler.LevelAt(lineCurrent - 1) >> 16; int levelCurrent = levelPrev; char chNext = styler[startPos]; char chPrev = styler.SafeGetCharAt(startPos - 1); int styleNext = styler.StyleAt(startPos); // Used at end of line to determine if the line was a package definition bool isPackageLine = false; int podHeading = 0; for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); int style = styleNext; styleNext = styler.StyleAt(i + 1); int stylePrevCh = (i) ? styler.StyleAt(i - 1):SCE_PL_DEFAULT; bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); bool atLineStart = ((chPrev == '\r') || (chPrev == '\n')) || i == 0; // Comment folding if (options.foldComment && atEOL && IsCommentLine(lineCurrent, styler)) { if (!IsCommentLine(lineCurrent - 1, styler) && IsCommentLine(lineCurrent + 1, styler)) levelCurrent++; else if (IsCommentLine(lineCurrent - 1, styler) && !IsCommentLine(lineCurrent + 1, styler)) levelCurrent--; } // {} [] block folding if (style == SCE_PL_OPERATOR) { if (ch == '{') { if (options.foldAtElse && levelCurrent < levelPrev) --levelPrev; levelCurrent++; } else if (ch == '}') { levelCurrent--; } if (ch == '[') { if (options.foldAtElse && levelCurrent < levelPrev) --levelPrev; levelCurrent++; } else if (ch == ']') { levelCurrent--; } } else if (style == SCE_PL_STRING_QW) { // qw if (stylePrevCh != style) levelCurrent++; else if (styleNext != style) levelCurrent--; } // POD folding if (options.foldPOD && atLineStart) { if (style == SCE_PL_POD) { if (stylePrevCh != SCE_PL_POD && stylePrevCh != SCE_PL_POD_VERB) levelCurrent++; else if (styler.Match(i, "=cut")) levelCurrent = (levelCurrent & ~PERL_HEADFOLD_MASK) - 1; else if (styler.Match(i, "=head")) podHeading = PodHeadingLevel(i, styler); } else if (style == SCE_PL_DATASECTION) { if (ch == '=' && IsASCII(chNext) && isalpha(chNext) && levelCurrent == SC_FOLDLEVELBASE) levelCurrent++; else if (styler.Match(i, "=cut") && levelCurrent > SC_FOLDLEVELBASE) levelCurrent = (levelCurrent & ~PERL_HEADFOLD_MASK) - 1; else if (styler.Match(i, "=head")) podHeading = PodHeadingLevel(i, styler); // if package used or unclosed brace, level > SC_FOLDLEVELBASE! // reset needed as level test is vs. SC_FOLDLEVELBASE else if (stylePrevCh != SCE_PL_DATASECTION) levelCurrent = SC_FOLDLEVELBASE; } } // package folding if (options.foldPackage && atLineStart) { if (IsPackageLine(lineCurrent, styler) && !IsPackageLine(lineCurrent + 1, styler)) isPackageLine = true; } //heredoc folding switch (style) { case SCE_PL_HERE_QQ : case SCE_PL_HERE_Q : case SCE_PL_HERE_QX : switch (stylePrevCh) { case SCE_PL_HERE_QQ : case SCE_PL_HERE_Q : case SCE_PL_HERE_QX : //do nothing; break; default : levelCurrent++; break; } break; default: switch (stylePrevCh) { case SCE_PL_HERE_QQ : case SCE_PL_HERE_Q : case SCE_PL_HERE_QX : levelCurrent--; break; default : //do nothing; break; } break; } //explicit folding if (options.foldCommentExplicit && style == SCE_PL_COMMENTLINE && ch == '#') { if (chNext == '{') { levelCurrent++; } else if (levelCurrent > SC_FOLDLEVELBASE && chNext == '}') { levelCurrent--; } } if (atEOL) { int lev = levelPrev; // POD headings occupy bits 7-4, leaving some breathing room for // non-standard practice -- POD sections stuck in blocks, etc. if (podHeading > 0) { levelCurrent = (lev & ~PERL_HEADFOLD_MASK) | (podHeading << PERL_HEADFOLD_SHIFT); lev = levelCurrent - 1; lev |= SC_FOLDLEVELHEADERFLAG; podHeading = 0; } // Check if line was a package declaration // because packages need "special" treatment if (isPackageLine) { lev = SC_FOLDLEVELBASE | SC_FOLDLEVELHEADERFLAG; levelCurrent = SC_FOLDLEVELBASE + 1; isPackageLine = false; } lev |= levelCurrent << 16; if (visibleChars == 0 && options.foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if ((levelCurrent > levelPrev) && (visibleChars > 0)) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelPrev = levelCurrent; visibleChars = 0; } if (!isspacechar(ch)) visibleChars++; chPrev = ch; } // Fill in the real level of the next line, keeping the current flags as they will be filled in later int flagsNext = styler.LevelAt(lineCurrent) & ~SC_FOLDLEVELNUMBERMASK; styler.SetLevel(lineCurrent, levelPrev | flagsNext); } } LexerModule lmPerl(SCLEX_PERL, LexerPerl::LexerFactoryPerl, "perl", perlWordListDesc); lexilla/lexers/LexCrontab.cxx0000664000175000017500000001613514647367374015274 0ustar neilneil// Scintilla source code edit control /** @file LexCrontab.cxx ** Lexer to use with extended crontab files used by a powerful ** Windows scheduler/event monitor/automation manager nnCron. ** (http://nemtsev.eserv.ru/) **/ // Copyright 1998-2001 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static void ColouriseNncrontabDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *keywordLists[], Accessor &styler) { int state = SCE_NNCRONTAB_DEFAULT; char chNext = styler[startPos]; Sci_Position lengthDoc = startPos + length; // create a buffer large enough to take the largest chunk... char *buffer = new char[length+1]; Sci_Position bufferCount = 0; // used when highliting environment variables inside quoted string: bool insideString = false; // this assumes that we have 3 keyword list in conf.properties WordList §ion = *keywordLists[0]; WordList &keyword = *keywordLists[1]; WordList &modifier = *keywordLists[2]; // go through all provided text segment // using the hand-written state machine shown below styler.StartAt(startPos); styler.StartSegment(startPos); for (Sci_Position i = startPos; i < lengthDoc; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); if (styler.IsLeadByte(ch)) { chNext = styler.SafeGetCharAt(i + 2); i++; continue; } switch(state) { case SCE_NNCRONTAB_DEFAULT: if( ch == '\n' || ch == '\r' || ch == '\t' || ch == ' ') { // whitespace is simply ignored here... styler.ColourTo(i,SCE_NNCRONTAB_DEFAULT); break; } else if( ch == '#' && styler.SafeGetCharAt(i+1) == '(') { // signals the start of a task... state = SCE_NNCRONTAB_TASK; styler.ColourTo(i,SCE_NNCRONTAB_TASK); } else if( ch == '\\' && (styler.SafeGetCharAt(i+1) == ' ' || styler.SafeGetCharAt(i+1) == '\t')) { // signals the start of an extended comment... state = SCE_NNCRONTAB_COMMENT; styler.ColourTo(i,SCE_NNCRONTAB_COMMENT); } else if( ch == '#' ) { // signals the start of a plain comment... state = SCE_NNCRONTAB_COMMENT; styler.ColourTo(i,SCE_NNCRONTAB_COMMENT); } else if( ch == ')' && styler.SafeGetCharAt(i+1) == '#') { // signals the end of a task... state = SCE_NNCRONTAB_TASK; styler.ColourTo(i,SCE_NNCRONTAB_TASK); } else if( ch == '"') { state = SCE_NNCRONTAB_STRING; styler.ColourTo(i,SCE_NNCRONTAB_STRING); } else if( ch == '%') { // signals environment variables state = SCE_NNCRONTAB_ENVIRONMENT; styler.ColourTo(i,SCE_NNCRONTAB_ENVIRONMENT); } else if( ch == '<' && styler.SafeGetCharAt(i+1) == '%') { // signals environment variables state = SCE_NNCRONTAB_ENVIRONMENT; styler.ColourTo(i,SCE_NNCRONTAB_ENVIRONMENT); } else if( ch == '*' ) { // signals an asterisk // no state jump necessary for this simple case... styler.ColourTo(i,SCE_NNCRONTAB_ASTERISK); } else if( (IsASCII(ch) && isalpha(ch)) || ch == '<' ) { // signals the start of an identifier bufferCount = 0; buffer[bufferCount++] = ch; state = SCE_NNCRONTAB_IDENTIFIER; } else if( IsASCII(ch) && isdigit(ch) ) { // signals the start of a number bufferCount = 0; buffer[bufferCount++] = ch; state = SCE_NNCRONTAB_NUMBER; } else { // style it the default style.. styler.ColourTo(i,SCE_NNCRONTAB_DEFAULT); } break; case SCE_NNCRONTAB_COMMENT: // if we find a newline here, // we simply go to default state // else continue to work on it... if( ch == '\n' || ch == '\r' ) { state = SCE_NNCRONTAB_DEFAULT; } else { styler.ColourTo(i,SCE_NNCRONTAB_COMMENT); } break; case SCE_NNCRONTAB_TASK: // if we find a newline here, // we simply go to default state // else continue to work on it... if( ch == '\n' || ch == '\r' ) { state = SCE_NNCRONTAB_DEFAULT; } else { styler.ColourTo(i,SCE_NNCRONTAB_TASK); } break; case SCE_NNCRONTAB_STRING: if( ch == '%' ) { state = SCE_NNCRONTAB_ENVIRONMENT; insideString = true; styler.ColourTo(i-1,SCE_NNCRONTAB_STRING); break; } // if we find the end of a string char, we simply go to default state // else we're still dealing with an string... if( (ch == '"' && styler.SafeGetCharAt(i-1)!='\\') || (ch == '\n') || (ch == '\r') ) { state = SCE_NNCRONTAB_DEFAULT; } styler.ColourTo(i,SCE_NNCRONTAB_STRING); break; case SCE_NNCRONTAB_ENVIRONMENT: // if we find the end of a string char, we simply go to default state // else we're still dealing with an string... if( ch == '%' && insideString ) { state = SCE_NNCRONTAB_STRING; insideString = false; break; } if( (ch == '%' && styler.SafeGetCharAt(i-1)!='\\') || (ch == '\n') || (ch == '\r') || (ch == '>') ) { state = SCE_NNCRONTAB_DEFAULT; styler.ColourTo(i,SCE_NNCRONTAB_ENVIRONMENT); break; } styler.ColourTo(i+1,SCE_NNCRONTAB_ENVIRONMENT); break; case SCE_NNCRONTAB_IDENTIFIER: // stay in CONF_IDENTIFIER state until we find a non-alphanumeric if( (IsASCII(ch) && isalnum(ch)) || (ch == '_') || (ch == '-') || (ch == '/') || (ch == '$') || (ch == '.') || (ch == '<') || (ch == '>') || (ch == '@') ) { buffer[bufferCount++] = ch; } else { state = SCE_NNCRONTAB_DEFAULT; buffer[bufferCount] = '\0'; // check if the buffer contains a keyword, // and highlight it if it is a keyword... if(section.InList(buffer)) { styler.ColourTo(i,SCE_NNCRONTAB_SECTION ); } else if(keyword.InList(buffer)) { styler.ColourTo(i-1,SCE_NNCRONTAB_KEYWORD ); } // else if(strchr(buffer,'/') || strchr(buffer,'.')) { // styler.ColourTo(i-1,SCE_NNCRONTAB_EXTENSION); // } else if(modifier.InList(buffer)) { styler.ColourTo(i-1,SCE_NNCRONTAB_MODIFIER ); } else { styler.ColourTo(i-1,SCE_NNCRONTAB_DEFAULT); } // push back the faulty character chNext = styler[i--]; } break; case SCE_NNCRONTAB_NUMBER: // stay in CONF_NUMBER state until we find a non-numeric if( IsASCII(ch) && isdigit(ch) /* || ch == '.' */ ) { buffer[bufferCount++] = ch; } else { state = SCE_NNCRONTAB_DEFAULT; buffer[bufferCount] = '\0'; // Colourize here... (normal number) styler.ColourTo(i-1,SCE_NNCRONTAB_NUMBER); // push back a character chNext = styler[i--]; } break; } } delete []buffer; } static const char * const cronWordListDesc[] = { "Section keywords and Forth words", "nnCrontab keywords", "Modifiers", 0 }; LexerModule lmNncrontab(SCLEX_NNCRONTAB, ColouriseNncrontabDoc, "nncrontab", 0, cronWordListDesc); lexilla/lexers/LexPowerShell.cxx0000664000175000017500000002120314647367374015760 0ustar neilneil// Scintilla source code edit control /** @file LexPowerShell.cxx ** Lexer for PowerShell scripts. **/ // Copyright 2008 by Tim Gerundt // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; // Extended to accept accented characters static inline bool IsAWordChar(int ch) noexcept { return ch >= 0x80 || isalnum(ch) || ch == '-' || ch == '_'; } static bool IsNumericLiteral(int chPrev, int ch, int chNext) { // integers if (ch >= '0' && ch <= '9') { return true; } // hex 0x or a-f if ((ch == 'x' && chPrev == '0') || (ch >= 'a' && ch <= 'f')) { return true; } // decimal point if (ch == '.' && chNext != '.') { return true; } // optional -/+ sign after exponent if ((ch == '+' || ch == '-') && chPrev == 'e') { return true; } // suffix switch (ch) { //case 'b': see hex case 'g': case 'k': case 'l': case 'm': case 'n': case 'p': case 's': case 't': case 'u': case 'y': return true; } return false; } static void ColourisePowerShellDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { const WordList &keywords = *keywordlists[0]; const WordList &keywords2 = *keywordlists[1]; const WordList &keywords3 = *keywordlists[2]; const WordList &keywords4 = *keywordlists[3]; const WordList &keywords5 = *keywordlists[4]; const WordList &keywords6 = *keywordlists[5]; styler.StartAt(startPos); StyleContext sc(startPos, length, initStyle, styler); for (; sc.More(); sc.Forward()) { if (sc.state == SCE_POWERSHELL_COMMENT) { if (sc.MatchLineEnd()) { sc.SetState(SCE_POWERSHELL_DEFAULT); } } else if (sc.state == SCE_POWERSHELL_COMMENTSTREAM) { if (sc.atLineStart) { while (IsASpaceOrTab(sc.ch)) { sc.Forward(); } if (sc.ch == '.' && IsAWordChar(sc.chNext)) { sc.SetState(SCE_POWERSHELL_COMMENTDOCKEYWORD); } } if (sc.ch == '>' && sc.chPrev == '#') { sc.ForwardSetState(SCE_POWERSHELL_DEFAULT); } } else if (sc.state == SCE_POWERSHELL_COMMENTDOCKEYWORD) { if (!IsAWordChar(sc.ch)) { char s[100]; sc.GetCurrentLowered(s, sizeof(s)); if (!keywords6.InList(s + 1)) { sc.ChangeState(SCE_POWERSHELL_COMMENTSTREAM); } sc.SetState(SCE_POWERSHELL_COMMENTSTREAM); } } else if (sc.state == SCE_POWERSHELL_STRING) { // This is a doubles quotes string if (sc.ch == '\"') { sc.ForwardSetState(SCE_POWERSHELL_DEFAULT); } else if (sc.ch == '`') { sc.Forward(); // skip next escaped character } } else if (sc.state == SCE_POWERSHELL_CHARACTER) { // This is a single quote string if (sc.ch == '\'') { sc.ForwardSetState(SCE_POWERSHELL_DEFAULT); } } else if (sc.state == SCE_POWERSHELL_HERE_STRING) { // This is a doubles quotes here-string if (sc.atLineStart && sc.ch == '\"' && sc.chNext == '@') { sc.Forward(2); sc.SetState(SCE_POWERSHELL_DEFAULT); } } else if (sc.state == SCE_POWERSHELL_HERE_CHARACTER) { // This is a single quote here-string if (sc.atLineStart && sc.ch == '\'' && sc.chNext == '@') { sc.Forward(2); sc.SetState(SCE_POWERSHELL_DEFAULT); } } else if (sc.state == SCE_POWERSHELL_NUMBER) { if (!IsNumericLiteral(MakeLowerCase(sc.chPrev), MakeLowerCase(sc.ch), MakeLowerCase(sc.chNext))) { if (sc.MatchLineEnd() || IsASpaceOrTab(sc.ch) || isoperator(sc.ch)) { sc.SetState(SCE_POWERSHELL_DEFAULT); } else { sc.ChangeState(SCE_POWERSHELL_IDENTIFIER); } } } else if (sc.state == SCE_POWERSHELL_VARIABLE) { if (!IsAWordChar(sc.ch)) { sc.SetState(SCE_POWERSHELL_DEFAULT); } } else if (sc.state == SCE_POWERSHELL_OPERATOR) { if (!isoperator(sc.ch)) { sc.SetState(SCE_POWERSHELL_DEFAULT); } } else if (sc.state == SCE_POWERSHELL_IDENTIFIER) { if (!IsAWordChar(sc.ch)) { char s[100]; sc.GetCurrentLowered(s, sizeof(s)); if (keywords.InList(s)) { sc.ChangeState(SCE_POWERSHELL_KEYWORD); } else if (keywords2.InList(s)) { sc.ChangeState(SCE_POWERSHELL_CMDLET); } else if (keywords3.InList(s)) { sc.ChangeState(SCE_POWERSHELL_ALIAS); } else if (keywords4.InList(s)) { sc.ChangeState(SCE_POWERSHELL_FUNCTION); } else if (keywords5.InList(s)) { sc.ChangeState(SCE_POWERSHELL_USER1); } sc.SetState(SCE_POWERSHELL_DEFAULT); } } // Determine if a new state should be entered. if (sc.state == SCE_POWERSHELL_DEFAULT) { if (sc.ch == '#') { sc.SetState(SCE_POWERSHELL_COMMENT); } else if (sc.ch == '<' && sc.chNext == '#') { sc.SetState(SCE_POWERSHELL_COMMENTSTREAM); } else if (sc.ch == '\"') { sc.SetState(SCE_POWERSHELL_STRING); } else if (sc.ch == '\'') { sc.SetState(SCE_POWERSHELL_CHARACTER); } else if (sc.ch == '@' && sc.chNext == '\"') { sc.SetState(SCE_POWERSHELL_HERE_STRING); } else if (sc.ch == '@' && sc.chNext == '\'') { sc.SetState(SCE_POWERSHELL_HERE_CHARACTER); } else if (sc.ch == '$') { sc.SetState(SCE_POWERSHELL_VARIABLE); } else if (IsADigit(sc.ch) || (sc.chPrev != '.' && sc.ch == '.' && IsADigit(sc.chNext))) { sc.SetState(SCE_POWERSHELL_NUMBER); } else if (isoperator(sc.ch)) { sc.SetState(SCE_POWERSHELL_OPERATOR); } else if (IsAWordChar(sc.ch)) { sc.SetState(SCE_POWERSHELL_IDENTIFIER); } else if (sc.ch == '`') { sc.Forward(); // skip next escaped character } } } sc.Complete(); } // Store both the current line's fold level and the next lines in the // level store to make it easy to pick up with each increment // and to make it possible to fiddle the current level for "} else {". static void FoldPowerShellDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *[], Accessor &styler) { const bool foldComment = styler.GetPropertyInt("fold.comment") != 0; const bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; const bool foldAtElse = styler.GetPropertyInt("fold.at.else", 0) != 0; const Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelCurrent = SC_FOLDLEVELBASE; if (lineCurrent > 0) levelCurrent = styler.LevelAt(lineCurrent-1) >> 16; int levelMinCurrent = levelCurrent; int levelNext = levelCurrent; char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); int style = initStyle; for (Sci_PositionU i = startPos; i < endPos; i++) { const char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); const int stylePrev = style; style = styleNext; styleNext = styler.StyleAt(i + 1); const bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (style == SCE_POWERSHELL_OPERATOR) { if (ch == '{') { // Measure the minimum before a '{' to allow // folding on "} else {" if (levelMinCurrent > levelNext) { levelMinCurrent = levelNext; } levelNext++; } else if (ch == '}') { levelNext--; } } else if (foldComment && style == SCE_POWERSHELL_COMMENTSTREAM) { if (stylePrev != SCE_POWERSHELL_COMMENTSTREAM && stylePrev != SCE_POWERSHELL_COMMENTDOCKEYWORD) { levelNext++; } else if (styleNext != SCE_POWERSHELL_COMMENTSTREAM && styleNext != SCE_POWERSHELL_COMMENTDOCKEYWORD) { levelNext--; } } else if (foldComment && style == SCE_POWERSHELL_COMMENT) { if (ch == '#') { Sci_PositionU j = i + 1; while ((j < endPos) && IsASpaceOrTab(styler.SafeGetCharAt(j))) { j++; } if (styler.Match(j, "region")) { levelNext++; } else if (styler.Match(j, "endregion")) { levelNext--; } } } if (!IsASpace(ch)) visibleChars++; if (atEOL || (i == endPos-1)) { int levelUse = levelCurrent; if (foldAtElse) { levelUse = levelMinCurrent; } int lev = levelUse | levelNext << 16; if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if (levelUse < levelNext) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelCurrent = levelNext; levelMinCurrent = levelCurrent; visibleChars = 0; } } } static const char *const powershellWordLists[] = { "Commands", "Cmdlets", "Aliases", "Functions", "User1", "DocComment", 0 }; LexerModule lmPowerShell(SCLEX_POWERSHELL, ColourisePowerShellDoc, "powershell", FoldPowerShellDoc, powershellWordLists); lexilla/lexers/LexGui4Cli.cxx0000664000175000017500000002141014647367374015134 0ustar neilneil// Scintilla source code edit control // Copyright 1998-2002 by Neil Hodgson // @file LexGui4Cli.cxx /* This is the Lexer for Gui4Cli, included in SciLexer.dll - by d. Keletsekis, 2/10/2003 To add to SciLexer.dll: 1. Add the values below to INCLUDE\Scintilla.iface 2. Run the scripts/HFacer.py script 3. Run the scripts/LexGen.py script val SCE_GC_DEFAULT=0 val SCE_GC_COMMENTLINE=1 val SCE_GC_COMMENTBLOCK=2 val SCE_GC_GLOBAL=3 val SCE_GC_EVENT=4 val SCE_GC_ATTRIBUTE=5 val SCE_GC_CONTROL=6 val SCE_GC_COMMAND=7 val SCE_GC_STRING=8 val SCE_GC_OPERATOR=9 */ #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; #define debug Platform::DebugPrintf static inline bool IsAWordChar(const int ch) { return (ch < 0x80) && (isalnum(ch) || ch == '.' || ch == '_' || ch =='\\'); } inline bool isGCOperator(int ch) { if (isalnum(ch)) return false; // '.' left out as it is used to make up numbers if (ch == '*' || ch == '/' || ch == '-' || ch == '+' || ch == '(' || ch == ')' || ch == '=' || ch == '%' || ch == '[' || ch == ']' || ch == '<' || ch == '>' || ch == ',' || ch == ';' || ch == ':') return true; return false; } #define isSpace(x) ((x)==' ' || (x)=='\t') #define isNL(x) ((x)=='\n' || (x)=='\r') #define isSpaceOrNL(x) (isSpace(x) || isNL(x)) #define BUFFSIZE 500 #define isFoldPoint(x) ((styler.LevelAt(x) & SC_FOLDLEVELNUMBERMASK) == 1024) static void colorFirstWord(WordList *keywordlists[], Accessor &styler, StyleContext *sc, char *buff, Sci_Position length, Sci_Position) { Sci_Position c = 0; while (sc->More() && isSpaceOrNL(sc->ch)) { sc->Forward(); } styler.ColourTo(sc->currentPos - 1, sc->state); if (!IsAWordChar(sc->ch)) // comment, marker, etc.. return; while (sc->More() && !isSpaceOrNL(sc->ch) && (c < length-1) && !isGCOperator(sc->ch)) { buff[c] = static_cast(sc->ch); ++c; sc->Forward(); } buff[c] = '\0'; char *p = buff; while (*p) // capitalize.. { if (islower(*p)) *p = static_cast(toupper(*p)); ++p; } WordList &kGlobal = *keywordlists[0]; // keyword lists set by the user WordList &kEvent = *keywordlists[1]; WordList &kAttribute = *keywordlists[2]; WordList &kControl = *keywordlists[3]; WordList &kCommand = *keywordlists[4]; int state = 0; // int level = styler.LevelAt(line) & SC_FOLDLEVELNUMBERMASK; // debug ("line = %d, level = %d", line, level); if (kGlobal.InList(buff)) state = SCE_GC_GLOBAL; else if (kAttribute.InList(buff)) state = SCE_GC_ATTRIBUTE; else if (kControl.InList(buff)) state = SCE_GC_CONTROL; else if (kCommand.InList(buff)) state = SCE_GC_COMMAND; else if (kEvent.InList(buff)) state = SCE_GC_EVENT; if (state) { sc->ChangeState(state); styler.ColourTo(sc->currentPos - 1, sc->state); sc->ChangeState(SCE_GC_DEFAULT); } else { sc->ChangeState(SCE_GC_DEFAULT); styler.ColourTo(sc->currentPos - 1, sc->state); } } // Main colorizing function called by Scintilla static void ColouriseGui4CliDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { styler.StartAt(startPos); Sci_Position currentline = styler.GetLine(startPos); int quotestart = 0, oldstate; styler.StartSegment(startPos); bool noforward; char buff[BUFFSIZE+1]; // buffer for command name StyleContext sc(startPos, length, initStyle, styler); buff[0] = '\0'; // cbuff = 0; if (sc.state != SCE_GC_COMMENTBLOCK) // colorize 1st word.. colorFirstWord(keywordlists, styler, &sc, buff, BUFFSIZE, currentline); while (sc.More()) { noforward = 0; switch (sc.ch) { case '/': if (sc.state == SCE_GC_COMMENTBLOCK || sc.state == SCE_GC_STRING) break; if (sc.chNext == '/') // line comment { sc.SetState (SCE_GC_COMMENTLINE); sc.Forward(); styler.ColourTo(sc.currentPos, sc.state); } else if (sc.chNext == '*') // block comment { sc.SetState(SCE_GC_COMMENTBLOCK); sc.Forward(); styler.ColourTo(sc.currentPos, sc.state); } else styler.ColourTo(sc.currentPos, sc.state); break; case '*': // end of comment block, or operator.. if (sc.state == SCE_GC_STRING) break; if (sc.state == SCE_GC_COMMENTBLOCK && sc.chNext == '/') { sc.Forward(); styler.ColourTo(sc.currentPos, sc.state); sc.ChangeState (SCE_GC_DEFAULT); } else styler.ColourTo(sc.currentPos, sc.state); break; case '\'': case '\"': // strings.. if (sc.state == SCE_GC_COMMENTBLOCK || sc.state == SCE_GC_COMMENTLINE) break; if (sc.state == SCE_GC_STRING) { if (sc.ch == quotestart) // match same quote char.. { styler.ColourTo(sc.currentPos, sc.state); sc.ChangeState(SCE_GC_DEFAULT); quotestart = 0; } } else { styler.ColourTo(sc.currentPos - 1, sc.state); sc.ChangeState(SCE_GC_STRING); quotestart = sc.ch; } break; case ';': // end of commandline character if (sc.state != SCE_GC_COMMENTBLOCK && sc.state != SCE_GC_COMMENTLINE && sc.state != SCE_GC_STRING) { styler.ColourTo(sc.currentPos - 1, sc.state); styler.ColourTo(sc.currentPos, SCE_GC_OPERATOR); sc.ChangeState(SCE_GC_DEFAULT); sc.Forward(); colorFirstWord(keywordlists, styler, &sc, buff, BUFFSIZE, currentline); noforward = 1; // don't move forward - already positioned at next char.. } break; case '+': case '-': case '=': case '!': // operators.. case '<': case '>': case '&': case '|': case '$': if (sc.state != SCE_GC_COMMENTBLOCK && sc.state != SCE_GC_COMMENTLINE && sc.state != SCE_GC_STRING) { styler.ColourTo(sc.currentPos - 1, sc.state); styler.ColourTo(sc.currentPos, SCE_GC_OPERATOR); sc.ChangeState(SCE_GC_DEFAULT); } break; case '\\': // escape - same as operator, but also mark in strings.. if (sc.state != SCE_GC_COMMENTBLOCK && sc.state != SCE_GC_COMMENTLINE) { oldstate = sc.state; styler.ColourTo(sc.currentPos - 1, sc.state); sc.Forward(); // mark also the next char.. styler.ColourTo(sc.currentPos, SCE_GC_OPERATOR); sc.ChangeState(oldstate); } break; case '\n': case '\r': ++currentline; if (sc.state == SCE_GC_COMMENTLINE) { styler.ColourTo(sc.currentPos, sc.state); sc.ChangeState (SCE_GC_DEFAULT); } else if (sc.state != SCE_GC_COMMENTBLOCK) { colorFirstWord(keywordlists, styler, &sc, buff, BUFFSIZE, currentline); noforward = 1; // don't move forward - already positioned at next char.. } break; // case ' ': case '\t': // default : } if (!noforward) sc.Forward(); } sc.Complete(); } // Main folding function called by Scintilla - (based on props (.ini) files function) static void FoldGui4Cli(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); bool headerPoint = false; for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler[i+1]; int style = styleNext; styleNext = styler.StyleAt(i + 1); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (style == SCE_GC_EVENT || style == SCE_GC_GLOBAL) { headerPoint = true; // fold at events and globals } if (atEOL) { int lev = SC_FOLDLEVELBASE+1; if (headerPoint) lev = SC_FOLDLEVELBASE; if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if (headerPoint) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) // set level, if not already correct { styler.SetLevel(lineCurrent, lev); } lineCurrent++; // re-initialize our flags visibleChars = 0; headerPoint = false; } if (!(isspacechar(ch))) // || (style == SCE_GC_COMMENTLINE) || (style != SCE_GC_COMMENTBLOCK))) visibleChars++; } int lev = headerPoint ? SC_FOLDLEVELBASE : SC_FOLDLEVELBASE+1; int flagsNext = styler.LevelAt(lineCurrent) & ~SC_FOLDLEVELNUMBERMASK; styler.SetLevel(lineCurrent, lev | flagsNext); } // I have no idea what these are for.. probably accessible by some message. static const char * const gui4cliWordListDesc[] = { "Globals", "Events", "Attributes", "Control", "Commands", 0 }; // Declare language & pass our function pointers to Scintilla LexerModule lmGui4Cli(SCLEX_GUI4CLI, ColouriseGui4CliDoc, "gui4cli", FoldGui4Cli, gui4cliWordListDesc); #undef debug lexilla/lexers/LexFSharp.cxx0000664000175000017500000006115214647367374015066 0ustar neilneil/** * @file LexFSharp.cxx * Lexer for F# 5.0 * Copyright (c) 2021 Robert Di Pardo * Parts of LexerFSharp::Lex were adapted from LexCaml.cxx by Robert Roessler ("RR"). * Parts of LexerFSharp::Fold were adapted from LexCPP.cxx by Neil Hodgson and Udo Lechner. * The License.txt file describes the conditions under which this software may be distributed. */ // clang-format off #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" #include "OptionSet.h" #include "DefaultLexer.h" // clang-format on using namespace Scintilla; using namespace Lexilla; static const char *const lexerName = "fsharp"; static constexpr int WORDLIST_SIZE = 5; static const char *const fsharpWordLists[] = { "standard language keywords", "core functions, including those in the FSharp.Collections namespace", "built-in types, core namespaces, modules", "optional", "optional", nullptr, }; static constexpr int keywordClasses[] = { SCE_FSHARP_KEYWORD, SCE_FSHARP_KEYWORD2, SCE_FSHARP_KEYWORD3, SCE_FSHARP_KEYWORD4, SCE_FSHARP_KEYWORD5, }; namespace { struct OptionsFSharp { bool fold = true; bool foldCompact = true; bool foldComment = true; bool foldCommentStream = true; bool foldCommentMultiLine = true; bool foldPreprocessor = false; bool foldImports = true; }; struct OptionSetFSharp : public OptionSet { OptionSetFSharp() { DefineProperty("fold", &OptionsFSharp::fold); DefineProperty("fold.compact", &OptionsFSharp::foldCompact); DefineProperty("fold.comment", &OptionsFSharp::foldComment, "Setting this option to 0 disables comment folding in F# files."); DefineProperty("fold.fsharp.comment.stream", &OptionsFSharp::foldCommentStream, "Setting this option to 0 disables folding of ML-style comments in F# files when " "fold.comment=1."); DefineProperty("fold.fsharp.comment.multiline", &OptionsFSharp::foldCommentMultiLine, "Setting this option to 0 disables folding of grouped line comments in F# files when " "fold.comment=1."); DefineProperty("fold.fsharp.preprocessor", &OptionsFSharp::foldPreprocessor, "Setting this option to 1 enables folding of F# compiler directives."); DefineProperty("fold.fsharp.imports", &OptionsFSharp::foldImports, "Setting this option to 0 disables folding of F# import declarations."); DefineWordListSets(fsharpWordLists); } }; struct FSharpString { Sci_Position startPos = INVALID_POSITION; int startChar = '"', nextChar = '\0'; constexpr bool HasLength() const { return startPos > INVALID_POSITION; } constexpr bool CanInterpolate() const { return startChar == '$' || (startChar == '@' && nextChar == '$'); } constexpr bool IsVerbatim() const { return startChar == '@' || (startChar == '$' && nextChar == '@'); } }; class UnicodeChar { enum class Notation { none, asciiDec, asciiHex, utf16, utf32 }; Notation type = Notation::none; // single-byte Unicode char (000 - 255) int asciiDigits[3] = { 0 }; int maxDigit = '9'; int toEnd = 0; bool invalid = false; public: UnicodeChar() noexcept = default; explicit UnicodeChar(const int prefix) { if (IsADigit(prefix)) { *asciiDigits = prefix; if (*asciiDigits >= '0' && *asciiDigits <= '2') { type = Notation::asciiDec; // count first digit as "prefix" toEnd = 2; } } else if (prefix == 'x' || prefix == 'u' || prefix == 'U') { switch (prefix) { case 'x': type = Notation::asciiHex; toEnd = 2; break; case 'u': type = Notation::utf16; toEnd = 4; break; case 'U': type = Notation::utf32; toEnd = 8; break; } } } void Parse(const int ch) { invalid = false; switch (type) { case Notation::asciiDec: { maxDigit = (*asciiDigits < '2') ? '9' : (asciiDigits[1] <= '4') ? '9' : '5'; if (IsADigit(ch) && asciiDigits[1] <= maxDigit && ch <= maxDigit) { asciiDigits[1] = ch; toEnd--; } else { invalid = true; } break; } case Notation::asciiHex: case Notation::utf16: if (IsADigit(ch, 16)) { toEnd--; } else { invalid = true; } break; case Notation::utf32: if ((toEnd > 6 && ch == '0') || (toEnd <= 6 && IsADigit(ch, 16))) { toEnd--; } else { invalid = true; } break; case Notation::none: break; } } constexpr bool AtEnd() noexcept { return invalid || type == Notation::none || (type != Notation::none && toEnd < 0); } }; inline bool MatchStreamCommentStart(StyleContext &cxt) { // match (* ... *), but allow point-free usage of the `*` operator, // e.g. List.fold (*) 1 [ 1; 2; 3 ] return (cxt.Match('(', '*') && cxt.GetRelative(2) != ')'); } inline bool MatchStreamCommentEnd(const StyleContext &cxt) { return (cxt.ch == ')' && cxt.chPrev == '*'); } inline bool MatchLineComment(const StyleContext &cxt) { // style shebang lines as comments in F# scripts: // https://fsharp.org/specs/language-spec/4.1/FSharpSpec-4.1-latest.pdf#page=30&zoom=auto,-98,537 return cxt.Match('/', '/') || cxt.Match('#', '!'); } inline bool MatchLineNumberStart(StyleContext &cxt) { return cxt.atLineStart && (cxt.MatchIgnoreCase("#line") || (cxt.ch == '#' && (IsADigit(cxt.chNext) || IsADigit(cxt.GetRelative(2))))); } inline bool MatchPPDirectiveStart(const StyleContext &cxt) { return (cxt.atLineStart && cxt.ch == '#' && iswordstart(cxt.chNext)); } inline bool MatchTypeAttributeStart(const StyleContext &cxt) { return cxt.Match('[', '<'); } inline bool MatchTypeAttributeEnd(const StyleContext &cxt) { return (cxt.ch == ']' && cxt.chPrev == '>'); } inline bool MatchQuotedExpressionStart(const StyleContext &cxt) { return cxt.Match('<', '@'); } inline bool MatchQuotedExpressionEnd(const StyleContext &cxt) { return (cxt.ch == '>' && cxt.chPrev == '@'); } inline bool MatchStringStart(StyleContext &cxt) { return (cxt.ch == '"' || cxt.Match("@\"") || cxt.Match("$\"") || cxt.Match("@$\"") || cxt.Match("$@\"") || cxt.Match("``")); } inline bool FollowsEscapedBackslash(StyleContext &cxt) { int count = 0; for (Sci_Position offset = 1; cxt.GetRelative(-offset) == '\\'; offset++) count++; return count % 2 != 0; } inline bool MatchStringEnd(StyleContext &cxt, const FSharpString &fsStr) { return (fsStr.HasLength() && // end of quoted identifier? ((cxt.ch == '`' && cxt.chPrev == '`') || // end of literal or interpolated triple-quoted string? ((fsStr.startChar == '"' || (fsStr.CanInterpolate() && !(fsStr.IsVerbatim() || cxt.chPrev == '$'))) && cxt.MatchIgnoreCase("\"\"\"")) || // end of verbatim string? (fsStr.IsVerbatim() && // embedded quotes must be in pairs cxt.ch == '"' && cxt.chNext != '"' && (cxt.chPrev != '"' || // empty verbatim string? ((cxt.GetRelative(-2) == '@' || cxt.GetRelative(-2) == '$') || // pair of quotes at end of string? (cxt.GetRelative(-2) == '"' && !(cxt.GetRelative(-3) == '@' || cxt.GetRelative(-3) == '$'))))))) || (!fsStr.HasLength() && cxt.ch == '"' && ((cxt.chPrev != '\\' || (cxt.GetRelative(-2) == '\\' && !FollowsEscapedBackslash(cxt))) || // treat backslashes as char literals in verbatim strings (fsStr.IsVerbatim() && cxt.chPrev == '\\'))); } inline bool MatchCharacterStart(StyleContext &cxt) { // don't style generic type parameters: 'a, 'b, 'T, etc. return (cxt.ch == '\'' && !(cxt.chPrev == ':' || cxt.GetRelative(-2) == ':')); } inline bool CanEmbedQuotes(StyleContext &cxt) { // allow unescaped double quotes inside literal or interpolated triple-quoted strings, verbatim strings, // and quoted identifiers: // - https://docs.microsoft.com/en-us/dotnet/fsharp/language-reference/strings // - https://docs.microsoft.com/en-us/dotnet/fsharp/language-reference/interpolated-strings#syntax // - https://fsharp.org/specs/language-spec/4.1/FSharpSpec-4.1-latest.pdf#page=25&zoom=auto,-98,600 return cxt.Match("$\"\"\"") || cxt.Match("\"\"\"") || cxt.Match("@$\"\"\"") || cxt.Match("$@\"\"\"") || cxt.Match('@', '"') || cxt.Match('`', '`'); } inline bool IsLineEnd(StyleContext &cxt, const Sci_Position offset) { const int ch = cxt.GetRelative(offset, '\n'); return (ch == '\r' || ch == '\n'); } class LexerFSharp : public DefaultLexer { WordList keywords[WORDLIST_SIZE]; OptionsFSharp options; OptionSetFSharp optionSet; CharacterSet setOperators; CharacterSet setFormatSpecs; CharacterSet setDotNetFormatSpecs; CharacterSet setFormatFlags; CharacterSet numericMetaChars1; CharacterSet numericMetaChars2; std::map numericPrefixes = { { 'b', 2 }, { 'o', 8 }, { 'x', 16 } }; public: explicit LexerFSharp() : DefaultLexer(lexerName, SCLEX_FSHARP), setOperators(CharacterSet::setNone, "~^'-+*/%=@|&<>()[]{};,:!?"), setFormatSpecs(CharacterSet::setNone, ".%aAbBcdeEfFgGiMoOstuxX0123456789"), setDotNetFormatSpecs(CharacterSet::setNone, "cCdDeEfFgGnNpPxX"), setFormatFlags(CharacterSet::setNone, ".-+0 "), numericMetaChars1(CharacterSet::setNone, "_uU"), numericMetaChars2(CharacterSet::setNone, "fFIlLmMnsy") { } LexerFSharp(const LexerFSharp &) = delete; LexerFSharp(LexerFSharp &&) = delete; LexerFSharp &operator=(const LexerFSharp &) = delete; LexerFSharp &operator=(LexerFSharp &&) = delete; static ILexer5 *LexerFactoryFSharp() { return new LexerFSharp(); } virtual ~LexerFSharp() { } void SCI_METHOD Release() noexcept override { delete this; } int SCI_METHOD Version() const noexcept override { return lvRelease5; } const char *SCI_METHOD GetName() noexcept override { return lexerName; } int SCI_METHOD GetIdentifier() noexcept override { return SCLEX_FSHARP; } int SCI_METHOD LineEndTypesSupported() noexcept override { return SC_LINE_END_TYPE_DEFAULT; } void *SCI_METHOD PrivateCall(int, void *) noexcept override { return nullptr; } const char *SCI_METHOD DescribeWordListSets() override { return optionSet.DescribeWordListSets(); } const char *SCI_METHOD PropertyNames() override { return optionSet.PropertyNames(); } int SCI_METHOD PropertyType(const char *name) override { return optionSet.PropertyType(name); } const char *SCI_METHOD DescribeProperty(const char *name) override { return optionSet.DescribeProperty(name); } const char *SCI_METHOD PropertyGet(const char *key) override { return optionSet.PropertyGet(key); } Sci_Position SCI_METHOD PropertySet(const char *key, const char *val) override { if (optionSet.PropertySet(&options, key, val)) { return 0; } return INVALID_POSITION; } Sci_Position SCI_METHOD WordListSet(int n, const char *wl) override; void SCI_METHOD Lex(Sci_PositionU start, Sci_Position length, int initStyle, IDocument *pAccess) override; void SCI_METHOD Fold(Sci_PositionU start, Sci_Position length, int initStyle,IDocument *pAccess) override; private: inline bool IsNumber(StyleContext &cxt, const int base = 10) { return IsADigit(cxt.ch, base) || (IsADigit(cxt.chPrev, base) && numericMetaChars1.Contains(cxt.ch)) || (IsADigit(cxt.GetRelative(-2), base) && numericMetaChars2.Contains(cxt.ch)); } inline bool IsFloat(StyleContext &cxt) { if (cxt.MatchIgnoreCase("e+") || cxt.MatchIgnoreCase("e-")) { cxt.Forward(); return true; } return ((cxt.chPrev == '.' && IsADigit(cxt.ch)) || (IsADigit(cxt.chPrev) && (cxt.ch == '.' || numericMetaChars2.Contains(cxt.ch)))); } }; Sci_Position SCI_METHOD LexerFSharp::WordListSet(int n, const char *wl) { WordList *wordListN = nullptr; Sci_Position firstModification = INVALID_POSITION; if (n < WORDLIST_SIZE) { wordListN = &keywords[n]; } if (wordListN && wordListN->Set(wl)) { firstModification = 0; } return firstModification; } void SCI_METHOD LexerFSharp::Lex(Sci_PositionU start, Sci_Position length, int initStyle, IDocument *pAccess) { LexAccessor styler(pAccess); StyleContext sc(start, static_cast(length), initStyle, styler); Sci_Position lineCurrent = styler.GetLine(static_cast(start)); Sci_PositionU cursor = 0; UnicodeChar uniCh = UnicodeChar(); FSharpString fsStr = FSharpString(); constexpr Sci_Position MAX_WORD_LEN = 64; constexpr int SPACE = ' '; int currentBase = 10; int levelNesting = (lineCurrent >= 1) ? styler.GetLineState(lineCurrent - 1) : 0; bool isInterpolated = false; while (sc.More()) { Sci_PositionU colorSpan = sc.currentPos - 1; int state = -1; bool advance = true; switch (sc.state & 0xff) { case SCE_FSHARP_DEFAULT: cursor = sc.currentPos; if (MatchLineNumberStart(sc)) { state = SCE_FSHARP_LINENUM; } else if (MatchPPDirectiveStart(sc)) { state = SCE_FSHARP_PREPROCESSOR; } else if (MatchLineComment(sc)) { state = SCE_FSHARP_COMMENTLINE; sc.Forward(); sc.ch = SPACE; } else if (MatchStreamCommentStart(sc)) { state = SCE_FSHARP_COMMENT; sc.Forward(); sc.ch = SPACE; } else if (MatchTypeAttributeStart(sc)) { state = SCE_FSHARP_ATTRIBUTE; sc.Forward(); } else if (MatchQuotedExpressionStart(sc)) { state = SCE_FSHARP_QUOTATION; sc.Forward(); } else if (MatchCharacterStart(sc)) { state = SCE_FSHARP_CHARACTER; } else if (MatchStringStart(sc)) { fsStr.startChar = sc.ch; fsStr.nextChar = sc.chNext; fsStr.startPos = INVALID_POSITION; if (CanEmbedQuotes(sc)) { // double quotes after this position should be non-terminating fsStr.startPos = static_cast(sc.currentPos - cursor); } if (sc.ch == '`') { state = SCE_FSHARP_QUOT_IDENTIFIER; } else if (fsStr.IsVerbatim()) { state = SCE_FSHARP_VERBATIM; } else { state = SCE_FSHARP_STRING; } } else if (IsADigit(sc.ch, currentBase) || ((sc.ch == '+' || sc.ch == '-') && IsADigit(sc.chNext))) { state = SCE_FSHARP_NUMBER; } else if (setOperators.Contains(sc.ch) && // don't use operator style in async keywords (e.g. `return!`) !(sc.ch == '!' && iswordstart(sc.chPrev)) && // don't use operator style in member access, array/string indexing !(sc.ch == '.' && (sc.chPrev == '\"' || iswordstart(sc.chPrev)) && (iswordstart(sc.chNext) || sc.chNext == '['))) { state = SCE_FSHARP_OPERATOR; } else if (iswordstart(sc.ch)) { state = SCE_FSHARP_IDENTIFIER; } else { state = SCE_FSHARP_DEFAULT; } break; case SCE_FSHARP_LINENUM: case SCE_FSHARP_PREPROCESSOR: case SCE_FSHARP_COMMENTLINE: if (sc.MatchLineEnd()) { state = SCE_FSHARP_DEFAULT; advance = false; } break; case SCE_FSHARP_COMMENT: if (MatchStreamCommentStart(sc)) { sc.Forward(); sc.ch = SPACE; levelNesting++; } else if (MatchStreamCommentEnd(sc)) { if (levelNesting > 0) levelNesting--; else { state = SCE_FSHARP_DEFAULT; colorSpan++; } } break; case SCE_FSHARP_ATTRIBUTE: case SCE_FSHARP_QUOTATION: if (MatchTypeAttributeEnd(sc) || MatchQuotedExpressionEnd(sc)) { state = SCE_FSHARP_DEFAULT; colorSpan++; } break; case SCE_FSHARP_CHARACTER: if (sc.chPrev == '\\' && sc.GetRelative(-2) != '\\') { uniCh = UnicodeChar(sc.ch); } else if (sc.ch == '\'' && ((sc.chPrev == ' ' && sc.GetRelative(-2) == '\'') || sc.chPrev != '\\' || (sc.chPrev == '\\' && sc.GetRelative(-2) == '\\'))) { // byte literal? if (sc.Match('\'', 'B')) { sc.Forward(); colorSpan++; } if (!sc.atLineEnd) { colorSpan++; } else { sc.ChangeState(SCE_FSHARP_IDENTIFIER); } state = SCE_FSHARP_DEFAULT; } else { uniCh.Parse(sc.ch); if (uniCh.AtEnd() && (sc.currentPos - cursor) >= 2) { // terminate now, since we left the char behind sc.ChangeState(SCE_FSHARP_IDENTIFIER); advance = false; } } break; case SCE_FSHARP_STRING: case SCE_FSHARP_VERBATIM: case SCE_FSHARP_QUOT_IDENTIFIER: if (MatchStringEnd(sc, fsStr)) { const Sci_Position strLen = static_cast(sc.currentPos - cursor); // backtrack to start of string for (Sci_Position i = -strLen; i < 0; i++) { const int startQuote = sc.GetRelative(i); if (startQuote == '\"' || (startQuote == '`' && sc.GetRelative(i - 1) == '`')) { // byte array? if (sc.Match('\"', 'B')) { sc.Forward(); colorSpan++; } if (!sc.atLineEnd) { colorSpan++; } else { sc.ChangeState(SCE_FSHARP_IDENTIFIER); } state = SCE_FSHARP_DEFAULT; break; } } } else if (sc.ch == '%' && !(fsStr.startChar == '`' || sc.MatchIgnoreCase("% ") || sc.MatchIgnoreCase("% \"")) && (setFormatSpecs.Contains(sc.chNext) || setFormatFlags.Contains(sc.chNext))) { if (fsStr.CanInterpolate() && sc.chNext != '%') { for (Sci_Position i = 2; i < length && !IsLineEnd(sc, i); i++) { if (sc.GetRelative(i) == '{') { state = setFormatSpecs.Contains(sc.GetRelative(i - 1)) ? SCE_FSHARP_FORMAT_SPEC : state; break; } } } else { state = SCE_FSHARP_FORMAT_SPEC; } } else if (isInterpolated) { if (sc.ch == ',') { // .NET alignment specifier? state = (sc.chNext == '+' || sc.chNext == '-' || IsADigit(sc.chNext)) ? SCE_FSHARP_FORMAT_SPEC : state; } else if (sc.ch == ':') { // .NET format specifier? state = setDotNetFormatSpecs.Contains(sc.chNext) ? SCE_FSHARP_FORMAT_SPEC : state; } else if (sc.chNext == '}') { isInterpolated = false; sc.Forward(); state = fsStr.IsVerbatim() ? SCE_FSHARP_VERBATIM : SCE_FSHARP_STRING; } } else if (fsStr.CanInterpolate() && sc.ch == '{') { isInterpolated = true; } break; case SCE_FSHARP_IDENTIFIER: if (!(iswordstart(sc.ch) || sc.ch == '\'')) { const Sci_Position wordLen = static_cast(sc.currentPos - cursor); if (wordLen < MAX_WORD_LEN) { // wordLength is believable as keyword, [re-]construct token - RR char token[MAX_WORD_LEN] = { 0 }; for (Sci_Position i = -wordLen; i < 0; i++) { token[wordLen + i] = static_cast(sc.GetRelative(i)); } token[wordLen] = '\0'; // a snake_case_identifier can never be a keyword if (!(sc.ch == '_' || sc.GetRelative(-wordLen - 1) == '_')) { for (int i = 0; i < WORDLIST_SIZE; i++) { if (keywords[i].InList(token)) { sc.ChangeState(keywordClasses[i]); break; } } } } state = SCE_FSHARP_DEFAULT; advance = false; } break; case SCE_FSHARP_OPERATOR: // special-case "()" and "[]" tokens as KEYWORDS - RR if ((sc.ch == ')' && sc.chPrev == '(') || (sc.ch == ']' && sc.chPrev == '[')) { sc.ChangeState(SCE_FSHARP_KEYWORD); colorSpan++; } else { advance = false; } state = SCE_FSHARP_DEFAULT; break; case SCE_FSHARP_NUMBER: if ((setOperators.Contains(sc.chPrev) || IsASpaceOrTab(sc.chPrev)) && sc.ch == '0') { if (numericPrefixes.find(sc.chNext) != numericPrefixes.end()) { currentBase = numericPrefixes[sc.chNext]; sc.Forward(2); } } else if ((setOperators.Contains(sc.GetRelative(-2)) || IsASpaceOrTab(sc.GetRelative(-2))) && sc.chPrev == '0') { if (numericPrefixes.find(sc.ch) != numericPrefixes.end()) { currentBase = numericPrefixes[sc.ch]; sc.Forward(); } } state = (IsNumber(sc, currentBase) || IsFloat(sc)) ? SCE_FSHARP_NUMBER // change style even when operators aren't spaced : setOperators.Contains(sc.ch) ? SCE_FSHARP_OPERATOR : SCE_FSHARP_DEFAULT; currentBase = (state == SCE_FSHARP_NUMBER) ? currentBase : 10; break; case SCE_FSHARP_FORMAT_SPEC: if (!(isInterpolated && IsADigit(sc.chNext)) && (!setFormatSpecs.Contains(sc.chNext) || !(setFormatFlags.Contains(sc.ch) || IsADigit(sc.ch)) || (setFormatFlags.Contains(sc.ch) && sc.ch == sc.chNext))) { colorSpan++; state = fsStr.IsVerbatim() ? SCE_FSHARP_VERBATIM : SCE_FSHARP_STRING; } break; } if (sc.MatchLineEnd()) { styler.SetLineState(lineCurrent++, (sc.state == SCE_FSHARP_COMMENT) ? levelNesting : 0); advance = true; } if (state >= SCE_FSHARP_DEFAULT) { styler.ColourTo(colorSpan, sc.state); sc.ChangeState(state); } if (advance) { sc.Forward(); } } sc.Complete(); } bool LineContains(LexAccessor &styler, const char *word, const Sci_Position start, const int chAttr = SCE_FSHARP_DEFAULT); void FoldLexicalGroup(LexAccessor &styler, int &levelNext, const Sci_Position lineCurrent, const char *word, const int chAttr); void SCI_METHOD LexerFSharp::Fold(Sci_PositionU start, Sci_Position length, int initStyle, IDocument *pAccess) { if (!options.fold) { return; } LexAccessor styler(pAccess); const Sci_Position startPos = static_cast(start); const Sci_PositionU endPos = start + length; Sci_Position lineCurrent = styler.GetLine(startPos); Sci_Position lineNext = lineCurrent + 1; Sci_Position lineStartNext = styler.LineStart(lineNext); int style = initStyle; int styleNext = styler.StyleAt(startPos); char chNext = styler[startPos]; int levelNext; int levelCurrent = SC_FOLDLEVELBASE; int visibleChars = 0; if (lineCurrent > 0) { levelCurrent = styler.LevelAt(lineCurrent - 1) >> 0x10; } levelNext = levelCurrent; for (Sci_PositionU i = start; i < endPos; i++) { const Sci_Position currentPos = static_cast(i); const bool atEOL = (currentPos == (lineStartNext - 1) || styler.SafeGetCharAt(currentPos) == '\r'); const bool atLineOrDocEnd = (atEOL || (i == (endPos - 1))); const int stylePrev = style; const char ch = chNext; const bool inLineComment = (stylePrev == SCE_FSHARP_COMMENTLINE); style = styleNext; styleNext = styler.StyleAt(currentPos + 1); chNext = styler.SafeGetCharAt(currentPos + 1); if (options.foldComment) { if (options.foldCommentMultiLine && inLineComment && atEOL) { FoldLexicalGroup(styler, levelNext, lineCurrent, "//", SCE_FSHARP_COMMENTLINE); } if (options.foldCommentStream && style == SCE_FSHARP_COMMENT && !inLineComment) { if (stylePrev != SCE_FSHARP_COMMENT || (styler.Match(currentPos, "(*") && !LineContains(styler, "*)", currentPos + 2, SCE_FSHARP_COMMENT))) { levelNext++; } else if ((styleNext != SCE_FSHARP_COMMENT || ((styler.Match(currentPos, "*)") && !LineContains(styler, "(*", styler.LineStart(lineCurrent), SCE_FSHARP_COMMENT)) && styler.GetLineState(lineCurrent - 1) > 0)) && !atEOL) { levelNext--; } } } if (options.foldPreprocessor && style == SCE_FSHARP_PREPROCESSOR) { if (styler.Match(currentPos, "#if")) { levelNext++; } else if (styler.Match(currentPos, "#endif")) { levelNext--; } } if (options.foldImports && styler.Match(currentPos, "open ") && styleNext == SCE_FSHARP_KEYWORD) { FoldLexicalGroup(styler, levelNext, lineCurrent, "open ", SCE_FSHARP_KEYWORD); } if (!IsASpace(ch)) { visibleChars++; } if (atLineOrDocEnd) { int levelUse = levelCurrent; int lev = levelUse | levelNext << 16; if (visibleChars == 0 && options.foldCompact) { lev |= SC_FOLDLEVELWHITEFLAG; } if (levelUse < levelNext) { lev |= SC_FOLDLEVELHEADERFLAG; } if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } visibleChars = 0; lineCurrent++; lineNext = lineCurrent + 1; lineStartNext = styler.LineStart(lineNext); levelCurrent = levelNext; if (atEOL && (currentPos == (styler.Length() - 1))) { styler.SetLevel(lineCurrent, (levelCurrent | levelCurrent << 16) | SC_FOLDLEVELWHITEFLAG); } } } } bool LineContains(LexAccessor &styler, const char *word, const Sci_Position start, const int chAttr) { bool found = false; bool requireStyle = (chAttr > SCE_FSHARP_DEFAULT); for (Sci_Position i = start; i < styler.LineStart(styler.GetLine(start) + 1) - 1; i++) { if (styler.Match(i, word)) { found = requireStyle ? styler.StyleAt(i) == chAttr : true; break; } } return found; } void FoldLexicalGroup(LexAccessor &styler, int &levelNext, const Sci_Position lineCurrent, const char *word, const int chAttr) { const Sci_Position linePrev = styler.LineStart(lineCurrent - 1); const Sci_Position lineNext = styler.LineStart(lineCurrent + 1); const bool follows = (lineCurrent > 0) && LineContains(styler, word, linePrev, chAttr); const bool isFollowed = LineContains(styler, word, lineNext, chAttr); if (isFollowed && !follows) { levelNext++; } else if (!isFollowed && follows && levelNext > SC_FOLDLEVELBASE) { levelNext--; } } } // namespace LexerModule lmFSharp(SCLEX_FSHARP, LexerFSharp::LexerFactoryFSharp, "fsharp", fsharpWordLists); lexilla/lexers/LexA68k.cxx0000664000175000017500000003035514647367374014415 0ustar neilneil// Scintilla source code edit control /** @file LexA68k.cxx ** Lexer for Assembler, just for the MASM syntax ** Written by Martial Demolins AKA Folco **/ // Copyright 2010 Martial Demolins // The License.txt file describes the conditions under which this software // may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; // Return values for GetOperatorType #define NO_OPERATOR 0 #define OPERATOR_1CHAR 1 #define OPERATOR_2CHAR 2 /** * IsIdentifierStart * * Return true if the given char is a valid identifier first char */ static inline bool IsIdentifierStart (const int ch) { return (isalpha(ch) || (ch == '_') || (ch == '\\')); } /** * IsIdentifierChar * * Return true if the given char is a valid identifier char */ static inline bool IsIdentifierChar (const int ch) { return (isalnum(ch) || (ch == '_') || (ch == '@') || (ch == ':') || (ch == '.')); } /** * GetOperatorType * * Return: * NO_OPERATOR if char is not an operator * OPERATOR_1CHAR if the operator is one char long * OPERATOR_2CHAR if the operator is two chars long */ static inline int GetOperatorType (const int ch1, const int ch2) { int OpType = NO_OPERATOR; if ((ch1 == '+') || (ch1 == '-') || (ch1 == '*') || (ch1 == '/') || (ch1 == '#') || (ch1 == '(') || (ch1 == ')') || (ch1 == '~') || (ch1 == '&') || (ch1 == '|') || (ch1 == ',')) OpType = OPERATOR_1CHAR; else if ((ch1 == ch2) && (ch1 == '<' || ch1 == '>')) OpType = OPERATOR_2CHAR; return OpType; } /** * IsBin * * Return true if the given char is 0 or 1 */ static inline bool IsBin (const int ch) { return (ch == '0') || (ch == '1'); } /** * IsDoxygenChar * * Return true if the char may be part of a Doxygen keyword */ static inline bool IsDoxygenChar (const int ch) { return isalpha(ch) || (ch == '$') || (ch == '[') || (ch == ']') || (ch == '{') || (ch == '}'); } /** * ColouriseA68kDoc * * Main function, which colourises a 68k source */ static void ColouriseA68kDoc (Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { // Used to buffer a string, to be able to compare it using built-in functions char Buffer[100]; // Used to know the length of an operator int OpType; // Get references to keywords lists WordList &cpuInstruction = *keywordlists[0]; WordList ®isters = *keywordlists[1]; WordList &directive = *keywordlists[2]; WordList &extInstruction = *keywordlists[3]; WordList &alert = *keywordlists[4]; WordList &doxygenKeyword = *keywordlists[5]; // Instanciate a context for our source StyleContext sc(startPos, length, initStyle, styler); /************************************************************ * * Parse the source * ************************************************************/ for ( ; sc.More(); sc.Forward()) { /************************************************************ * * A style always terminates at the end of a line, even for * comments (no multi-lines comments) * ************************************************************/ if (sc.atLineStart) { sc.SetState(SCE_A68K_DEFAULT); } /************************************************************ * * If we are not in "default style", check if the style continues * In this case, we just have to loop * ************************************************************/ if (sc.state != SCE_A68K_DEFAULT) { if ( ((sc.state == SCE_A68K_NUMBER_DEC) && isdigit(sc.ch)) // Decimal number || ((sc.state == SCE_A68K_NUMBER_BIN) && IsBin(sc.ch)) // Binary number || ((sc.state == SCE_A68K_NUMBER_HEX) && isxdigit(sc.ch)) // Hexa number || ((sc.state == SCE_A68K_MACRO_ARG) && isdigit(sc.ch)) // Macro argument || ((sc.state == SCE_A68K_STRING1) && (sc.ch != '\'')) // String single-quoted || ((sc.state == SCE_A68K_STRING2) && (sc.ch != '\"')) // String double-quoted || ((sc.state == SCE_A68K_MACRO_DECLARATION) && IsIdentifierChar(sc.ch)) // Macro declaration (or global label, we don't know at this point) || ((sc.state == SCE_A68K_IDENTIFIER) && IsIdentifierChar(sc.ch)) // Identifier || ((sc.state == SCE_A68K_LABEL) && IsIdentifierChar(sc.ch)) // Label (local) || ((sc.state == SCE_A68K_COMMENT_DOXYGEN) && IsDoxygenChar(sc.ch)) // Doxygen keyword || ((sc.state == SCE_A68K_COMMENT_SPECIAL) && isalpha(sc.ch)) // Alert || ((sc.state == SCE_A68K_COMMENT) && !isalpha(sc.ch) && (sc.ch != '\\'))) // Normal comment { continue; } /************************************************************ * * Check if current state terminates * ************************************************************/ // Strings: include terminal ' or " in the current string by skipping it if ((sc.state == SCE_A68K_STRING1) || (sc.state == SCE_A68K_STRING2)) { sc.Forward(); } // If a macro declaration was terminated with ':', it was a label else if ((sc.state == SCE_A68K_MACRO_DECLARATION) && (sc.chPrev == ':')) { sc.ChangeState(SCE_A68K_LABEL); } // If it wasn't a Doxygen keyword, change it to normal comment else if (sc.state == SCE_A68K_COMMENT_DOXYGEN) { sc.GetCurrent(Buffer, sizeof(Buffer)); if (!doxygenKeyword.InList(Buffer)) { sc.ChangeState(SCE_A68K_COMMENT); } sc.SetState(SCE_A68K_COMMENT); continue; } // If it wasn't an Alert, change it to normal comment else if (sc.state == SCE_A68K_COMMENT_SPECIAL) { sc.GetCurrent(Buffer, sizeof(Buffer)); if (!alert.InList(Buffer)) { sc.ChangeState(SCE_A68K_COMMENT); } // Reset style to normal comment, or to Doxygen keyword if it begins with '\' if (sc.ch == '\\') { sc.SetState(SCE_A68K_COMMENT_DOXYGEN); } else { sc.SetState(SCE_A68K_COMMENT); } continue; } // If we are in a comment, it's a Doxygen keyword or an Alert else if (sc.state == SCE_A68K_COMMENT) { if (sc.ch == '\\') { sc.SetState(SCE_A68K_COMMENT_DOXYGEN); } else { sc.SetState(SCE_A68K_COMMENT_SPECIAL); } continue; } // Check if we are at the end of an identifier // In this case, colourise it if was a keyword. else if ((sc.state == SCE_A68K_IDENTIFIER) && !IsIdentifierChar(sc.ch)) { sc.GetCurrentLowered(Buffer, sizeof(Buffer)); // Buffer the string of the current context if (cpuInstruction.InList(Buffer)) { // And check if it belongs to a keyword list sc.ChangeState(SCE_A68K_CPUINSTRUCTION); } else if (extInstruction.InList(Buffer)) { sc.ChangeState(SCE_A68K_EXTINSTRUCTION); } else if (registers.InList(Buffer)) { sc.ChangeState(SCE_A68K_REGISTER); } else if (directive.InList(Buffer)) { sc.ChangeState(SCE_A68K_DIRECTIVE); } } // All special contexts are now handled.Come back to default style sc.SetState(SCE_A68K_DEFAULT); } /************************************************************ * * Check if we must enter a new state * ************************************************************/ // Something which begins at the beginning of a line, and with // - '\' + an identifier start char, or // - '\\@' + an identifier start char // is a local label (second case is used for macro local labels). We set it already as a label, it can't be a macro/equ declaration if (sc.atLineStart && (sc.ch < 0x80) && IsIdentifierStart(sc.chNext) && (sc.ch == '\\')) { sc.SetState(SCE_A68K_LABEL); } if (sc.atLineStart && (sc.ch < 0x80) && (sc.ch == '\\') && (sc.chNext == '\\')) { sc.Forward(2); if ((sc.ch == '@') && IsIdentifierStart(sc.chNext)) { sc.ChangeState(SCE_A68K_LABEL); sc.SetState(SCE_A68K_LABEL); } } // Label and macro identifiers start at the beginning of a line // We set both as a macro id, but if it wasn't one (':' at the end), // it will be changed as a label. if (sc.atLineStart && (sc.ch < 0x80) && IsIdentifierStart(sc.ch)) { sc.SetState(SCE_A68K_MACRO_DECLARATION); } else if ((sc.ch < 0x80) && (sc.ch == ';')) { // Default: alert in a comment. If it doesn't match sc.SetState(SCE_A68K_COMMENT); // with an alert, it will be toggle to a normal comment } else if ((sc.ch < 0x80) && isdigit(sc.ch)) { // Decimal numbers haven't prefix sc.SetState(SCE_A68K_NUMBER_DEC); } else if ((sc.ch < 0x80) && (sc.ch == '%')) { // Binary numbers are prefixed with '%' sc.SetState(SCE_A68K_NUMBER_BIN); } else if ((sc.ch < 0x80) && (sc.ch == '$')) { // Hexadecimal numbers are prefixed with '$' sc.SetState(SCE_A68K_NUMBER_HEX); } else if ((sc.ch < 0x80) && (sc.ch == '\'')) { // String (single-quoted) sc.SetState(SCE_A68K_STRING1); } else if ((sc.ch < 0x80) && (sc.ch == '\"')) { // String (double-quoted) sc.SetState(SCE_A68K_STRING2); } else if ((sc.ch < 0x80) && (sc.ch == '\\') && (isdigit(sc.chNext))) { // Replacement symbols in macro are prefixed with '\' sc.SetState(SCE_A68K_MACRO_ARG); } else if ((sc.ch < 0x80) && IsIdentifierStart(sc.ch)) { // An identifier: constant, label, etc... sc.SetState(SCE_A68K_IDENTIFIER); } else { if (sc.ch < 0x80) { OpType = GetOperatorType(sc.ch, sc.chNext); // Check if current char is an operator if (OpType != NO_OPERATOR) { sc.SetState(SCE_A68K_OPERATOR); if (OpType == OPERATOR_2CHAR) { // Check if the operator is 2 bytes long sc.ForwardSetState(SCE_A68K_OPERATOR); // (>> or <<) } } } } } // End of for() sc.Complete(); } // Names of the keyword lists static const char * const a68kWordListDesc[] = { "CPU instructions", "Registers", "Directives", "Extended instructions", "Comment special words", "Doxygen keywords", 0 }; LexerModule lmA68k(SCLEX_A68K, ColouriseA68kDoc, "a68k", 0, a68kWordListDesc); lexilla/lexers/LexAsn1.cxx0000664000175000017500000001230314647367374014477 0ustar neilneil// Scintilla source code edit control /** @file LexAsn1.cxx ** Lexer for ASN.1 **/ // Copyright 2004 by Herr Pfarrer rpfarrer yahoo de // Last Updated: 20/07/2004 // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; // Some char test functions static bool isAsn1Number(int ch) { return (ch >= '0' && ch <= '9'); } static bool isAsn1Letter(int ch) { return (ch >= 'A' && ch <= 'Z') || (ch >= 'a' && ch <= 'z'); } static bool isAsn1Char(int ch) { return (ch == '-' ) || isAsn1Number(ch) || isAsn1Letter (ch); } // // Function determining the color of a given code portion // Based on a "state" // static void ColouriseAsn1Doc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordLists[], Accessor &styler) { // The keywords WordList &Keywords = *keywordLists[0]; WordList &Attributes = *keywordLists[1]; WordList &Descriptors = *keywordLists[2]; WordList &Types = *keywordLists[3]; // Parse the whole buffer character by character using StyleContext StyleContext sc(startPos, length, initStyle, styler); for (; sc.More(); sc.Forward()) { // The state engine switch (sc.state) { case SCE_ASN1_DEFAULT: // Plain characters asn1_default: if (sc.ch == '-' && sc.chNext == '-') // A comment begins here sc.SetState(SCE_ASN1_COMMENT); else if (sc.ch == '"') // A string begins here sc.SetState(SCE_ASN1_STRING); else if (isAsn1Number (sc.ch)) // A number starts here (identifier should start with a letter in ASN.1) sc.SetState(SCE_ASN1_SCALAR); else if (isAsn1Char (sc.ch)) // An identifier starts here (identifier always start with a letter) sc.SetState(SCE_ASN1_IDENTIFIER); else if (sc.ch == ':') // A ::= operator starts here sc.SetState(SCE_ASN1_OPERATOR); break; case SCE_ASN1_COMMENT: // A comment if (sc.ch == '\r' || sc.ch == '\n') // A comment ends here sc.SetState(SCE_ASN1_DEFAULT); break; case SCE_ASN1_IDENTIFIER: // An identifier (keyword, attribute, descriptor or type) if (!isAsn1Char (sc.ch)) { // The end of identifier is here: we can look for it in lists by now and change its state char s[100]; sc.GetCurrent(s, sizeof(s)); if (Keywords.InList(s)) // It's a keyword, change its state sc.ChangeState(SCE_ASN1_KEYWORD); else if (Attributes.InList(s)) // It's an attribute, change its state sc.ChangeState(SCE_ASN1_ATTRIBUTE); else if (Descriptors.InList(s)) // It's a descriptor, change its state sc.ChangeState(SCE_ASN1_DESCRIPTOR); else if (Types.InList(s)) // It's a type, change its state sc.ChangeState(SCE_ASN1_TYPE); // Set to default now sc.SetState(SCE_ASN1_DEFAULT); } break; case SCE_ASN1_STRING: // A string delimited by "" if (sc.ch == '"') { // A string ends here sc.ForwardSetState(SCE_ASN1_DEFAULT); // To correctly manage a char sticking to the string quote goto asn1_default; } break; case SCE_ASN1_SCALAR: // A plain number if (!isAsn1Number (sc.ch)) // A number ends here sc.SetState(SCE_ASN1_DEFAULT); break; case SCE_ASN1_OPERATOR: // The affectation operator ::= and wath follows (eg: ::= { org 6 } OID or ::= 12 trap) if (sc.ch == '{') { // An OID definition starts here: enter the sub loop for (; sc.More(); sc.Forward()) { if (isAsn1Number (sc.ch) && (!isAsn1Char (sc.chPrev) || isAsn1Number (sc.chPrev))) // The OID number is highlighted sc.SetState(SCE_ASN1_OID); else if (isAsn1Char (sc.ch)) // The OID parent identifier is plain sc.SetState(SCE_ASN1_IDENTIFIER); else sc.SetState(SCE_ASN1_DEFAULT); if (sc.ch == '}') // Here ends the OID and the operator sub loop: go back to main loop break; } } else if (isAsn1Number (sc.ch)) { // A trap number definition starts here: enter the sub loop for (; sc.More(); sc.Forward()) { if (isAsn1Number (sc.ch)) // The trap number is highlighted sc.SetState(SCE_ASN1_OID); else { // The number ends here: go back to main loop sc.SetState(SCE_ASN1_DEFAULT); break; } } } else if (sc.ch != ':' && sc.ch != '=' && sc.ch != ' ') // The operator doesn't imply an OID definition nor a trap, back to main loop goto asn1_default; // To be sure to handle actually the state change break; } } sc.Complete(); } static void FoldAsn1Doc(Sci_PositionU, Sci_Position, int, WordList *[], Accessor &styler) { // No folding enabled, no reason to continue... if( styler.GetPropertyInt("fold") == 0 ) return; // No folding implemented: doesn't make sense for ASN.1 } static const char * const asn1WordLists[] = { "Keywords", "Attributes", "Descriptors", "Types", 0, }; LexerModule lmAsn1(SCLEX_ASN1, ColouriseAsn1Doc, "asn1", FoldAsn1Doc, asn1WordLists); lexilla/lexers/LexErrorList.cxx0000664000175000017500000003372314647367374015633 0ustar neilneil// Scintilla source code edit control /** @file LexErrorList.cxx ** Lexer for error lists. Used for the output pane in SciTE. **/ // Copyright 1998-2001 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "InList.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; namespace { bool strstart(const char *haystack, const char *needle) noexcept { return strncmp(haystack, needle, strlen(needle)) == 0; } constexpr bool Is0To9(char ch) noexcept { return (ch >= '0') && (ch <= '9'); } constexpr bool Is1To9(char ch) noexcept { return (ch >= '1') && (ch <= '9'); } bool AtEOL(Accessor &styler, Sci_Position i) { return (styler[i] == '\n') || ((styler[i] == '\r') && (styler.SafeGetCharAt(i + 1) != '\n')); } bool IsGccExcerpt(const char *s) noexcept { while (*s) { if (s[0] == ' ' && s[1] == '|' && (s[2] == ' ' || s[2] == '+')) { return true; } if (!(s[0] == ' ' || s[0] == '+' || Is0To9(s[0]))) { return false; } s++; } return true; } const std::string_view bashDiagnosticMark = ": line "; bool IsBashDiagnostic(std::string_view sv) { const size_t mark = sv.find(bashDiagnosticMark); if (mark == std::string_view::npos) { return false; } std::string_view rest = sv.substr(mark + bashDiagnosticMark.length()); if (rest.empty() || !Is0To9(rest.front())) { return false; } while (!rest.empty() && Is0To9(rest.front())) { rest.remove_prefix(1); } return !rest.empty() && (rest.front() == ':'); } int RecogniseErrorListLine(const char *lineBuffer, Sci_PositionU lengthLine, Sci_Position &startValue) { if (lineBuffer[0] == '>') { // Command or return status return SCE_ERR_CMD; } else if (lineBuffer[0] == '<') { // Diff removal. return SCE_ERR_DIFF_DELETION; } else if (lineBuffer[0] == '!') { return SCE_ERR_DIFF_CHANGED; } else if (lineBuffer[0] == '+') { if (strstart(lineBuffer, "+++ ")) { return SCE_ERR_DIFF_MESSAGE; } else { return SCE_ERR_DIFF_ADDITION; } } else if (lineBuffer[0] == '-') { if (strstart(lineBuffer, "--- ")) { return SCE_ERR_DIFF_MESSAGE; } else { return SCE_ERR_DIFF_DELETION; } } else if (strstart(lineBuffer, "cf90-")) { // Absoft Pro Fortran 90/95 v8.2 error and/or warning message return SCE_ERR_ABSF; } else if (strstart(lineBuffer, "fortcom:")) { // Intel Fortran Compiler v8.0 error/warning message return SCE_ERR_IFORT; } else if (strstr(lineBuffer, "File \"") && strstr(lineBuffer, ", line ")) { return SCE_ERR_PYTHON; } else if (strstr(lineBuffer, " in ") && strstr(lineBuffer, " on line ")) { return SCE_ERR_PHP; } else if ((strstart(lineBuffer, "Error ") || strstart(lineBuffer, "Warning ")) && strstr(lineBuffer, " at (") && strstr(lineBuffer, ") : ") && (strstr(lineBuffer, " at (") < strstr(lineBuffer, ") : "))) { // Intel Fortran Compiler error/warning message return SCE_ERR_IFC; } else if (strstart(lineBuffer, "Error ")) { // Borland error message return SCE_ERR_BORLAND; } else if (strstart(lineBuffer, "Warning ")) { // Borland warning message return SCE_ERR_BORLAND; } else if (strstr(lineBuffer, "at line ") && (strstr(lineBuffer, "at line ") < (lineBuffer + lengthLine)) && strstr(lineBuffer, "file ") && (strstr(lineBuffer, "file ") < (lineBuffer + lengthLine))) { // Lua 4 error message return SCE_ERR_LUA; } else if (strstr(lineBuffer, " at ") && (strstr(lineBuffer, " at ") < (lineBuffer + lengthLine)) && strstr(lineBuffer, " line ") && (strstr(lineBuffer, " line ") < (lineBuffer + lengthLine)) && (strstr(lineBuffer, " at ") + 4 < (strstr(lineBuffer, " line ")))) { // perl error message: // at line return SCE_ERR_PERL; } else if ((lengthLine >= 6) && (memcmp(lineBuffer, " at ", 6) == 0) && strstr(lineBuffer, ":line ")) { // A .NET traceback return SCE_ERR_NET; } else if (strstart(lineBuffer, "Line ") && strstr(lineBuffer, ", file ")) { // Essential Lahey Fortran error message return SCE_ERR_ELF; } else if (strstart(lineBuffer, "line ") && strstr(lineBuffer, " column ")) { // HTML tidy style: line 42 column 1 return SCE_ERR_TIDY; } else if (strstart(lineBuffer, "\tat ") && strchr(lineBuffer, '(') && strstr(lineBuffer, ".java:")) { // Java stack back trace return SCE_ERR_JAVA_STACK; } else if (strstart(lineBuffer, "In file included from ") || strstart(lineBuffer, " from ")) { // GCC showing include path to following error return SCE_ERR_GCC_INCLUDED_FROM; } else if (strstart(lineBuffer, "NMAKE : fatal error")) { // Microsoft nmake fatal error: // NMAKE : fatal error : : return code return SCE_ERR_MS; } else if (strstr(lineBuffer, "warning LNK") || strstr(lineBuffer, "error LNK")) { // Microsoft linker warning: // { : } (warning|error) LNK9999 return SCE_ERR_MS; } else if (IsBashDiagnostic(lineBuffer)) { // Bash diagnostic // : line : return SCE_ERR_BASH; } else if (IsGccExcerpt(lineBuffer)) { // GCC code excerpt and pointer to issue // 73 | GTimeVal last_popdown; // | ^~~~~~~~~~~~ return SCE_ERR_GCC_EXCERPT; } else { // Look for one of the following formats: // GCC: :: // Microsoft: () : // Common: (): warning|error|note|remark|catastrophic|fatal // Common: () warning|error|note|remark|catastrophic|fatal // Microsoft: (,) // CTags: \t\t // Lua 5 traceback: \t:: // Lua 5.1: : :: const bool initialTab = (lineBuffer[0] == '\t'); bool initialColonPart = false; bool canBeCtags = !initialTab; // For ctags must have an identifier with no spaces then a tab enum { stInitial, stGccStart, stGccDigit, stGccColumn, stGcc, stMsStart, stMsDigit, stMsBracket, stMsVc, stMsDigitComma, stMsDotNet, stCtagsStart, stCtagsFile, stCtagsStartString, stCtagsStringDollar, stCtags, stUnrecognized } state = stInitial; for (Sci_PositionU i = 0; i < lengthLine; i++) { const char ch = lineBuffer[i]; char chNext = ' '; if ((i + 1) < lengthLine) chNext = lineBuffer[i + 1]; if (state == stInitial) { if (ch == ':') { // May be GCC, or might be Lua 5 (Lua traceback same but with tab prefix) if ((chNext != '\\') && (chNext != '/') && (chNext != ' ')) { // This check is not completely accurate as may be on // GTK+ with a file name that includes ':'. state = stGccStart; } else if (chNext == ' ') { // indicates a Lua 5.1 error message initialColonPart = true; } } else if ((ch == '(') && Is1To9(chNext) && (!initialTab)) { // May be Microsoft // Check against '0' often removes phone numbers state = stMsStart; } else if ((ch == '\t') && canBeCtags) { // May be CTags state = stCtagsStart; } else if (ch == ' ') { canBeCtags = false; } } else if (state == stGccStart) { // : state = ((ch == '-') || Is0To9(ch)) ? stGccDigit : stUnrecognized; } else if (state == stGccDigit) { // : if (ch == ':') { state = stGccColumn; // :9.*: is GCC startValue = i + 1; } else if (!Is0To9(ch)) { state = stUnrecognized; } } else if (state == stGccColumn) { // :: if (!Is0To9(ch)) { state = stGcc; if (ch == ':') startValue = i + 1; break; } } else if (state == stMsStart) { // ( state = Is0To9(ch) ? stMsDigit : stUnrecognized; } else if (state == stMsDigit) { // ( if (ch == ',') { state = stMsDigitComma; } else if (ch == ')') { state = stMsBracket; } else if ((ch != ' ') && !Is0To9(ch)) { state = stUnrecognized; } } else if (state == stMsBracket) { // () if ((ch == ' ') && (chNext == ':')) { state = stMsVc; } else if ((ch == ':' && chNext == ' ') || (ch == ' ')) { // Possibly Delphi.. don't test against chNext as it's one of the strings below. char word[512]; unsigned numstep = 0; if (ch == ' ') numstep = 1; // ch was ' ', handle as if it's a delphi errorline, only add 1 to i. else numstep = 2; // otherwise add 2. Sci_PositionU chPos = 0; for (Sci_PositionU j = i + numstep; j < lengthLine && IsUpperOrLowerCase(lineBuffer[j]) && chPos < sizeof(word) - 1; j++) word[chPos++] = lineBuffer[j]; word[chPos] = 0; if (InListCaseInsensitive(word, {"error", "warning", "fatal", "catastrophic", "note", "remark"})) { state = stMsVc; } else { state = stUnrecognized; } } else { state = stUnrecognized; } } else if (state == stMsDigitComma) { // (, if (ch == ')') { state = stMsDotNet; break; } else if ((ch != ' ') && !Is0To9(ch)) { state = stUnrecognized; } } else if (state == stCtagsStart) { if (ch == '\t') { state = stCtagsFile; } } else if (state == stCtagsFile) { if ((lineBuffer[i - 1] == '\t') && ((ch == '/' && chNext == '^') || Is0To9(ch))) { state = stCtags; break; } else if ((ch == '/') && (chNext == '^')) { state = stCtagsStartString; } } else if ((state == stCtagsStartString) && ((lineBuffer[i] == '$') && (lineBuffer[i + 1] == '/'))) { state = stCtagsStringDollar; break; } } if (state == stGcc) { return initialColonPart ? SCE_ERR_LUA : SCE_ERR_GCC; } else if ((state == stMsVc) || (state == stMsDotNet)) { return SCE_ERR_MS; } else if ((state == stCtagsStringDollar) || (state == stCtags)) { return SCE_ERR_CTAG; } else if (initialColonPart && strstr(lineBuffer, ": warning C")) { // Microsoft warning without line number // : warning C9999 return SCE_ERR_MS; } else { return SCE_ERR_DEFAULT; } } } #define CSI "\033[" constexpr bool SequenceEnd(int ch) noexcept { return (ch == 0) || ((ch >= '@') && (ch <= '~')); } int StyleFromSequence(const char *seq) noexcept { int bold = 0; int colour = 0; while (!SequenceEnd(*seq)) { if (Is0To9(*seq)) { int base = *seq - '0'; if (Is0To9(seq[1])) { base = base * 10; base += seq[1] - '0'; seq++; } if (base == 0) { colour = 0; bold = 0; } else if (base == 1) { bold = 1; } else if (base >= 30 && base <= 37) { colour = base - 30; } } seq++; } return SCE_ERR_ES_BLACK + bold * 8 + colour; } void ColouriseErrorListLine( const std::string &lineBuffer, Sci_PositionU endPos, Accessor &styler, bool valueSeparate, bool escapeSequences) { Sci_Position startValue = -1; const Sci_PositionU lengthLine = lineBuffer.length(); const int style = RecogniseErrorListLine(lineBuffer.c_str(), lengthLine, startValue); if (escapeSequences && strstr(lineBuffer.c_str(), CSI)) { const Sci_Position startPos = endPos - lengthLine; const char *linePortion = lineBuffer.c_str(); Sci_Position startPortion = startPos; int portionStyle = style; while (const char *startSeq = strstr(linePortion, CSI)) { if (startSeq > linePortion) { styler.ColourTo(startPortion + (startSeq - linePortion), portionStyle); } const char *endSeq = startSeq + 2; while (!SequenceEnd(*endSeq)) endSeq++; const Sci_Position endSeqPosition = startPortion + (endSeq - linePortion) + 1; switch (*endSeq) { case 0: styler.ColourTo(endPos, SCE_ERR_ESCSEQ_UNKNOWN); return; case 'm': // Colour command styler.ColourTo(endSeqPosition, SCE_ERR_ESCSEQ); portionStyle = StyleFromSequence(startSeq+2); break; case 'K': // Erase to end of line -> ignore styler.ColourTo(endSeqPosition, SCE_ERR_ESCSEQ); break; default: styler.ColourTo(endSeqPosition, SCE_ERR_ESCSEQ_UNKNOWN); portionStyle = style; } startPortion = endSeqPosition; linePortion = endSeq + 1; } styler.ColourTo(endPos, portionStyle); } else { if (valueSeparate && (startValue >= 0)) { styler.ColourTo(endPos - (lengthLine - startValue), style); styler.ColourTo(endPos, SCE_ERR_VALUE); } else { styler.ColourTo(endPos, style); } } } void ColouriseErrorListDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { std::string lineBuffer; styler.StartAt(startPos); styler.StartSegment(startPos); // property lexer.errorlist.value.separate // For lines in the output pane that are matches from Find in Files or GCC-style // diagnostics, style the path and line number separately from the rest of the // line with style 21 used for the rest of the line. // This allows matched text to be more easily distinguished from its location. const bool valueSeparate = styler.GetPropertyInt("lexer.errorlist.value.separate", 0) != 0; // property lexer.errorlist.escape.sequences // Set to 1 to interpret escape sequences. const bool escapeSequences = styler.GetPropertyInt("lexer.errorlist.escape.sequences") != 0; for (Sci_PositionU i = startPos; i < startPos + length; i++) { lineBuffer.push_back(styler[i]); if (AtEOL(styler, i)) { // End of line met, colourise it ColouriseErrorListLine(lineBuffer, i, styler, valueSeparate, escapeSequences); lineBuffer.clear(); } } if (!lineBuffer.empty()) { // Last line does not have ending characters ColouriseErrorListLine(lineBuffer, startPos + length - 1, styler, valueSeparate, escapeSequences); } } const char *const emptyWordListDesc[] = { nullptr }; } LexerModule lmErrorList(SCLEX_ERRORLIST, ColouriseErrorListDoc, "errorlist", nullptr, emptyWordListDesc); lexilla/lexers/LexRaku.cxx0000664000175000017500000014276514647367374014617 0ustar neilneil/** @file LexRaku.cxx ** Lexer for Raku ** ** Copyright (c) 2019 Mark Reay **/ // Copyright 1998-2005 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. /* * Raku (Perl6) Lexer for Scintilla * --------------------------------- * --------------------------------- * 06-Dec-2019: More Unicode support: * - Added a full scope of allowed numbers and letters * 29-Nov-2019: More highlighting / implemented basic folding: * - Operators (blanket cover, no sequence checking) * - Class / Grammar name highlighting * - Folding: * - Comments: line / multi-line * - POD sections * - Code blocks {} * 26-Nov-2019: Basic syntax highlighting covering the following: * - Comments, both line and embedded (multi-line) * - POD, no inline highlighting as yet... * - Heredoc block string, with variable highlighting (with qq) * - Strings, with variable highlighting (with ") * - Q Language, including adverbs (also basic q and qq) * - Regex, including adverbs * - Numbers * - Bareword / identifiers * - Types * - Variables: mu, positional, associative, callable * TODO: * - POD inline * - Better operator sequence coverage */ #include #include #include #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "CharacterCategory.h" #include "LexerModule.h" #include "OptionSet.h" #include "DefaultLexer.h" using namespace Scintilla; using namespace Lexilla; namespace { // anonymous namespace to isolate any name clashes /*----------------------------------------------------------------------------* * --- DEFINITIONS: OPTIONS / CONSTANTS --- *----------------------------------------------------------------------------*/ // Number types #define RAKUNUM_BINARY 1 // order is significant: 1-3 cannot have a dot #define RAKUNUM_OCTAL 2 #define RAKUNUM_FLOAT_EXP 3 // exponent part only #define RAKUNUM_HEX 4 // may be a hex float #define RAKUNUM_DECIMAL 5 // 1-5 are numbers; 6-7 are strings #define RAKUNUM_VECTOR 6 #define RAKUNUM_V_VECTOR 7 #define RAKUNUM_VERSION 8 // can contain multiple '.'s #define RAKUNUM_BAD 9 // Regex / Q string types #define RAKUTYPE_REGEX_NORM 0 // 0 char ident #define RAKUTYPE_REGEX_S 1 // order is significant: #define RAKUTYPE_REGEX_M 2 // 1 char ident #define RAKUTYPE_REGEX_Y 3 // 1 char ident #define RAKUTYPE_REGEX 4 // > RAKUTYPE_REGEX == 2 char identifiers #define RAKUTYPE_REGEX_RX 5 // 2 char ident #define RAKUTYPE_REGEX_TR 6 // 2 char ident #define RAKUTYPE_QLANG 7 // < RAKUTYPE_QLANG == RAKUTYPE_REGEX_? #define RAKUTYPE_STR_WQ 8 // 0 char ident < word quote > #define RAKUTYPE_STR_Q 9 // 1 char ident #define RAKUTYPE_STR_QX 10 // 2 char ident #define RAKUTYPE_STR_QW 11 // 2 char ident #define RAKUTYPE_STR_QQ 12 // 2 char ident #define RAKUTYPE_STR_QQX 13 // 3 char ident #define RAKUTYPE_STR_QQW 14 // 3 char ident #define RAKUTYPE_STR_QQWW 15 // 4 char ident // Delimiter types #define RAKUDELIM_BRACKET 0 // bracket: regex, Q language #define RAKUDELIM_QUOTE 1 // quote: normal string // rakuWordLists: keywords as defined in config const char *const rakuWordLists[] = { "Keywords and identifiers", "Functions", "Types basic", "Types composite", "Types domain-specific", "Types exception", "Adverbs", nullptr, }; // Options and defaults struct OptionsRaku { bool fold; bool foldCompact; bool foldComment; bool foldCommentMultiline; bool foldCommentPOD; OptionsRaku() { fold = true; foldCompact = false; foldComment = true; foldCommentMultiline = true; foldCommentPOD = true; } }; // init options and words struct OptionSetRaku : public OptionSet { OptionSetRaku() { DefineProperty("fold", &OptionsRaku::fold); DefineProperty("fold.comment", &OptionsRaku::foldComment); DefineProperty("fold.compact", &OptionsRaku::foldCompact); DefineProperty("fold.raku.comment.multiline", &OptionsRaku::foldCommentMultiline, "Set this property to 0 to disable folding multi-line comments when fold.comment=1."); DefineProperty("fold.raku.comment.pod", &OptionsRaku::foldCommentPOD, "Set this property to 0 to disable folding POD comments when fold.comment=1."); // init word lists DefineWordListSets(rakuWordLists); } }; // Delimiter pair struct DelimPair { int opener; // opener char int closer[2]; // closer chars bool interpol; // can variables be interpolated? short count; // delimiter char count DelimPair() { opener = 0; closer[0] = 0; closer[1] = 0; interpol = false; count = 0; } bool isCloser(int ch) const { return ch == closer[0] || ch == closer[1]; } }; /*----------------------------------------------------------------------------* * --- FUNCTIONS --- *----------------------------------------------------------------------------*/ /* * IsANewLine * - returns true if this is a new line char */ constexpr bool IsANewLine(int ch) noexcept { return ch == '\r' || ch == '\n'; } /* * IsAWhitespace * - returns true if this is a whitespace (or newline) char */ bool IsAWhitespace(int ch) noexcept { return IsASpaceOrTab(ch) || IsANewLine(ch); } /* * IsAlphabet * - returns true if this is an alphabetical char */ constexpr bool IsAlphabet(int ch) noexcept { return (ch >= 'a' && ch <= 'z') || (ch >= 'A' && ch <= 'Z'); } /* * IsCommentLine * - returns true if this is a comment line * - tests: SCE_RAKU_COMMENTLINE or SCE_RAKU_COMMENTEMBED * modified from: LexPerl.cxx */ bool IsCommentLine(Sci_Position line, LexAccessor &styler, int type = SCE_RAKU_COMMENTLINE) { Sci_Position pos = styler.LineStart(line); Sci_Position eol_pos = styler.LineStart(line + 1) - 1; for (Sci_Position i = pos; i < eol_pos; i++) { char ch = styler[i]; int style = styler.StyleAt(i); if (type == SCE_RAKU_COMMENTEMBED) { if (i == (eol_pos - 1) && style == type) return true; } else { // make sure the line is NOT a SCE_RAKU_COMMENTEMBED if (ch == '#' && style == type && styler[i+1] != '`' ) return true; else if (!IsASpaceOrTab(ch)) return false; } } return false; } /* * ContainsQTo * - returns true if this range contains ":to" in style SCE_RAKU_ADVERB indicating the start * of a SCE_RAKU_HEREDOC_Q or SCE_RAKU_HEREDOC_QQ. */ bool ContainsQTo(Sci_Position start, Sci_Position end, LexAccessor &styler) { std::string adverb; for (Sci_Position i = start; i < end; i++) { if (styler.StyleAt(i) == SCE_RAKU_ADVERB) { adverb.push_back(styler[i]); } } return adverb.find(":to") != std::string::npos; } /* * GetBracketCloseChar * - returns the end bracket char: opposite of start * - see: http://www.unicode.org/Public/5.1.0/ucd/BidiMirroring.txt (first section) * - Categories are general matches for valid BiDi types * - Most closer chars are opener + 1 */ int GetBracketCloseChar(const int ch) noexcept { const CharacterCategory cc = CategoriseCharacter(ch); switch (cc) { case ccSm: switch (ch) { case 0x3C: return 0x3E; // LESS-THAN SIGN case 0x2208: return 0x220B; // ELEMENT OF case 0x2209: return 0x220C; // NOT AN ELEMENT OF case 0x220A: return 0x220D; // SMALL ELEMENT OF case 0x2215: return 0x29F5; // DIVISION SLASH case 0x2243: return 0x22CD; // ASYMPTOTICALLY EQUAL TO case 0x2298: return 0x29B8; // CIRCLED DIVISION SLASH case 0x22A6: return 0x2ADE; // ASSERTION case 0x22A8: return 0x2AE4; // TRUE case 0x22A9: return 0x2AE3; // FORCES case 0x22AB: return 0x2AE5; // DOUBLE VERTICAL BAR DOUBLE RIGHT TURNSTILE case 0x22F2: return 0x22FA; // ELEMENT OF WITH LONG HORIZONTAL STROKE case 0x22F3: return 0x22FB; // ELEMENT OF WITH VERTICAL BAR AT END OF HORIZONTAL STROKE case 0x22F4: return 0x22FC; // SMALL ELEMENT OF WITH VERTICAL BAR AT END OF HORIZONTAL STROKE case 0x22F6: return 0x22FD; // ELEMENT OF WITH OVERBAR case 0x22F7: return 0x22FE; // SMALL ELEMENT OF WITH OVERBAR case 0xFF1C: return 0xFF1E; // FULLWIDTH LESS-THAN SIGN } break; case ccPs: switch (ch) { case 0x5B: return 0x5D; // LEFT SQUARE BRACKET case 0x7B: return 0x7D; // LEFT CURLY BRACKET case 0x298D: return 0x2990; // LEFT SQUARE BRACKET WITH TICK IN TOP CORNER case 0x298F: return 0x298E; // LEFT SQUARE BRACKET WITH TICK IN BOTTOM CORNER case 0xFF3B: return 0xFF3D; // FULLWIDTH LEFT SQUARE BRACKET case 0xFF5B: return 0xFF5D; // FULLWIDTH LEFT CURLY BRACKET } break; case ccPi: break; default: return 0; } return ch + 1; } /* * IsValidQuoteOpener * - */ bool IsValidQuoteOpener(const int ch, DelimPair &dp, int type = RAKUDELIM_BRACKET) noexcept { dp.closer[0] = 0; dp.closer[1] = 0; dp.interpol = true; if (type == RAKUDELIM_QUOTE) { switch (ch) { // Opener Closer Description case '\'': dp.closer[0] = '\''; // APOSTROPHE dp.interpol = false; break; case '"': dp.closer[0] = '"'; // QUOTATION MARK break; case 0x2018: dp.closer[0] = 0x2019; // LEFT SINGLE QUOTATION MARK dp.interpol = false; break; case 0x201C: dp.closer[0] = 0x201D; // LEFT DOUBLE QUOTATION MARK break; case 0x201D: dp.closer[0] = 0x201C; // RIGHT DOUBLE QUOTATION MARK break; case 0x201E: dp.closer[0] = 0x201C; // DOUBLE LOW-9 QUOTATION MARK dp.closer[1] = 0x201D; break; case 0xFF62: dp.closer[0] = 0xFF63; // HALFWIDTH LEFT CORNER BRACKET dp.interpol = false; break; default: return false; } } else if (type == RAKUDELIM_BRACKET) { dp.closer[0] = GetBracketCloseChar(ch); } dp.opener = ch; dp.count = 1; return dp.closer[0] > 0; } /* * IsBracketOpenChar * - true if this is a valid start bracket character */ bool IsBracketOpenChar(int ch) noexcept { return GetBracketCloseChar(ch) > 0; } /* * IsValidRegOrQAdjacent * - returns true if ch is a valid character to put directly after Q / q * * ref: Q Language: https://docs.raku.org/language/quoting */ bool IsValidRegOrQAdjacent(int ch) noexcept { return !(IsAlphaNumeric(ch) || ch == '_' || ch == '(' || ch == ')' || ch == '\'' ); } /* * IsValidRegOrQPrecede * - returns true if ch is a valid preceding character to put directly before Q / q * * ref: Q Language: https://docs.raku.org/language/quoting */ bool IsValidRegOrQPrecede(int ch) noexcept { return !(IsAlphaNumeric(ch) || ch == '_'); } /* * MatchCharInRange * - returns true if the mach character is found in range (of length) * - ignoreDelim (default false) */ bool MatchCharInRange(StyleContext &sc, const Sci_Position length, const int match, bool ignoreDelim = false) { Sci_Position len = 0; int chPrev = sc.chPrev; while (++len < length) { const int ch = sc.GetRelativeCharacter(len); if (ch == match && (ignoreDelim || chPrev != '\\')) return true; } return false; } /* * PrevNonWhitespaceChar * - returns the last non-whitespace char */ int PrevNonWhitespaceChar(StyleContext &sc) { Sci_Position rel = 0; Sci_Position max_back = 0 - sc.currentPos; while (--rel > max_back) { const int ch = sc.GetRelativeCharacter(rel); if (!IsAWhitespace(ch)) return ch; } return 0; // no matching char } /* * IsQLangStartAtScPos * - returns true if this is a valid Q Language sc position * - ref: https://docs.raku.org/language/quoting * - Q :adverb :adverb //; * - q,qx,qw,qq,qqx,qqw,qqww :adverb /:adverb /; */ bool IsQLangStartAtScPos(StyleContext &sc, int &type, const Sci_Position length) { const bool valid_adj = IsValidRegOrQAdjacent(sc.chNext); const int chFw2 = sc.GetRelativeCharacter(2); const int chFw3 = sc.GetRelativeCharacter(3); type = -1; if (IsValidRegOrQPrecede(sc.chPrev)) { if (sc.ch == 'Q' && valid_adj) { type = RAKUTYPE_QLANG; } else if (sc.ch == 'q') { switch (sc.chNext) { case 'x': type = RAKUTYPE_STR_QX; break; case 'w': type = RAKUTYPE_STR_QW; break; case 'q': if (chFw2 == 'x') { type = RAKUTYPE_STR_QQX; } else if (chFw2 == 'w') { if (chFw3 == 'w') { type = RAKUTYPE_STR_QQWW; } else { type = RAKUTYPE_STR_QQW; } } else { type = RAKUTYPE_STR_QQ; } break; default: type = RAKUTYPE_STR_Q; } } else if (sc.ch == '<' && MatchCharInRange(sc, length, '>')) { type = RAKUTYPE_STR_WQ; // < word quote > } } return type >= 0; } /* * IsRegexStartAtScPos * - returns true if this is a valid Regex sc position * - ref: https://docs.raku.org/language/regexes * - Regex: (rx/s/m/tr/y) :adverb /:adverb /; * - regex R :adverb //; * - /:adverb /; */ bool IsRegexStartAtScPos(StyleContext &sc, int &type, CharacterSet &set) { const bool valid_adj = IsValidRegOrQAdjacent(sc.chNext); type = -1; if (IsValidRegOrQPrecede(sc.chPrev)) { switch (sc.ch) { case 'r': if (sc.chNext == 'x') type = RAKUTYPE_REGEX_RX; break; case 't': case 'T': if (sc.chNext == 'r' || sc.chNext == 'R') type = RAKUTYPE_REGEX_TR; break; case 'm': if (valid_adj) type = RAKUTYPE_REGEX_M; break; case 's': case 'S': if (valid_adj) type = RAKUTYPE_REGEX_S; break; case 'y': if (valid_adj) type = RAKUTYPE_REGEX_Y; break; case '/': if (set.Contains(PrevNonWhitespaceChar(sc))) type = RAKUTYPE_REGEX_NORM; } } return type >= 0; } /* * IsValidIdentPrecede * - returns if ch is a valid preceding char to put directly before an identifier */ bool IsValidIdentPrecede(int ch) noexcept { return !(IsAlphaNumeric(ch) || ch == '_' || ch == '@' || ch == '$' || ch == '%'); } /* * IsValidDelimiter * - returns if ch is a valid delimiter (most chars are valid) * * ref: Q Language: https://docs.raku.org/language/quoting */ bool IsValidDelimiter(int ch) noexcept { return !(IsAlphaNumeric(ch) || ch == ':'); } /* * GetDelimiterCloseChar * - returns the corresponding close char for a given delimiter (could be the same char) */ int GetDelimiterCloseChar(int ch) noexcept { int ch_end = GetBracketCloseChar(ch); if (ch_end == 0 && IsValidDelimiter(ch)) { ch_end = ch; } return ch_end; } /* * GetRepeatCharCount * - returns the occurrence count of match */ Sci_Position GetRepeatCharCount(StyleContext &sc, int chMatch, Sci_Position length) { Sci_Position cnt = 0; while (cnt < length) { if (sc.GetRelativeCharacter(cnt) != chMatch) { break; } cnt++; } return cnt; } /* * LengthToDelimiter * - returns the length until the end of a delimited string section * - Ignores nested delimiters (if opener != closer) * - no trailing char after last closer (default false) */ Sci_Position LengthToDelimiter(StyleContext &sc, const DelimPair &dp, Sci_Position length, bool noTrailing = false) { short cnt_open = 0; // count open bracket short cnt_close = 0; // count close bracket bool is_escape = false; // has been escaped using '\'? Sci_Position len = 0; // count characters int chOpener = dp.opener; // look for nested opener / closer if (dp.opener == dp.closer[0]) chOpener = 0; // no opening delimiter (no nesting possible) while (len < length) { const int chPrev = sc.GetRelativeCharacter(len - 1); const int ch = sc.GetRelativeCharacter(len); const int chNext = sc.GetRelativeCharacter(len+1); if (cnt_open == 0 && cnt_close == dp.count) { return len; // end condition has been met } else if (is_escape) { is_escape = false; } else if (ch == '\\') { is_escape = true; } else { if (ch == chOpener) { cnt_open++; // open nested bracket } else if (dp.isCloser(ch)) { if ( cnt_open > 0 ) { cnt_open--; // close nested bracket } else if (dp.count > 1 && cnt_close < (dp.count - 1)) { if (cnt_close > 1) { if (dp.isCloser(chPrev)) { cnt_close++; } else { // reset if previous char was not close cnt_close = 0; } } else { cnt_close++; } } else if (!noTrailing || (IsAWhitespace(chNext))) { cnt_close++; // found last close if (cnt_close > 1 && !dp.isCloser(chPrev)) { cnt_close = 0; // reset if previous char was not close } } else { cnt_close = 0; // non handled close: reset } } else if (IsANewLine(ch)) { cnt_open = 0; // reset after each line cnt_close = 0; } } len++; } return -1; // end condition has NOT been met } /* * LengthToEndHeredoc * - returns the length until the end of a heredoc section * - delimiter string MUST begin on a new line */ Sci_Position LengthToEndHeredoc(const StyleContext &sc, LexAccessor &styler, const Sci_Position length, const char *delim) { bool on_new_ln = false; int i = 0; // str index for (int n = 0; n < length; n++) { const char ch = styler.SafeGetCharAt(sc.currentPos + n, 0); if (on_new_ln) { if (delim[i] == '\0') return n; // at end of str, match found! if (ch != delim[i++]) i = 0; // no char match, reset 'i'ndex } if (i == 0) // detect new line on_new_ln = IsANewLine(ch); } return -1; // no match found } /* * LengthToNextChar * - returns the length until the next character */ Sci_Position LengthToNextChar(StyleContext &sc, const Sci_Position length) { Sci_Position len = 0; while (++len < length) { const int ch = sc.GetRelativeCharacter(len); if (!IsASpaceOrTab(ch) && !IsANewLine(ch)) { break; } } return len; } /* * GetRelativeString * - gets a relative string and sets it in &str * - resets string before setting */ void GetRelativeString(StyleContext &sc, Sci_Position offset, Sci_Position length, std::string &str) { Sci_Position pos = offset; str.clear(); while (pos < length) { str += sc.GetRelativeCharacter(pos++); } } } // end anonymous namespace /*----------------------------------------------------------------------------* * --- class: LexerRaku --- *----------------------------------------------------------------------------*/ //class LexerRaku : public ILexerWithMetaData { class LexerRaku : public DefaultLexer { CharacterSet setWord; CharacterSet setSigil; CharacterSet setTwigil; CharacterSet setOperator; CharacterSet setSpecialVar; WordList regexIdent; // identifiers that specify a regex OptionsRaku options; // Options from config OptionSetRaku osRaku; WordList keywords; // Word Lists from config WordList functions; WordList typesBasic; WordList typesComposite; WordList typesDomainSpecific; WordList typesExceptions; WordList adverbs; public: // Defined as explicit, so that constructor can not be copied explicit LexerRaku() : DefaultLexer("raku", SCLEX_RAKU), setWord(CharacterSet::setAlphaNum, "-_", 0x80), setSigil(CharacterSet::setNone, "$&%@"), setTwigil(CharacterSet::setNone, "!*.:<=?^~"), setOperator(CharacterSet::setNone, "^&\\()-+=|{}[]:;<>,?!.~"), setSpecialVar(CharacterSet::setNone, "_/!") { regexIdent.Set("regex rule token"); } // Deleted so LexerRaku objects can not be copied. LexerRaku(const LexerRaku &) = delete; LexerRaku(LexerRaku &&) = delete; void operator=(const LexerRaku &) = delete; void operator=(LexerRaku &&) = delete; virtual ~LexerRaku() { } void SCI_METHOD Release() noexcept override { delete this; } int SCI_METHOD Version() const noexcept override { return lvRelease5; } const char *SCI_METHOD PropertyNames() override { return osRaku.PropertyNames(); } int SCI_METHOD PropertyType(const char *name) override { return osRaku.PropertyType(name); } const char *SCI_METHOD DescribeProperty(const char *name) override { return osRaku.DescribeProperty(name); } Sci_Position SCI_METHOD PropertySet(const char *key, const char *val) override; const char *SCI_METHOD PropertyGet(const char *key) override { return osRaku.PropertyGet(key); } const char *SCI_METHOD DescribeWordListSets() override { return osRaku.DescribeWordListSets(); } Sci_Position SCI_METHOD WordListSet(int n, const char *wl) override; void SCI_METHOD Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void SCI_METHOD Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; static ILexer5 *LexerFactoryRaku() { return new LexerRaku(); } protected: bool IsOperatorChar(const int ch); bool IsWordChar(const int ch, bool allowNumber = true); bool IsWordStartChar(const int ch); bool IsNumberChar(const int ch, int base = 10); bool ProcessRegexTwinCapture(StyleContext &sc, const Sci_Position length, int &type, const DelimPair &dp); void ProcessStringVars(StyleContext &sc, const Sci_Position length, const int varState); bool ProcessValidRegQlangStart(StyleContext &sc, Sci_Position length, const int type, WordList &wordsAdverbs, DelimPair &dp); Sci_Position LengthToNonWordChar(StyleContext &sc, Sci_Position length, char *s, const int size, Sci_Position offset = 0); }; /*----------------------------------------------------------------------------* * --- METHODS: LexerRaku --- *----------------------------------------------------------------------------*/ /* * LexerRaku::IsOperatorChar * - Test for both ASCII and Unicode operators * see: https://docs.raku.org/language/unicode_entry */ bool LexerRaku::IsOperatorChar(const int ch) { if (ch > 0x7F) { switch (ch) { // Unicode ASCII Equiv. case 0x2208: // (elem) case 0x2209: // !(elem) case 0x220B: // (cont) case 0x220C: // !(cont) case 0x2216: // (-) case 0x2229: // (&) case 0x222A: // (|) case 0x2282: // (<) case 0x2283: // (>) case 0x2284: // !(<) case 0x2285: // !(>) case 0x2286: // (<=) case 0x2287: // (>=) case 0x2288: // !(<=) case 0x2289: // !(>=) case 0x228D: // (.) case 0x228E: // (+) case 0x2296: // (^) return true; } } return setOperator.Contains(ch); } /* * LexerRaku::IsWordChar * - Test for both ASCII and Unicode identifier characters * see: https://docs.raku.org/language/unicode_ascii * also: ftp://ftp.unicode.org/Public/UCD/latest/ucd/UnicodeData.txt * FIXME: *still* may not contain all valid characters */ bool LexerRaku::IsWordChar(const int ch, bool allowNumber) { // Unicode numbers should not appear in word identifiers if (ch > 0x7F) { const CharacterCategory cc = CategoriseCharacter(ch); switch (cc) { // Letters case ccLu: case ccLl: case ccLt: case ccLm: case ccLo: return true; default: return false; } } else if (allowNumber && IsADigit(ch)) { return true; // an ASCII number type } return setWord.Contains(ch); } /* * LexerRaku::IsWordStartChar * - Test for both ASCII and Unicode identifier "start / first" characters */ bool LexerRaku::IsWordStartChar(const int ch) { return ch != '-' && IsWordChar(ch, false); // no numbers allowed } /* * LexerRaku::IsNumberChar * - Test for both ASCII and Unicode identifier number characters * see: https://docs.raku.org/language/unicode_ascii * also: ftp://ftp.unicode.org/Public/UCD/latest/ucd/UnicodeData.txt * FILTERED by Unicode letters that are NUMBER * and NOT PARENTHESIZED or CIRCLED * FIXME: *still* may not contain all valid number characters */ bool LexerRaku::IsNumberChar(const int ch, int base) { if (ch > 0x7F) { const CharacterCategory cc = CategoriseCharacter(ch); switch (cc) { // Numbers case ccNd: case ccNl: case ccNo: return true; default: return false; } } return IsADigit(ch, base); } /* * LexerRaku::PropertySet * - */ Sci_Position SCI_METHOD LexerRaku::PropertySet(const char *key, const char *val) { if (osRaku.PropertySet(&options, key, val)) return 0; return -1; } /* * LexerRaku::WordListSet * - */ Sci_Position SCI_METHOD LexerRaku::WordListSet(int n, const char *wl) { WordList *wordListN = nullptr; switch (n) { case 0: wordListN = &keywords; break; case 1: wordListN = &functions; break; case 2: wordListN = &typesBasic; break; case 3: wordListN = &typesComposite; break; case 4: wordListN = &typesDomainSpecific; break; case 5: wordListN = &typesExceptions; break; case 6: wordListN = &adverbs; break; } Sci_Position firstModification = -1; if (wordListN) { if (wordListN->Set(wl)) { firstModification = 0; } } return firstModification; } /* * LexerRaku::ProcessRegexTwinCapture * - processes the transition between a regex pair (two sets of delimiters) * - moves to first new delimiter, if a bracket * - returns true when valid delimiter start found (if bracket) */ bool LexerRaku::ProcessRegexTwinCapture(StyleContext &sc, const Sci_Position length, int &type, const DelimPair &dp) { if (type == RAKUTYPE_REGEX_S || type == RAKUTYPE_REGEX_TR || type == RAKUTYPE_REGEX_Y) { type = -1; // clear type // move past chRegQClose if it was the previous char if (dp.isCloser(sc.chPrev)) sc.Forward(); // no processing needed for non-bracket if (dp.isCloser(dp.opener)) return true; // move to next opening bracket const Sci_Position len = LengthToNextChar(sc, length); if (sc.GetRelativeCharacter(len) == dp.opener) { sc.Forward(len); return true; } } return false; } /* * LexerRaku::ProcessStringVars * - processes a string and highlights any valid variables */ void LexerRaku::ProcessStringVars(StyleContext &sc, const Sci_Position length, const int varState) { const int state = sc.state; for (Sci_Position pos = 0; pos < length; pos++) { if (sc.state == varState && !IsWordChar(sc.ch)) { sc.SetState(state); } else if (sc.chPrev != '\\' && (sc.ch == '$' || sc.ch == '@') && IsWordStartChar(sc.chNext)) { sc.SetState(varState); } sc.Forward(); // Next character } } /* * LexerRaku::ProcessValidRegQlangStart * - processes a section of the document range from after a Regex / Q delimiter * - returns true on success * - sets: adverbs, chOpen, chClose, chCount * ref: https://docs.raku.org/language/regexes */ bool LexerRaku::ProcessValidRegQlangStart(StyleContext &sc, Sci_Position length, const int type, WordList &wordsAdverbs, DelimPair &dp) { Sci_Position startPos = sc.currentPos; Sci_Position startLen = length; const int target_state = sc.state; int state = SCE_RAKU_DEFAULT; std::string str; // find our opening delimiter (and occurrences) / save any adverbs dp.opener = 0; // adverbs can be after the first delimiter bool got_all_adverbs = false; // in Regex statements bool got_ident = false; // regex can have an identifier: 'regex R' sc.SetState(state); // set state default to avoid pre-highlights while ((dp.opener == 0 || !got_all_adverbs) && sc.More()) { // move to the next non-space character const bool was_space = IsAWhitespace(sc.ch); if (!got_all_adverbs && was_space) { sc.Forward(LengthToNextChar(sc, length)); } length = startLen - (sc.currentPos - startPos); // update length remaining // parse / eat an identifier (if type == RAKUTYPE_REGEX) if (dp.opener == 0 && !got_ident && type == RAKUTYPE_REGEX && IsAlphabet(sc.ch)) { // eat identifier / account for special adverb :sym bool got_sym = false; while (sc.More()) { sc.SetState(SCE_RAKU_IDENTIFIER); while (sc.More() && (IsAlphaNumeric(sc.chNext) || sc.chNext == '_' || sc.chNext == '-')) { sc.Forward(); } sc.Forward(); if (got_sym && sc.ch == '>') { sc.SetState(SCE_RAKU_OPERATOR); // '>' sc.Forward(); break; } else if (type == RAKUTYPE_REGEX && sc.Match(":sym<")) { sc.SetState(SCE_RAKU_ADVERB); // ':sym' sc.Forward(4); sc.SetState(SCE_RAKU_OPERATOR); // '<' sc.Forward(); got_sym = true; } else { break; } } sc.SetState(state); got_ident = true; } // parse / save an adverb: RAKUTYPE_REGEX only has adverbs after delim // >= RAKUTYPE_QLANG only has adverbs before delim else if (!got_all_adverbs && sc.ch == ':' && (!(dp.opener == 0 && got_ident) && !(dp.opener > 0 && type >= RAKUTYPE_QLANG))) { sc.SetState(SCE_RAKU_ADVERB); while (IsAlphaNumeric(sc.chNext) && sc.More()) { sc.Forward(); str += sc.ch; } str += ' '; sc.Forward(); sc.SetState(state); } // find starting delimiter else if (dp.opener == 0 && (was_space || IsValidRegOrQAdjacent(sc.ch)) && IsValidDelimiter(sc.ch)) { // make sure the delimiter is legal (most are) sc.SetState((state = target_state));// start state here... dp.opener = sc.ch; // this is our delimiter, get count if (type < RAKUTYPE_QLANG) // type is Regex dp.count = 1; // has only one delimiter else dp.count = GetRepeatCharCount(sc, dp.opener, length); sc.Forward(dp.count); } // we must have all the adverbs by now... else { if (got_all_adverbs) break; // prevent infinite loop: occurs on missing open char got_all_adverbs = true; } } // set word list / find a valid closing delimiter (or bomb!) wordsAdverbs.Set(str.c_str()); dp.closer[0] = GetDelimiterCloseChar(dp.opener); dp.closer[1] = 0; // no other closer char return dp.closer[0] > 0; } /* * LexerRaku::LengthToNonWordChar * - returns the length until the next non "word" character: AlphaNum + '_' * - also sets all the parsed chars in 's' */ Sci_Position LexerRaku::LengthToNonWordChar(StyleContext &sc, Sci_Position length, char *s, const int size, Sci_Position offset) { Sci_Position len = 0; Sci_Position max_length = size < length ? size : length; while (len <= max_length) { const int ch = sc.GetRelativeCharacter(len + offset); if (!IsWordChar(ch)) { s[len] = '\0'; break; } s[len] = ch; len++; } s[len + 1] = '\0'; return len; } /* * LexerRaku::Lex * - Main lexer method */ void SCI_METHOD LexerRaku::Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { LexAccessor styler(pAccess); DelimPair dpEmbeded; // delimiter pair: embedded comments DelimPair dpString; // delimiter pair: string DelimPair dpRegQ; // delimiter pair: Regex / Q Lang std::string hereDelim; // heredoc delimiter (if in heredoc) int hereState = 0; // heredoc state to use (Q / QQ) int numState = 0; // number state / type short cntDecimal = 0; // number decimal count std::string wordLast; // last word seen std::string identLast; // last identifier seen std::string adverbLast; // last (single) adverb seen WordList lastAdverbs; // last adverbs seen Sci_Position len; // temp length value char s[100]; // temp char string int typeDetect = -1; // temp type detected (for regex and Q lang) Sci_Position lengthToEnd; // length until the end of range // Backtrack to safe start position before complex quoted elements Sci_PositionU newStartPos = startPos; if (initStyle != SCE_RAKU_DEFAULT) { // Backtrack to last SCE_RAKU_DEFAULT or 0 while (newStartPos > 0) { newStartPos--; if (styler.StyleAt(newStartPos) == SCE_RAKU_DEFAULT) break; } // Backtrack to start of line before SCE_RAKU_HEREDOC_Q? if (initStyle == SCE_RAKU_HEREDOC_Q || initStyle == SCE_RAKU_HEREDOC_QQ) { if (newStartPos > 0) { newStartPos = styler.LineStart(styler.GetLine(newStartPos)); } } } else { const Sci_Position line = styler.GetLine(newStartPos); if (line > 0) { // If the previous line is a start of a q or qq heredoc, backtrack to start of line const Sci_Position startPreviousLine = styler.LineStart(line-1); if (ContainsQTo(startPreviousLine, newStartPos, styler)) { newStartPos = startPreviousLine; } } } // Re-calculate (any) changed startPos, length and initStyle state if (newStartPos < startPos) { initStyle = SCE_RAKU_DEFAULT; length += startPos - newStartPos; startPos = newStartPos; } // init StyleContext StyleContext sc(startPos, length, initStyle, styler); // StyleContext Loop for (; sc.More(); sc.Forward()) { lengthToEnd = (length - (sc.currentPos - startPos)); // end of range /* *** Determine if the current state should terminate ************** * * Everything within the 'switch' statement processes characters up * until the end of a syntax highlight section / state. * ****************************************************************** */ switch (sc.state) { case SCE_RAKU_OPERATOR: sc.SetState(SCE_RAKU_DEFAULT); break; // FIXME: better valid operator sequences needed? case SCE_RAKU_COMMENTLINE: if (IsANewLine(sc.ch)) { sc.SetState(SCE_RAKU_DEFAULT); } break; case SCE_RAKU_COMMENTEMBED: if ((len = LengthToDelimiter(sc, dpEmbeded, lengthToEnd)) >= 0) { sc.Forward(len); // Move to end delimiter sc.SetState(SCE_RAKU_DEFAULT); } else { sc.Forward(lengthToEnd); // no end delimiter found } break; case SCE_RAKU_POD: if (sc.atLineStart && sc.Match("=end pod")) { sc.Forward(8); sc.SetState(SCE_RAKU_DEFAULT); } break; case SCE_RAKU_STRING: // Process the string for variables: move to end delimiter if ((len = LengthToDelimiter(sc, dpString, lengthToEnd)) >= 0) { if (dpString.interpol) { ProcessStringVars(sc, len, SCE_RAKU_STRING_VAR); } else { sc.Forward(len); } sc.SetState(SCE_RAKU_DEFAULT); } else { sc.Forward(lengthToEnd); // no end delimiter found } break; case SCE_RAKU_STRING_Q: case SCE_RAKU_STRING_QQ: case SCE_RAKU_STRING_Q_LANG: // No string: previous char was the delimiter if (dpRegQ.count == 1 && dpRegQ.isCloser(sc.chPrev)) { sc.SetState(SCE_RAKU_DEFAULT); } // Process the string for variables: move to end delimiter else if ((len = LengthToDelimiter(sc, dpRegQ, lengthToEnd)) >= 0) { // set (any) heredoc delimiter string if (lastAdverbs.InList("to")) { GetRelativeString(sc, -1, len - dpRegQ.count, hereDelim); hereState = SCE_RAKU_HEREDOC_Q; // default heredoc state } // select variable identifiers if (sc.state == SCE_RAKU_STRING_QQ || lastAdverbs.InList("qq")) { ProcessStringVars(sc, len, SCE_RAKU_STRING_VAR); hereState = SCE_RAKU_HEREDOC_QQ; // potential heredoc state } else { sc.Forward(len); } sc.SetState(SCE_RAKU_DEFAULT); } else { sc.Forward(lengthToEnd); // no end delimiter found } break; case SCE_RAKU_HEREDOC_Q: case SCE_RAKU_HEREDOC_QQ: if ((len = LengthToEndHeredoc(sc, styler, lengthToEnd, hereDelim.c_str())) >= 0) { // select variable identifiers if (sc.state == SCE_RAKU_HEREDOC_QQ) { ProcessStringVars(sc, len, SCE_RAKU_STRING_VAR); } else { sc.Forward(len); } sc.SetState(SCE_RAKU_DEFAULT); } else { sc.Forward(lengthToEnd); // no end delimiter found } hereDelim.clear(); // clear heredoc delimiter break; case SCE_RAKU_REGEX: // account for typeDetect = RAKUTYPE_REGEX_S/TR/Y while (sc.state == SCE_RAKU_REGEX) { // No string: previous char was the delimiter if (dpRegQ.count == 1 && dpRegQ.isCloser(sc.chPrev)) { if (ProcessRegexTwinCapture(sc, lengthToEnd, typeDetect, dpRegQ)) continue; sc.SetState(SCE_RAKU_DEFAULT); break; } // Process the string for variables: move to end delimiter else if ((len = LengthToDelimiter(sc, dpRegQ, lengthToEnd)) >= 0) { ProcessStringVars(sc, len, SCE_RAKU_REGEX_VAR); if (ProcessRegexTwinCapture(sc, lengthToEnd, typeDetect, dpRegQ)) continue; sc.SetState(SCE_RAKU_DEFAULT); break; } else { sc.Forward(lengthToEnd); // no end delimiter found break; } } break; case SCE_RAKU_NUMBER: if (sc.ch == '.') { if (sc.chNext == '.') { // '..' is an operator sc.SetState(SCE_RAKU_OPERATOR); sc.Forward(); if (sc.chNext == '.') // '...' is also an operator sc.Forward(); break; } else if (numState > RAKUNUM_FLOAT_EXP && (cntDecimal < 1 || numState == RAKUNUM_VERSION)) { cntDecimal++; sc.Forward(); } else { sc.SetState(SCE_RAKU_DEFAULT); break; // too many decimal places } } switch (numState) { case RAKUNUM_BINARY: if (!IsNumberChar(sc.ch, 2)) sc.SetState(SCE_RAKU_DEFAULT); break; case RAKUNUM_OCTAL: if (!IsNumberChar(sc.ch, 8)) sc.SetState(SCE_RAKU_DEFAULT); break; case RAKUNUM_HEX: if (!IsNumberChar(sc.ch, 16)) sc.SetState(SCE_RAKU_DEFAULT); break; case RAKUNUM_DECIMAL: case RAKUNUM_VERSION: if (!IsNumberChar(sc.ch)) sc.SetState(SCE_RAKU_DEFAULT); } break; case SCE_RAKU_WORD: case SCE_RAKU_FUNCTION: case SCE_RAKU_TYPEDEF: case SCE_RAKU_ADVERB: sc.SetState(SCE_RAKU_DEFAULT); break; case SCE_RAKU_MU: case SCE_RAKU_POSITIONAL: case SCE_RAKU_ASSOCIATIVE: case SCE_RAKU_CALLABLE: case SCE_RAKU_IDENTIFIER: case SCE_RAKU_GRAMMAR: case SCE_RAKU_CLASS: sc.SetState(SCE_RAKU_DEFAULT); break; } /* *** Determine if a new state should be entered ******************* * * Everything below here identifies the beginning of a state, all or part * of the characters within this state are processed here, the rest are * completed above in the terminate state section. * ****************************************************************** */ if (sc.state == SCE_RAKU_DEFAULT) { // --- Single line comment if (sc.ch == '#') { sc.SetState(SCE_RAKU_COMMENTLINE); } // --- POD block else if (sc.atLineStart && sc.Match("=begin pod")) { sc.SetState(SCE_RAKU_POD); sc.Forward(10); } // --- String (normal) else if (sc.chPrev != '\\' && (IsValidQuoteOpener(sc.ch, dpString, RAKUDELIM_QUOTE))) { sc.SetState(SCE_RAKU_STRING); } // --- String (Q Language) ---------------------------------------- // - https://docs.raku.org/language/quoting // - Q :adverb :adverb //; // - q,qx,qw,qq,qqx,qqw,qqww :adverb :adverb //; else if (IsQLangStartAtScPos(sc, typeDetect, lengthToEnd)) { int state = SCE_RAKU_STRING_Q_LANG; Sci_Position forward = 1; // single char ident (default) if (typeDetect > RAKUTYPE_QLANG) { state = SCE_RAKU_STRING_Q; if (typeDetect == RAKUTYPE_STR_WQ) forward = 0; // no char ident } if (typeDetect > RAKUTYPE_STR_Q) { if (typeDetect == RAKUTYPE_STR_QQ) state = SCE_RAKU_STRING_QQ; forward++; // two char ident } if (typeDetect > RAKUTYPE_STR_QQ) forward++; // three char ident if (typeDetect == RAKUTYPE_STR_QQWW) forward++; // four char ident // Proceed: check for a valid character after statement if (IsValidRegOrQAdjacent(sc.GetRelative(forward)) || typeDetect == RAKUTYPE_QLANG) { sc.SetState(state); sc.Forward(forward); lastAdverbs.Clear(); // Process: adverbs / opening delimiter / adverbs after delim if (ProcessValidRegQlangStart(sc, lengthToEnd, typeDetect, lastAdverbs, dpRegQ)) sc.SetState(state); } } // --- Regex (rx/s/m/tr/y) ---------------------------------------- // - https://docs.raku.org/language/regexes else if ((IsRegexStartAtScPos(sc, typeDetect, setOperator) || regexIdent.InList(wordLast.c_str()))) { if (typeDetect == -1) { // must be a regex identifier word wordLast.clear(); typeDetect = RAKUTYPE_REGEX; } Sci_Position forward = 0; // no ident (RAKUTYPE_REGEX, RAKUTYPE_REGEX_NORM) if (typeDetect > 0 && typeDetect != RAKUTYPE_REGEX) forward++; // single char ident if (typeDetect > RAKUTYPE_REGEX) forward++; // two char ident // Proceed: check for a valid character after statement if (IsValidRegOrQAdjacent(sc.GetRelative(forward)) || typeDetect == RAKUTYPE_REGEX_NORM) { sc.SetState(SCE_RAKU_REGEX); sc.Forward(forward); lastAdverbs.Clear(); // Process: adverbs / opening delimiter / adverbs after delim if (ProcessValidRegQlangStart(sc, lengthToEnd, typeDetect, lastAdverbs, dpRegQ)) sc.SetState(SCE_RAKU_REGEX); } } // --- Numbers ---------------------------------------------------- else if (IsValidIdentPrecede(sc.chPrev) && (IsNumberChar(sc.ch) || (sc.ch == 'v' && IsNumberChar(sc.chNext) && wordLast == "use"))) { numState = RAKUNUM_DECIMAL; // default: decimal (base 10) cntDecimal = 0; sc.SetState(SCE_RAKU_NUMBER); if (sc.ch == 'v') // forward past 'v' sc.Forward(); if (wordLast == "use") { // package version number numState = RAKUNUM_VERSION; } else if (sc.ch == '0') { // other type of number switch (sc.chNext) { case 'b': // binary (base 2) numState = RAKUNUM_BINARY; break; case 'o': // octal (base 8) numState = RAKUNUM_OCTAL; break; case 'x': // hexadecimal (base 16) numState = RAKUNUM_HEX; } if (numState != RAKUNUM_DECIMAL) sc.Forward(); // forward to number type char } } // --- Keywords / functions / types / barewords ------------------- else if ((sc.currentPos == 0 || sc.atLineStart || IsValidIdentPrecede(sc.chPrev)) && IsWordStartChar(sc.ch)) { len = LengthToNonWordChar(sc, lengthToEnd, s, sizeof(s)); if (keywords.InList(s)) { sc.SetState(SCE_RAKU_WORD); // Keywords } else if(functions.InList(s)) { sc.SetState(SCE_RAKU_FUNCTION); // Functions } else if(typesBasic.InList(s)) { sc.SetState(SCE_RAKU_TYPEDEF); // Types (basic) } else if(typesComposite.InList(s)) { sc.SetState(SCE_RAKU_TYPEDEF); // Types (composite) } else if(typesDomainSpecific.InList(s)) { sc.SetState(SCE_RAKU_TYPEDEF); // Types (domain-specific) } else if(typesExceptions.InList(s)) { sc.SetState(SCE_RAKU_TYPEDEF); // Types (exceptions) } else { if (wordLast == "class") sc.SetState(SCE_RAKU_CLASS); // a Class ident else if (wordLast == "grammar") sc.SetState(SCE_RAKU_GRAMMAR); // a Grammar ident else sc.SetState(SCE_RAKU_IDENTIFIER); // Bareword identLast = s; // save identifier } if (adverbLast == "sym") { // special adverb ":sym" sc.SetState(SCE_RAKU_IDENTIFIER); // treat as identifier identLast = s; // save identifier } if (sc.state != SCE_RAKU_IDENTIFIER) wordLast = s; // save word sc.Forward(len - 1); // ...forward past word } // --- Adverbs ---------------------------------------------------- else if (sc.ch == ':' && IsWordStartChar(sc.chNext)) { len = LengthToNonWordChar(sc, lengthToEnd, s, sizeof(s), 1); if (adverbs.InList(s)) { sc.SetState(SCE_RAKU_ADVERB); // Adverbs (begin with ':') adverbLast = s; // save word sc.Forward(len); // ...forward past word (less offset: 1) } } // --- Identifiers: $mu / @positional / %associative / &callable -- // see: https://docs.raku.org/language/variables else if (setSigil.Contains(sc.ch) && (setTwigil.Contains(sc.chNext) || setSpecialVar.Contains(sc.chNext) || IsWordStartChar(sc.chNext))) { // State based on sigil switch (sc.ch) { case '$': sc.SetState(SCE_RAKU_MU); break; case '@': sc.SetState(SCE_RAKU_POSITIONAL); break; case '%': sc.SetState(SCE_RAKU_ASSOCIATIVE); break; case '&': sc.SetState(SCE_RAKU_CALLABLE); } const int state = sc.state; sc.Forward(); char ch_delim = 0; if (setSpecialVar.Contains(sc.ch) && !setWord.Contains(sc.chNext)) { // Process Special Var ch_delim = -1; } else if (setTwigil.Contains(sc.ch)) { // Process Twigil sc.SetState(SCE_RAKU_OPERATOR); if (sc.ch == '<' && setWord.Contains(sc.chNext)) ch_delim = '>'; sc.Forward(); sc.SetState(state); } // Process (any) identifier if (ch_delim >= 0) { sc.Forward(LengthToNonWordChar(sc, lengthToEnd, s, sizeof(s)) - 1); if (ch_delim > 0 && sc.chNext == ch_delim) { sc.Forward(); sc.SetState(SCE_RAKU_OPERATOR); } identLast = s; // save identifier } } // --- Operators -------------------------------------------------- else if (IsOperatorChar(sc.ch)) { // FIXME: better valid operator sequences needed? sc.SetState(SCE_RAKU_OPERATOR); } // --- Heredoc: begin --------------------------------------------- else if (!hereDelim.empty() && sc.atLineEnd) { if (IsANewLine(sc.ch)) sc.Forward(); // skip a possible CRLF situation sc.SetState(hereState); } // Reset words: on operator semi-colon OR '}' (end of statement) if (sc.state == SCE_RAKU_OPERATOR && (sc.ch == ';' || sc.ch == '}')) { wordLast.clear(); identLast.clear(); adverbLast.clear(); } } /* *** Determine if an "embedded comment" is to be entered ********** * * This type of embedded comment section, or multi-line comment comes * after a normal comment has begun... e.g: #`[ ... ] * ****************************************************************** */ else if (sc.state == SCE_RAKU_COMMENTLINE && sc.chPrev == '#' && sc.ch == '`') { if (IsBracketOpenChar(sc.chNext)) { sc.Forward(); // Condition met for "embedded comment" dpEmbeded.opener = sc.ch; // Find the opposite (termination) closing bracket (if any) dpEmbeded.closer[0] = GetBracketCloseChar(dpEmbeded.opener); if (dpEmbeded.closer[0] > 0) { // Enter "embedded comment" // Find multiple opening character occurrence dpEmbeded.count = GetRepeatCharCount(sc, dpEmbeded.opener, lengthToEnd); sc.SetState(SCE_RAKU_COMMENTEMBED); sc.Forward(dpEmbeded.count - 1); // incremented in the next loop } } } } // And we're done... sc.Complete(); } /* * LexerRaku::Lex * - Main fold method * NOTE: although Raku uses and supports UNICODE characters, we're only looking * at normal chars here, using 'SafeGetCharAt' - for folding purposes * that is all we need. */ #define RAKU_HEADFOLD_SHIFT 4 #define RAKU_HEADFOLD_MASK 0xF0 void SCI_METHOD LexerRaku::Fold(Sci_PositionU startPos, Sci_Position length, int /* initStyle */, IDocument *pAccess) { // init LexAccessor / return if fold option is off if (!options.fold) return; LexAccessor styler(pAccess); // init char and line positions const Sci_PositionU endPos = startPos + length; Sci_Position lineCurrent = styler.GetLine(startPos); // Backtrack to last SCE_RAKU_DEFAULT line if (startPos > 0 && lineCurrent > 0) { while (lineCurrent > 0 && styler.StyleAt(startPos) != SCE_RAKU_DEFAULT) { lineCurrent--; startPos = styler.LineStart(lineCurrent); } lineCurrent = styler.GetLine(startPos); } Sci_PositionU lineStart = startPos; Sci_PositionU lineStartNext = styler.LineStart(lineCurrent + 1); // init line folding level int levelPrev = SC_FOLDLEVELBASE; if (lineCurrent > 0) levelPrev = styler.LevelAt(lineCurrent - 1) >> 16; int levelCurrent = levelPrev; // init char and style variables char chNext = styler[startPos]; int stylePrev = styler.StyleAt(startPos - 1); int styleNext = styler.StyleAt(startPos); int styleNextStartLine = styler.StyleAt(lineStartNext); int visibleChars = 0; bool wasCommentMulti = false; // main loop for (Sci_PositionU i = startPos; i < endPos; i++) { // next char, style and flags const char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); const int style = styleNext; styleNext = styler.StyleAt(i + 1); const bool atEOL = i == (lineStartNext - 1); const bool atLineStart = i == lineStart; // --- Comments / Multi-line / POD ------------------------------------ if (options.foldComment) { // Multi-line if (options.foldCommentMultiline) { if (style == SCE_RAKU_COMMENTLINE && atLineStart && ch == '#' && chNext == '`' && styleNextStartLine == SCE_RAKU_COMMENTEMBED) { levelCurrent++; wasCommentMulti = true; // don't confuse line comments } else if (style == SCE_RAKU_COMMENTEMBED && atLineStart && styleNextStartLine != SCE_RAKU_COMMENTEMBED) { levelCurrent--; } } // Line comments if (!wasCommentMulti && atEOL && stylePrev == SCE_RAKU_COMMENTLINE && IsCommentLine(lineCurrent, styler)) { if (!IsCommentLine(lineCurrent - 1, styler) && IsCommentLine(lineCurrent + 1, styler)) levelCurrent++; else if (IsCommentLine(lineCurrent - 1, styler) && !IsCommentLine(lineCurrent + 1, styler)) levelCurrent--; } // POD if (options.foldCommentPOD && atLineStart && style == SCE_RAKU_POD) { if (styler.Match(i, "=begin")) levelCurrent++; else if (styler.Match(i, "=end")) levelCurrent--; } } // --- Code block ----------------------------------------------------- if (style == SCE_RAKU_OPERATOR) { if (ch == '{') { if (levelCurrent < levelPrev) levelPrev--; levelCurrent++; } else if (ch == '}') { levelCurrent--; } } // --- at end of line / range / apply fold ---------------------------- if (atEOL) { int level = levelPrev; // set level flags level |= levelCurrent << 16; if (visibleChars == 0 && options.foldCompact) level |= SC_FOLDLEVELWHITEFLAG; if ((levelCurrent > levelPrev) && (visibleChars > 0)) level |= SC_FOLDLEVELHEADERFLAG; if (level != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, level); } lineCurrent++; lineStart = lineStartNext; lineStartNext = styler.LineStart(lineCurrent + 1); styleNextStartLine = styler.StyleAt(lineStartNext); levelPrev = levelCurrent; visibleChars = 0; wasCommentMulti = false; } // increment visibleChars / set previous char if (!isspacechar(ch)) visibleChars++; stylePrev = style; } // Done: set real level of the next line int flagsNext = styler.LevelAt(lineCurrent) & ~SC_FOLDLEVELNUMBERMASK; styler.SetLevel(lineCurrent, levelPrev | flagsNext); } /*----------------------------------------------------------------------------* * --- Scintilla: LexerModule --- *----------------------------------------------------------------------------*/ LexerModule lmRaku(SCLEX_RAKU, LexerRaku::LexerFactoryRaku, "raku", rakuWordLists); lexilla/lexers/LexProgress.cxx0000664000175000017500000005105014647367374015503 0ustar neilneil// Scintilla source code edit control /** @file LexProgress.cxx ** Lexer for Progress 4GL. ** Based on LexCPP.cxx of Neil Hodgson **/ // Copyright 2006-2016 by Yuval Papish // The License.txt file describes the conditions under which this software may be distributed. /** TODO: SpeedScript support in html lexer Differentiate between labels and variables Option 1: By symbols table Option 2: As a single unidentified symbol in a sytactical line **/ #include #include #include #include #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" #include "OptionSet.h" #include "SparseState.h" #include "DefaultLexer.h" using namespace Scintilla; using namespace Lexilla; namespace { // Use an unnamed namespace to protect the functions and classes from name conflicts bool IsSpaceEquiv(int state) { return (state == SCE_ABL_COMMENT || state == SCE_ABL_LINECOMMENT || state == SCE_ABL_DEFAULT); } void highlightTaskMarker(StyleContext &sc, LexAccessor &styler, WordList &markerList){ if ((isoperator(sc.chPrev) || IsASpace(sc.chPrev)) && markerList.Length()) { const int lengthMarker = 50; char marker[lengthMarker+1]; Sci_Position currPos = (Sci_Position) sc.currentPos; Sci_Position i = 0; while (i < lengthMarker) { char ch = styler.SafeGetCharAt(currPos + i); if (IsASpace(ch) || isoperator(ch)) { break; } marker[i] = ch; i++; } marker[i] = '\0'; if (markerList.InListAbbreviated (marker,'(')) { sc.SetState(SCE_ABL_TASKMARKER); } } } bool IsStreamCommentStyle(int style) { return style == SCE_ABL_COMMENT; // style == SCE_ABL_LINECOMMENT; Only block comments are used for folding } // Options used for LexerABL struct OptionsABL { bool fold; bool foldSyntaxBased; bool foldComment; bool foldCommentMultiline; bool foldCompact; OptionsABL() { fold = false; foldSyntaxBased = true; foldComment = true; foldCommentMultiline = true; foldCompact = false; } }; const char *const ablWordLists[] = { "Primary keywords and identifiers", "Keywords that opens a block, only when used to begin a syntactic line", "Keywords that opens a block anywhere in a syntactic line", "Task Marker", /* "END MODIFY START TODO" */ 0, }; struct OptionSetABL : public OptionSet { OptionSetABL() { DefineProperty("fold", &OptionsABL::fold); DefineProperty("fold.abl.syntax.based", &OptionsABL::foldSyntaxBased, "Set this property to 0 to disable syntax based folding."); DefineProperty("fold.comment", &OptionsABL::foldComment, "This option enables folding multi-line comments and explicit fold points when using the ABL lexer. "); DefineProperty("fold.abl.comment.multiline", &OptionsABL::foldCommentMultiline, "Set this property to 0 to disable folding multi-line comments when fold.comment=1."); DefineProperty("fold.compact", &OptionsABL::foldCompact); DefineWordListSets(ablWordLists); } }; } class LexerABL : public DefaultLexer { CharacterSet setWord; CharacterSet setNegationOp; CharacterSet setArithmethicOp; CharacterSet setRelOp; CharacterSet setLogicalOp; CharacterSet setWordStart; WordList keywords1; // regular keywords WordList keywords2; // block opening keywords, only when isSentenceStart WordList keywords3; // block opening keywords WordList keywords4; // Task Marker OptionsABL options; OptionSetABL osABL; public: LexerABL() : DefaultLexer("abl", SCLEX_PROGRESS), setWord(CharacterSet::setAlphaNum, "_", 0x80, true), setNegationOp(CharacterSet::setNone, "!"), setArithmethicOp(CharacterSet::setNone, "+-/*%"), setRelOp(CharacterSet::setNone, "=!<>"), setLogicalOp(CharacterSet::setNone, "|&"){ } virtual ~LexerABL() { } void SCI_METHOD Release() override { delete this; } int SCI_METHOD Version() const override { return lvRelease5; } const char * SCI_METHOD PropertyNames() override { return osABL.PropertyNames(); } int SCI_METHOD PropertyType(const char *name) override { return osABL.PropertyType(name); } const char * SCI_METHOD DescribeProperty(const char *name) override { return osABL.DescribeProperty(name); } Sci_Position SCI_METHOD PropertySet(const char *key, const char *val) override ; const char * SCI_METHOD PropertyGet(const char *key) override { return osABL.PropertyGet(key); } const char * SCI_METHOD DescribeWordListSets() override { return osABL.DescribeWordListSets(); } Sci_Position SCI_METHOD WordListSet(int n, const char *wl) override; void SCI_METHOD Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void SCI_METHOD Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void * SCI_METHOD PrivateCall(int, void *) override { return 0; } int SCI_METHOD LineEndTypesSupported() override { return SC_LINE_END_TYPE_DEFAULT; } static ILexer5 *LexerFactoryABL() { return new LexerABL(); } }; Sci_Position SCI_METHOD LexerABL::PropertySet(const char *key, const char *val) { if (osABL.PropertySet(&options, key, val)) { return 0; } return -1; } Sci_Position SCI_METHOD LexerABL::WordListSet(int n, const char *wl) { WordList *wordListN = 0; switch (n) { case 0: wordListN = &keywords1; break; case 1: wordListN = &keywords2; break; case 2: wordListN = &keywords3; break; case 3: wordListN = &keywords4; break; } Sci_Position firstModification = -1; if (wordListN) { WordList wlNew; wlNew.Set(wl); if (*wordListN != wlNew) { wordListN->Set(wl); firstModification = 0; } } return firstModification; } #if defined(__clang__) #if __has_warning("-Wunused-but-set-variable") // Disable warning for visibleChars #pragma clang diagnostic ignored "-Wunused-but-set-variable" #endif #endif void SCI_METHOD LexerABL::Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { LexAccessor styler(pAccess); setWordStart = CharacterSet(CharacterSet::setAlpha, "_", 0x80, true); int visibleChars = 0; int visibleChars1 = 0; int styleBeforeTaskMarker = SCE_ABL_DEFAULT; bool continuationLine = false; int commentNestingLevel = 0; bool isSentenceStart = true; bool possibleOOLChange = false; Sci_Position lineCurrent = styler.GetLine(startPos); if (initStyle == SCE_ABL_PREPROCESSOR) { // Set continuationLine if last character of previous line is '~' if (lineCurrent > 0) { Sci_Position endLinePrevious = styler.LineEnd(lineCurrent-1); if (endLinePrevious > 0) { continuationLine = styler.SafeGetCharAt(endLinePrevious-1) == '~'; } } } // Look back to set variables that are actually invisible secondary states. The reason to avoid formal states is to cut down on state's bits if (startPos > 0) { Sci_Position back = startPos; bool checkCommentNestingLevel = (initStyle == SCE_ABL_COMMENT); bool checkIsSentenceStart = (initStyle == SCE_ABL_DEFAULT || initStyle == SCE_ABL_IDENTIFIER); char ch; char st; char chPrev; char chPrev_1; char chPrev_2; char chPrev_3; while (back >= 0 && (checkCommentNestingLevel || checkIsSentenceStart)) { ch = styler.SafeGetCharAt(back); styler.Flush(); // looking at styles so need to flush st = styler.StyleAt(back); chPrev = styler.SafeGetCharAt(back-1); // isSentenceStart is a non-visible state, used to identify where statements and preprocessor declerations can start if (checkIsSentenceStart && st != SCE_ABL_COMMENT && st != SCE_ABL_LINECOMMENT && st != SCE_ABL_CHARACTER && st != SCE_ABL_STRING ) { chPrev_1 = styler.SafeGetCharAt(back-2); chPrev_2 = styler.SafeGetCharAt(back-3); chPrev_3 = styler.SafeGetCharAt(back-4); if ((chPrev == '.' || chPrev == ':' || chPrev == '}' || (chPrev_3 == 'e' && chPrev_2 == 'l' && chPrev_1 == 's' && chPrev == 'e') || (chPrev_3 == 't' && chPrev_2 == 'h' && chPrev_1 == 'e' && chPrev == 'n')) && (IsASpace(ch) || (ch == '/' && styler.SafeGetCharAt(back+1) == '*')) ) { checkIsSentenceStart = false; isSentenceStart = true; } else if (IsASpace(chPrev) && ch == '{') { checkIsSentenceStart = false; isSentenceStart = false; } } // commentNestingLevel is a non-visible state, used to identify the nesting level of a comment if (checkCommentNestingLevel) { if (chPrev == '/' && ch == '*') { commentNestingLevel++; // eat the '/' so we don't miscount a */ if we see /*/* --back; } if (chPrev == '*' && ch == '/') { commentNestingLevel--; // eat the '*' so we don't miscount a /* if we see */*/ --back; } } --back; } } StyleContext sc(startPos, length, initStyle, styler, static_cast(0xff)); Sci_Position lineEndNext = styler.LineEnd(lineCurrent); for (; sc.More();) { if (sc.atLineStart) { visibleChars = 0; visibleChars1 = 0; } if (sc.atLineEnd) { lineCurrent++; lineEndNext = styler.LineEnd(lineCurrent); } // Handle line continuation generically. if (sc.ch == '~') { if (static_cast((sc.currentPos+1)) >= lineEndNext) { lineCurrent++; lineEndNext = styler.LineEnd(lineCurrent); sc.Forward(); if (sc.ch == '\r' && sc.chNext == '\n') { sc.Forward(); } continuationLine = true; sc.Forward(); continue; } } const bool atLineEndBeforeSwitch = sc.atLineEnd; // Determine if the current state should terminate. switch (sc.state) { case SCE_ABL_OPERATOR: sc.SetState(SCE_ABL_DEFAULT); break; case SCE_ABL_NUMBER: // We accept almost anything because of hex. and maybe number suffixes and scientific notations in the future if (!(setWord.Contains(sc.ch) || ((sc.ch == '+' || sc.ch == '-') && (sc.chPrev == 'e' || sc.chPrev == 'E' || sc.chPrev == 'p' || sc.chPrev == 'P')))) { sc.SetState(SCE_ABL_DEFAULT); } break; case SCE_ABL_IDENTIFIER: if (sc.atLineStart || sc.atLineEnd || (!setWord.Contains(sc.ch) && sc.ch != '-')) { char s[1000]; sc.GetCurrentLowered(s, sizeof(s)); bool isLastWordEnd = (s[0] == 'e' && s[1] =='n' && s[2] == 'd' && !IsAlphaNumeric(s[3]) && s[3] != '-'); // helps to identify "end trigger" phrase if ((isSentenceStart && keywords2.InListAbbreviated (s,'(')) || (!isLastWordEnd && keywords3.InListAbbreviated (s,'('))) { sc.ChangeState(SCE_ABL_BLOCK); isSentenceStart = false; } else if (keywords1.InListAbbreviated (s,'(')) { if (isLastWordEnd || (s[0] == 'f' && s[1] =='o' && s[2] == 'r' && s[3] == 'w' && s[4] =='a' && s[5] == 'r' && s[6] == 'd'&& !IsAlphaNumeric(s[7]))) { sc.ChangeState(SCE_ABL_END); isSentenceStart = false; } else if ((s[0] == 'e' && s[1] =='l' && s[2] == 's' && s[3] == 'e') || (s[0] == 't' && s[1] =='h' && s[2] == 'e' && s[3] == 'n')) { sc.ChangeState(SCE_ABL_WORD); isSentenceStart = true; } else { sc.ChangeState(SCE_ABL_WORD); isSentenceStart = false; } } sc.SetState(SCE_ABL_DEFAULT); } break; case SCE_ABL_PREPROCESSOR: if (sc.atLineStart && !continuationLine) { sc.SetState(SCE_ABL_DEFAULT); // Force Scintilla to acknowledge changed stated even though this change might happen outside of the current line possibleOOLChange = true; isSentenceStart = true; } break; case SCE_ABL_LINECOMMENT: if (sc.atLineStart && !continuationLine) { sc.SetState(SCE_ABL_DEFAULT); isSentenceStart = true; } else { styleBeforeTaskMarker = SCE_ABL_LINECOMMENT; highlightTaskMarker(sc, styler, keywords4); } break; case SCE_ABL_TASKMARKER: if (isoperator(sc.ch) || IsASpace(sc.ch)) { sc.SetState(styleBeforeTaskMarker); styleBeforeTaskMarker = SCE_ABL_DEFAULT; } // fall through case SCE_ABL_COMMENT: if (sc.Match('*', '/')) { sc.Forward(); commentNestingLevel--; if (commentNestingLevel == 0) { sc.ForwardSetState(SCE_ABL_DEFAULT); possibleOOLChange = true; } } else if (sc.Match('/', '*')) { commentNestingLevel++; sc.Forward(); } if (commentNestingLevel > 0) { styleBeforeTaskMarker = SCE_ABL_COMMENT; possibleOOLChange = true; highlightTaskMarker(sc, styler, keywords4); } break; case SCE_ABL_STRING: if (sc.ch == '~') { sc.Forward(); // Skip a character after a tilde } else if (sc.ch == '\"') { sc.ForwardSetState(SCE_ABL_DEFAULT); } break; case SCE_ABL_CHARACTER: if (sc.ch == '~') { sc.Forward(); // Skip a character after a tilde } else if (sc.ch == '\'') { sc.ForwardSetState(SCE_ABL_DEFAULT); } break; } if (sc.atLineEnd && !atLineEndBeforeSwitch) { // State exit processing consumed characters up to end of line. lineCurrent++; lineEndNext = styler.LineEnd(lineCurrent); } // Determine if a new state should be entered. if (sc.state == SCE_ABL_DEFAULT) { if (IsADigit(sc.ch) || (sc.ch == '.' && IsADigit(sc.chNext))) { sc.SetState(SCE_ABL_NUMBER); isSentenceStart = false; } else if (!sc.atLineEnd && (setWordStart.Contains(sc.ch)) && sc.chPrev != '&') { sc.SetState(SCE_ABL_IDENTIFIER); } else if (sc.Match('/', '*')) { if (sc.chPrev == '.' || sc.chPrev == ':' || sc.chPrev == '}') { isSentenceStart = true; } sc.SetState(SCE_ABL_COMMENT); possibleOOLChange = true; commentNestingLevel++; sc.Forward(); // Eat the * so it isn't used for the end of the comment } else if (sc.ch == '\"') { sc.SetState(SCE_ABL_STRING); isSentenceStart = false; } else if (sc.ch == '\'') { sc.SetState(SCE_ABL_CHARACTER); isSentenceStart = false; } else if (sc.ch == '&' && visibleChars1 == 0 && isSentenceStart) { // Preprocessor commands are alone on their line sc.SetState(SCE_ABL_PREPROCESSOR); // Force Scintilla to acknowledge changed stated even though this change might happen outside of the current line possibleOOLChange = true; // Skip whitespace between & and preprocessor word do { sc.Forward(); } while ((sc.ch == ' ' || sc.ch == '\t') && sc.More()); if (sc.atLineEnd) { sc.SetState(SCE_ABL_DEFAULT); } } else if (sc.Match('/','/') && (IsASpace(sc.chPrev) || isSentenceStart)) { // Line comments are valid after a white space or EOL sc.SetState(SCE_ABL_LINECOMMENT); // Skip whitespace between // and preprocessor word do { sc.Forward(); } while ((sc.ch == ' ' || sc.ch == '\t') && sc.More()); if (sc.atLineEnd) { sc.SetState(SCE_ABL_DEFAULT); } } else if (isoperator(sc.ch)) { sc.SetState(SCE_ABL_OPERATOR); /* This code allows highlight of handles. Alas, it would cause the phrase "last-event:function" to be recognized as a BlockBegin */ isSentenceStart = false; } else if ((sc.chPrev == '.' || sc.chPrev == ':' || sc.chPrev == '}') && (IsASpace(sc.ch))) { isSentenceStart = true; } } if (!IsASpace(sc.ch)) { visibleChars1++; } if (!IsASpace(sc.ch) && !IsSpaceEquiv(sc.state)) { visibleChars++; } continuationLine = false; sc.Forward(); } if (possibleOOLChange) styler.ChangeLexerState(startPos, startPos + length); sc.Complete(); } // Store both the current line's fold level and the next lines in the // level store to make it easy to pick up with each increment // and to make it possible to fiddle the current level for "} else {". void SCI_METHOD LexerABL::Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { if (!options.fold) return; LexAccessor styler(pAccess); Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelCurrent = SC_FOLDLEVELBASE; if (lineCurrent > 0) levelCurrent = styler.LevelAt(lineCurrent-1) >> 16; Sci_PositionU lineStartNext = styler.LineStart(lineCurrent+1); int levelNext = levelCurrent; char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); int style = initStyle; for (Sci_PositionU i = startPos; i < endPos; i++) { chNext = static_cast(tolower(chNext)); // check tolower char ch = chNext; chNext = styler.SafeGetCharAt(i+1); int stylePrev = style; style = styleNext; styleNext = styler.StyleAt(i+1); bool atEOL = i == (lineStartNext-1); if (options.foldComment && options.foldCommentMultiline && IsStreamCommentStyle(style)) { if (!IsStreamCommentStyle(stylePrev)) { levelNext++; } else if (!IsStreamCommentStyle(styleNext) && !atEOL) { // Comments don't end at end of line and the next character may be unstyled. levelNext--; } } if (options.foldSyntaxBased) { if (style == SCE_ABL_BLOCK && !IsAlphaNumeric(chNext)) { levelNext++; } else if (style == SCE_ABL_END && (ch == 'e' || ch == 'f')) { levelNext--; } } if (!IsASpace(ch)) visibleChars++; if (atEOL || (i == endPos-1)) { int lev = levelCurrent | levelNext << 16; if (visibleChars == 0 && options.foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if (levelCurrent < levelNext) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; lineStartNext = styler.LineStart(lineCurrent+1); levelCurrent = levelNext; if (atEOL && (i == static_cast(styler.Length()-1))) { // There is an empty line at end of file so give it same level and empty styler.SetLevel(lineCurrent, (levelCurrent | levelCurrent << 16) | SC_FOLDLEVELWHITEFLAG); } visibleChars = 0; } } } LexerModule lmProgress(SCLEX_PROGRESS, LexerABL::LexerFactoryABL, "abl", ablWordLists); lexilla/lexers/LexMarkdown.cxx0000664000175000017500000004364414647367374015473 0ustar neilneil/****************************************************************** * LexMarkdown.cxx * * A simple Markdown lexer for scintilla. * * Includes highlighting for some extra features from the * Pandoc implementation; strikeout, using '#.' as a default * ordered list item marker, and delimited code blocks. * * Limitations: * * Standard indented code blocks are not highlighted at all, * as it would conflict with other indentation schemes. Use * delimited code blocks for blanket highlighting of an * entire code block. Embedded HTML is not highlighted either. * Blanket HTML highlighting has issues, because some Markdown * implementations allow Markdown markup inside of the HTML. Also, * there is a following blank line issue that can't be ignored, * explained in the next paragraph. Embedded HTML and code * blocks would be better supported with language specific * highlighting. * * The highlighting aims to accurately reflect correct syntax, * but a few restrictions are relaxed. Delimited code blocks are * highlighted, even if the line following the code block is not blank. * Requiring a blank line after a block, breaks the highlighting * in certain cases, because of the way Scintilla ends up calling * the lexer. * * Written by Jon Strait - jstrait@moonloop.net * * The License.txt file describes the conditions under which this * software may be distributed. * *****************************************************************/ #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; namespace { constexpr bool IsNewline(const int ch) { // sc.GetRelative(i) returns '\0' if out of range return (ch == '\n' || ch == '\r' || ch == '\0'); } } // True if can follow ch down to the end with possibly trailing whitespace // Does not set the state SCE_MARKDOWN_LINE_BEGIN as to allow further processing static bool FollowToLineEnd(const int ch, const int state, const Sci_PositionU endPos, StyleContext &sc) { Sci_Position i = 0; while (sc.GetRelative(++i) == ch) ; // Skip over whitespace while (IsASpaceOrTab(sc.GetRelative(i)) && sc.currentPos + i < endPos) ++i; if (IsNewline(sc.GetRelative(i)) || sc.currentPos + i == endPos) { sc.SetState(state); sc.Forward(i); return true; } else return false; } // Set the state on text section from current to length characters, // then set the rest until the newline to default, except for any characters matching token static void SetStateAndZoom(const int state, const Sci_Position length, const int token, StyleContext &sc) { sc.SetState(state); sc.Forward(length); sc.SetState(SCE_MARKDOWN_DEFAULT); sc.Forward(); bool started = false; while (sc.More() && !IsNewline(sc.ch)) { if (sc.ch == token && !started) { sc.SetState(state); started = true; } else if (sc.ch != token) { sc.SetState(SCE_MARKDOWN_DEFAULT); started = false; } sc.Forward(); } sc.SetState(SCE_MARKDOWN_LINE_BEGIN); } // Does the previous line have more than spaces and tabs? static bool HasPrevLineContent(StyleContext &sc) { Sci_Position i = 0; // Go back to the previous newline while ((--i + (Sci_Position)sc.currentPos) >= 0 && !IsNewline(sc.GetRelative(i))) ; while ((--i + (Sci_Position)sc.currentPos) >= 0) { const int ch = sc.GetRelative(i); if (ch == '\n') break; if (!((ch == '\r' || IsASpaceOrTab(ch)))) return true; } return false; } static bool AtTermStart(StyleContext &sc) { return sc.currentPos == 0 || sc.chPrev == 0 || isspacechar(sc.chPrev); } static bool IsCompleteStyleRegion(StyleContext &sc, const char *token) { bool found = false; const size_t start = strlen(token); Sci_Position i = static_cast(start); while (!IsNewline(sc.GetRelative(i))) { // make sure an empty pair of single-char tokens doesn't match // with a longer token: {*}{*} != {**} if (sc.GetRelative(i) == *token && sc.GetRelative(i - 1) != *token) { found = start > 1U ? sc.GetRelative(i + 1) == token[1] : true; break; } i++; } return AtTermStart(sc) && found; } static bool IsValidHrule(const Sci_PositionU endPos, StyleContext &sc) { int count = 1; Sci_Position i = 0; for (;;) { ++i; int c = sc.GetRelative(i); if (c == sc.ch) ++count; // hit a terminating character else if (!IsASpaceOrTab(c) || sc.currentPos + i == endPos) { // Are we a valid HRULE if ((IsNewline(c) || sc.currentPos + i == endPos) && count >= 3 && !HasPrevLineContent(sc)) { sc.SetState(SCE_MARKDOWN_HRULE); sc.Forward(i); sc.SetState(SCE_MARKDOWN_LINE_BEGIN); return true; } else { sc.SetState(SCE_MARKDOWN_DEFAULT); return false; } } } } static void ColorizeMarkdownDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList **, Accessor &styler) { Sci_PositionU endPos = startPos + length; int precharCount = 0; bool isLinkNameDetecting = false; // Don't advance on a new loop iteration and retry at the same position. // Useful in the corner case of having to start at the beginning file position // in the default state. bool freezeCursor = false; // property lexer.markdown.header.eolfill // Set to 1 to highlight all ATX header text. bool headerEOLFill = styler.GetPropertyInt("lexer.markdown.header.eolfill", 0) == 1; StyleContext sc(startPos, static_cast(length), initStyle, styler); while (sc.More()) { // Skip past escaped characters if (sc.ch == '\\') { sc.Forward(); continue; } // A blockquotes resets the line semantics if (sc.state == SCE_MARKDOWN_BLOCKQUOTE) sc.SetState(SCE_MARKDOWN_LINE_BEGIN); // Conditional state-based actions if (sc.state == SCE_MARKDOWN_CODE2) { if (sc.Match("``")) { const int closingSpan = (sc.GetRelative(2) == '`') ? 3 : 2; sc.Forward(closingSpan); sc.SetState(SCE_MARKDOWN_DEFAULT); } } else if (sc.state == SCE_MARKDOWN_CODE) { if (sc.ch == '`' && sc.chPrev != ' ') sc.ForwardSetState(SCE_MARKDOWN_DEFAULT); } /* De-activated because it gets in the way of other valid indentation * schemes, for example multiple paragraphs inside a list item. // Code block else if (sc.state == SCE_MARKDOWN_CODEBK) { bool d = true; if (IsNewline(sc.ch)) { if (sc.chNext != '\t') { for (int c = 1; c < 5; ++c) { if (sc.GetRelative(c) != ' ') d = false; } } } else if (sc.atLineStart) { if (sc.ch != '\t' ) { for (int i = 0; i < 4; ++i) { if (sc.GetRelative(i) != ' ') d = false; } } } if (!d) sc.SetState(SCE_MARKDOWN_LINE_BEGIN); } */ // Strong else if (sc.state == SCE_MARKDOWN_STRONG1) { if ((sc.Match("**") && sc.chPrev != ' ') || IsNewline(sc.GetRelative(2))) { sc.Forward(2); sc.SetState(SCE_MARKDOWN_DEFAULT); } } else if (sc.state == SCE_MARKDOWN_STRONG2) { if ((sc.Match("__") && sc.chPrev != ' ') || IsNewline(sc.GetRelative(2))) { sc.Forward(2); sc.SetState(SCE_MARKDOWN_DEFAULT); } } // Emphasis else if (sc.state == SCE_MARKDOWN_EM1) { if ((sc.ch == '*' && sc.chPrev != ' ') || IsNewline(sc.chNext)) sc.ForwardSetState(SCE_MARKDOWN_DEFAULT); } else if (sc.state == SCE_MARKDOWN_EM2) { if ((sc.ch == '_' && sc.chPrev != ' ') || IsNewline(sc.chNext)) sc.ForwardSetState(SCE_MARKDOWN_DEFAULT); } else if (sc.state == SCE_MARKDOWN_CODEBK) { if (sc.atLineStart && sc.Match("~~~")) { Sci_Position i = 1; while (!IsNewline(sc.GetRelative(i)) && sc.currentPos + i < endPos) i++; sc.Forward(i); sc.SetState(SCE_MARKDOWN_DEFAULT); } } else if (sc.state == SCE_MARKDOWN_STRIKEOUT) { if ((sc.Match("~~") && sc.chPrev != ' ') || IsNewline(sc.GetRelative(2))) { sc.Forward(2); sc.SetState(SCE_MARKDOWN_DEFAULT); } } else if (sc.state == SCE_MARKDOWN_LINE_BEGIN) { // Header if (sc.Match("######")) { if (headerEOLFill) sc.SetState(SCE_MARKDOWN_HEADER6); else SetStateAndZoom(SCE_MARKDOWN_HEADER6, 6, '#', sc); } else if (sc.Match("#####")) { if (headerEOLFill) sc.SetState(SCE_MARKDOWN_HEADER5); else SetStateAndZoom(SCE_MARKDOWN_HEADER5, 5, '#', sc); } else if (sc.Match("####")) { if (headerEOLFill) sc.SetState(SCE_MARKDOWN_HEADER4); else SetStateAndZoom(SCE_MARKDOWN_HEADER4, 4, '#', sc); } else if (sc.Match("###")) { if (headerEOLFill) sc.SetState(SCE_MARKDOWN_HEADER3); else SetStateAndZoom(SCE_MARKDOWN_HEADER3, 3, '#', sc); } else if (sc.Match("##")) { if (headerEOLFill) sc.SetState(SCE_MARKDOWN_HEADER2); else SetStateAndZoom(SCE_MARKDOWN_HEADER2, 2, '#', sc); } else if (sc.Match("#")) { // Catch the special case of an unordered list if (sc.chNext == '.' && IsASpaceOrTab(sc.GetRelative(2))) { precharCount = 0; sc.SetState(SCE_MARKDOWN_PRECHAR); } else if (headerEOLFill) { sc.SetState(SCE_MARKDOWN_HEADER1); } else SetStateAndZoom(SCE_MARKDOWN_HEADER1, 1, '#', sc); } // Code block else if (sc.Match("~~~")) { if (!HasPrevLineContent(sc)) sc.SetState(SCE_MARKDOWN_CODEBK); else sc.SetState(SCE_MARKDOWN_DEFAULT); } else if (sc.ch == '=') { if (HasPrevLineContent(sc) && FollowToLineEnd('=', SCE_MARKDOWN_HEADER1, endPos, sc)) { if (!headerEOLFill) sc.SetState(SCE_MARKDOWN_LINE_BEGIN); } else sc.SetState(SCE_MARKDOWN_DEFAULT); } else if (sc.ch == '-') { if (HasPrevLineContent(sc) && FollowToLineEnd('-', SCE_MARKDOWN_HEADER2, endPos, sc)) { if (!headerEOLFill) sc.SetState(SCE_MARKDOWN_LINE_BEGIN); } else { precharCount = 0; sc.SetState(SCE_MARKDOWN_PRECHAR); } } else if (IsNewline(sc.ch)) sc.SetState(SCE_MARKDOWN_LINE_BEGIN); else { precharCount = 0; sc.SetState(SCE_MARKDOWN_PRECHAR); } } // The header lasts until the newline else if (sc.state == SCE_MARKDOWN_HEADER1 || sc.state == SCE_MARKDOWN_HEADER2 || sc.state == SCE_MARKDOWN_HEADER3 || sc.state == SCE_MARKDOWN_HEADER4 || sc.state == SCE_MARKDOWN_HEADER5 || sc.state == SCE_MARKDOWN_HEADER6) { if (headerEOLFill) { if (sc.atLineStart) { sc.SetState(SCE_MARKDOWN_LINE_BEGIN); freezeCursor = true; } } else if (IsNewline(sc.ch)) sc.SetState(SCE_MARKDOWN_LINE_BEGIN); } // New state only within the initial whitespace if (sc.state == SCE_MARKDOWN_PRECHAR) { // Blockquote if (sc.ch == '>' && precharCount < 5) sc.SetState(SCE_MARKDOWN_BLOCKQUOTE); /* // Begin of code block else if (!HasPrevLineContent(sc) && (sc.chPrev == '\t' || precharCount >= 4)) sc.SetState(SCE_MARKDOWN_CODEBK); */ // HRule - Total of three or more hyphens, asterisks, or underscores // on a line by themselves else if ((sc.ch == '-' || sc.ch == '*' || sc.ch == '_') && IsValidHrule(endPos, sc)) ; // Unordered list else if ((sc.ch == '-' || sc.ch == '*' || sc.ch == '+') && IsASpaceOrTab(sc.chNext)) { sc.SetState(SCE_MARKDOWN_ULIST_ITEM); sc.ForwardSetState(SCE_MARKDOWN_DEFAULT); } // Ordered list else if (IsADigit(sc.ch)) { int digitCount = 0; while (IsADigit(sc.GetRelative(++digitCount))) ; if (sc.GetRelative(digitCount) == '.' && IsASpaceOrTab(sc.GetRelative(digitCount + 1))) { sc.SetState(SCE_MARKDOWN_OLIST_ITEM); sc.Forward(digitCount + 1); sc.SetState(SCE_MARKDOWN_DEFAULT); } else { // a textual number at the margin should be plain text sc.SetState(SCE_MARKDOWN_DEFAULT); } } // Alternate Ordered list else if (sc.ch == '#' && sc.chNext == '.' && IsASpaceOrTab(sc.GetRelative(2))) { sc.SetState(SCE_MARKDOWN_OLIST_ITEM); sc.Forward(2); sc.SetState(SCE_MARKDOWN_DEFAULT); } else if (sc.ch != ' ' || precharCount > 2) sc.SetState(SCE_MARKDOWN_DEFAULT); else ++precharCount; } // Any link if (sc.state == SCE_MARKDOWN_LINK) { if (sc.Match("](") && sc.GetRelative(-1) != '\\') { sc.Forward(2); isLinkNameDetecting = true; } else if (sc.Match("]:") && sc.GetRelative(-1) != '\\') { sc.Forward(2); sc.SetState(SCE_MARKDOWN_DEFAULT); } else if (!isLinkNameDetecting && sc.ch == ']' && sc.GetRelative(-1) != '\\') { sc.Forward(); sc.SetState(SCE_MARKDOWN_DEFAULT); } else if (isLinkNameDetecting && sc.ch == ')' && sc.GetRelative(-1) != '\\') { sc.Forward(); sc.SetState(SCE_MARKDOWN_DEFAULT); isLinkNameDetecting = false; } } // New state anywhere in doc if (sc.state == SCE_MARKDOWN_DEFAULT) { if (sc.atLineStart && sc.ch == '#') { sc.SetState(SCE_MARKDOWN_LINE_BEGIN); freezeCursor = true; } // Links and Images if (sc.Match("![")) { sc.SetState(SCE_MARKDOWN_LINK); sc.Forward(1); } else if (sc.ch == '[' && sc.GetRelative(-1) != '\\') { sc.SetState(SCE_MARKDOWN_LINK); } // Code - also a special case for alternate inside spacing else if (sc.Match("``") && sc.GetRelative(3) != ' ' && AtTermStart(sc)) { const int openingSpan = (sc.GetRelative(2) == '`') ? 2 : 1; sc.SetState(SCE_MARKDOWN_CODE2); sc.Forward(openingSpan); } else if (sc.ch == '`' && sc.chNext != ' ' && IsCompleteStyleRegion(sc, "`")) { sc.SetState(SCE_MARKDOWN_CODE); } // Strong else if (sc.Match("**") && sc.GetRelative(2) != ' ' && IsCompleteStyleRegion(sc, "**")) { sc.SetState(SCE_MARKDOWN_STRONG1); sc.Forward(); } else if (sc.Match("__") && sc.GetRelative(2) != ' ' && IsCompleteStyleRegion(sc, "__")) { sc.SetState(SCE_MARKDOWN_STRONG2); sc.Forward(); } // Emphasis else if (sc.ch == '*' && sc.chNext != ' ' && IsCompleteStyleRegion(sc, "*")) { sc.SetState(SCE_MARKDOWN_EM1); } else if (sc.ch == '_' && sc.chNext != ' ' && IsCompleteStyleRegion(sc, "_")) { sc.SetState(SCE_MARKDOWN_EM2); } // Strikeout else if (sc.Match("~~") && !(sc.GetRelative(2) == '~' || sc.GetRelative(2) == ' ') && IsCompleteStyleRegion(sc, "~~")) { sc.SetState(SCE_MARKDOWN_STRIKEOUT); sc.Forward(); } // Beginning of line else if (IsNewline(sc.ch)) { sc.SetState(SCE_MARKDOWN_LINE_BEGIN); } } // Advance if not holding back the cursor for this iteration. if (!freezeCursor) sc.Forward(); freezeCursor = false; } sc.Complete(); } LexerModule lmMarkdown(SCLEX_MARKDOWN, ColorizeMarkdownDoc, "markdown"); lexilla/lexers/LexPOV.cxx0000664000175000017500000002255014647367374014346 0ustar neilneil// Scintilla source code edit control /** @file LexPOV.cxx ** Lexer for POV-Ray SDL (Persistance of Vision Raytracer, Scene Description Language). ** Written by Philippe Lhoste but this is mostly a derivative of LexCPP... **/ // Copyright 1998-2005 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. // Some points that distinguish from a simple C lexer: // Identifiers start only by a character. // No line continuation character. // Strings are limited to 256 characters. // Directives are similar to preprocessor commands, // but we match directive keywords and colorize incorrect ones. // Block comments can be nested (code stolen from my code in LexLua). #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static inline bool IsAWordChar(int ch) { return ch < 0x80 && (isalnum(ch) || ch == '_'); } static inline bool IsAWordStart(int ch) { return ch < 0x80 && isalpha(ch); } static inline bool IsANumberChar(int ch) { // Not exactly following number definition (several dots are seen as OK, etc.) // but probably enough in most cases. return (ch < 0x80) && (isdigit(ch) || toupper(ch) == 'E' || ch == '.' || ch == '-' || ch == '+'); } static void ColourisePovDoc( Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { WordList &keywords1 = *keywordlists[0]; WordList &keywords2 = *keywordlists[1]; WordList &keywords3 = *keywordlists[2]; WordList &keywords4 = *keywordlists[3]; WordList &keywords5 = *keywordlists[4]; WordList &keywords6 = *keywordlists[5]; WordList &keywords7 = *keywordlists[6]; WordList &keywords8 = *keywordlists[7]; Sci_Position currentLine = styler.GetLine(startPos); // Initialize the block comment /* */ nesting level, if we are inside such a comment. int blockCommentLevel = 0; if (initStyle == SCE_POV_COMMENT) { blockCommentLevel = styler.GetLineState(currentLine - 1); } // Do not leak onto next line if (initStyle == SCE_POV_STRINGEOL || initStyle == SCE_POV_COMMENTLINE) { initStyle = SCE_POV_DEFAULT; } short stringLen = 0; StyleContext sc(startPos, length, initStyle, styler); for (; sc.More(); sc.Forward()) { if (sc.atLineEnd) { // Update the line state, so it can be seen by next line currentLine = styler.GetLine(sc.currentPos); if (sc.state == SCE_POV_COMMENT) { // Inside a block comment, we set the line state styler.SetLineState(currentLine, blockCommentLevel); } else { // Reset the line state styler.SetLineState(currentLine, 0); } } if (sc.atLineStart && (sc.state == SCE_POV_STRING)) { // Prevent SCE_POV_STRINGEOL from leaking back to previous line sc.SetState(SCE_POV_STRING); } // Determine if the current state should terminate. if (sc.state == SCE_POV_OPERATOR) { sc.SetState(SCE_POV_DEFAULT); } else if (sc.state == SCE_POV_NUMBER) { // We stop the number definition on non-numerical non-dot non-eE non-sign char if (!IsANumberChar(sc.ch)) { sc.SetState(SCE_POV_DEFAULT); } } else if (sc.state == SCE_POV_IDENTIFIER) { if (!IsAWordChar(sc.ch)) { char s[100]; sc.GetCurrent(s, sizeof(s)); if (keywords2.InList(s)) { sc.ChangeState(SCE_POV_WORD2); } else if (keywords3.InList(s)) { sc.ChangeState(SCE_POV_WORD3); } else if (keywords4.InList(s)) { sc.ChangeState(SCE_POV_WORD4); } else if (keywords5.InList(s)) { sc.ChangeState(SCE_POV_WORD5); } else if (keywords6.InList(s)) { sc.ChangeState(SCE_POV_WORD6); } else if (keywords7.InList(s)) { sc.ChangeState(SCE_POV_WORD7); } else if (keywords8.InList(s)) { sc.ChangeState(SCE_POV_WORD8); } sc.SetState(SCE_POV_DEFAULT); } } else if (sc.state == SCE_POV_DIRECTIVE) { if (!IsAWordChar(sc.ch)) { char s[100]; char *p; sc.GetCurrent(s, sizeof(s)); p = s; // Skip # and whitespace between # and directive word do { p++; } while ((*p == ' ' || *p == '\t') && *p != '\0'); if (!keywords1.InList(p)) { sc.ChangeState(SCE_POV_BADDIRECTIVE); } sc.SetState(SCE_POV_DEFAULT); } } else if (sc.state == SCE_POV_COMMENT) { if (sc.Match('/', '*')) { blockCommentLevel++; sc.Forward(); } else if (sc.Match('*', '/') && blockCommentLevel > 0) { blockCommentLevel--; sc.Forward(); if (blockCommentLevel == 0) { sc.ForwardSetState(SCE_POV_DEFAULT); } } } else if (sc.state == SCE_POV_COMMENTLINE) { if (sc.atLineEnd) { sc.ForwardSetState(SCE_POV_DEFAULT); } } else if (sc.state == SCE_POV_STRING) { if (sc.ch == '\\') { stringLen++; if (strchr("abfnrtuv0'\"", sc.chNext)) { // Compound characters are counted as one. // Note: for Unicode chars \u, we shouldn't count the next 4 digits... sc.Forward(); } } else if (sc.ch == '\"') { sc.ForwardSetState(SCE_POV_DEFAULT); } else if (sc.atLineEnd) { sc.ChangeState(SCE_POV_STRINGEOL); sc.ForwardSetState(SCE_POV_DEFAULT); } else { stringLen++; } if (stringLen > 256) { // Strings are limited to 256 chars sc.SetState(SCE_POV_STRINGEOL); } } else if (sc.state == SCE_POV_STRINGEOL) { if (sc.ch == '\\') { if (sc.chNext == '\"' || sc.chNext == '\\') { sc.Forward(); } } else if (sc.ch == '\"') { sc.ForwardSetState(SCE_C_DEFAULT); } else if (sc.atLineEnd) { sc.ForwardSetState(SCE_POV_DEFAULT); } } // Determine if a new state should be entered. if (sc.state == SCE_POV_DEFAULT) { if (IsADigit(sc.ch) || (sc.ch == '.' && IsADigit(sc.chNext))) { sc.SetState(SCE_POV_NUMBER); } else if (IsAWordStart(sc.ch)) { sc.SetState(SCE_POV_IDENTIFIER); } else if (sc.Match('/', '*')) { blockCommentLevel = 1; sc.SetState(SCE_POV_COMMENT); sc.Forward(); // Eat the * so it isn't used for the end of the comment } else if (sc.Match('/', '/')) { sc.SetState(SCE_POV_COMMENTLINE); } else if (sc.ch == '\"') { sc.SetState(SCE_POV_STRING); stringLen = 0; } else if (sc.ch == '#') { sc.SetState(SCE_POV_DIRECTIVE); // Skip whitespace between # and directive word do { sc.Forward(); } while ((sc.ch == ' ' || sc.ch == '\t') && sc.More()); if (sc.atLineEnd) { sc.SetState(SCE_POV_DEFAULT); } } else if (isoperator(static_cast(sc.ch))) { sc.SetState(SCE_POV_OPERATOR); } } } sc.Complete(); } static void FoldPovDoc( Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *[], Accessor &styler) { bool foldComment = styler.GetPropertyInt("fold.comment") != 0; bool foldDirective = styler.GetPropertyInt("fold.directive") != 0; bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelPrev = styler.LevelAt(lineCurrent) & SC_FOLDLEVELNUMBERMASK; int levelCurrent = levelPrev; char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); int style = initStyle; for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); int stylePrev = style; style = styleNext; styleNext = styler.StyleAt(i + 1); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (foldComment && (style == SCE_POV_COMMENT)) { if (stylePrev != SCE_POV_COMMENT) { levelCurrent++; } else if ((styleNext != SCE_POV_COMMENT) && !atEOL) { // Comments don't end at end of line and the next character may be unstyled. levelCurrent--; } } if (foldComment && (style == SCE_POV_COMMENTLINE)) { if ((ch == '/') && (chNext == '/')) { char chNext2 = styler.SafeGetCharAt(i + 2); if (chNext2 == '{') { levelCurrent++; } else if (chNext2 == '}') { levelCurrent--; } } } if (foldDirective && (style == SCE_POV_DIRECTIVE)) { if (ch == '#') { Sci_PositionU j=i+1; while ((j levelPrev) && (visibleChars > 0)) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelPrev = levelCurrent; visibleChars = 0; } if (!isspacechar(ch)) visibleChars++; } // Fill in the real level of the next line, keeping the current flags as they will be filled in later int flagsNext = styler.LevelAt(lineCurrent) & ~SC_FOLDLEVELNUMBERMASK; styler.SetLevel(lineCurrent, levelPrev | flagsNext); } static const char * const povWordLists[] = { "Language directives", "Objects & CSG & Appearance", "Types & Modifiers & Items", "Predefined Identifiers", "Predefined Functions", "User defined 1", "User defined 2", "User defined 3", 0, }; LexerModule lmPOV(SCLEX_POV, ColourisePovDoc, "pov", FoldPovDoc, povWordLists); lexilla/lexers/LexTeX.cxx0000664000175000017500000003332714647367374014406 0ustar neilneil// Scintilla source code edit control // @file LexTeX.cxx - general context conformant tex coloring scheme // Author: Hans Hagen - PRAGMA ADE - Hasselt NL - www.pragma-ade.com // Version: September 28, 2003 // Copyright: 1998-2003 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. // This lexer is derived from the one written for the texwork environment (1999++) which in // turn is inspired on texedit (1991++) which finds its roots in wdt (1986). // If you run into strange boundary cases, just tell me and I'll look into it. // TeX Folding code added by instanton (soft_share@126.com) with borrowed code from VisualTeX source by Alex Romanenko. // Version: June 22, 2007 #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; // val SCE_TEX_DEFAULT = 0 // val SCE_TEX_SPECIAL = 1 // val SCE_TEX_GROUP = 2 // val SCE_TEX_SYMBOL = 3 // val SCE_TEX_COMMAND = 4 // val SCE_TEX_TEXT = 5 // Definitions in SciTEGlobal.properties: // // TeX Highlighting // // # Default // style.tex.0=fore:#7F7F00 // # Special // style.tex.1=fore:#007F7F // # Group // style.tex.2=fore:#880000 // # Symbol // style.tex.3=fore:#7F7F00 // # Command // style.tex.4=fore:#008800 // # Text // style.tex.5=fore:#000000 // lexer.tex.interface.default=0 // lexer.tex.comment.process=0 // todo: lexer.tex.auto.if // Auxiliary functions: static inline bool endOfLine(Accessor &styler, Sci_PositionU i) { return (styler[i] == '\n') || ((styler[i] == '\r') && (styler.SafeGetCharAt(i + 1) != '\n')) ; } static inline bool isTeXzero(int ch) { return (ch == '%') ; } static inline bool isTeXone(int ch) { return (ch == '[') || (ch == ']') || (ch == '=') || (ch == '#') || (ch == '(') || (ch == ')') || (ch == '<') || (ch == '>') || (ch == '"') ; } static inline bool isTeXtwo(int ch) { return (ch == '{') || (ch == '}') || (ch == '$') ; } static inline bool isTeXthree(int ch) { return (ch == '~') || (ch == '^') || (ch == '_') || (ch == '&') || (ch == '-') || (ch == '+') || (ch == '\"') || (ch == '`') || (ch == '/') || (ch == '|') || (ch == '%') ; } static inline bool isTeXfour(int ch) { return (ch == '\\') ; } static inline bool isTeXfive(int ch) { return ((ch >= 'a') && (ch <= 'z')) || ((ch >= 'A') && (ch <= 'Z')) || (ch == '@') || (ch == '!') || (ch == '?') ; } static inline bool isTeXsix(int ch) { return (ch == ' ') ; } static inline bool isTeXseven(int ch) { return (ch == '^') ; } // Interface determination static int CheckTeXInterface( Sci_PositionU startPos, Sci_Position length, Accessor &styler, int defaultInterface) { char lineBuffer[1024] ; Sci_PositionU linePos = 0 ; // some day we can make something lexer.tex.mapping=(all,0)(nl,1)(en,2)... if (styler.SafeGetCharAt(0) == '%') { for (Sci_PositionU i = 0; i < startPos + length; i++) { lineBuffer[linePos++] = styler.SafeGetCharAt(i) ; if (endOfLine(styler, i) || (linePos >= sizeof(lineBuffer) - 1)) { lineBuffer[linePos] = '\0'; if (strstr(lineBuffer, "interface=all")) { return 0 ; } else if (strstr(lineBuffer, "interface=tex")) { return 1 ; } else if (strstr(lineBuffer, "interface=nl")) { return 2 ; } else if (strstr(lineBuffer, "interface=en")) { return 3 ; } else if (strstr(lineBuffer, "interface=de")) { return 4 ; } else if (strstr(lineBuffer, "interface=cz")) { return 5 ; } else if (strstr(lineBuffer, "interface=it")) { return 6 ; } else if (strstr(lineBuffer, "interface=ro")) { return 7 ; } else if (strstr(lineBuffer, "interface=latex")) { // we will move latex cum suis up to 91+ when more keyword lists are supported return 8 ; } else if (styler.SafeGetCharAt(1) == 'D' && strstr(lineBuffer, "%D \\module")) { // better would be to limit the search to just one line return 3 ; } else { return defaultInterface ; } } } } return defaultInterface ; } static void ColouriseTeXDoc( Sci_PositionU startPos, Sci_Position length, int, WordList *keywordlists[], Accessor &styler) { styler.StartAt(startPos) ; styler.StartSegment(startPos) ; bool processComment = styler.GetPropertyInt("lexer.tex.comment.process", 0) == 1 ; bool useKeywords = styler.GetPropertyInt("lexer.tex.use.keywords", 1) == 1 ; bool autoIf = styler.GetPropertyInt("lexer.tex.auto.if", 1) == 1 ; int defaultInterface = styler.GetPropertyInt("lexer.tex.interface.default", 1) ; char key[100] ; int k ; bool newifDone = false ; bool inComment = false ; int currentInterface = CheckTeXInterface(startPos,length,styler,defaultInterface) ; if (currentInterface == 0) { useKeywords = false ; currentInterface = 1 ; } WordList &keywords = *keywordlists[currentInterface-1] ; StyleContext sc(startPos, length, SCE_TEX_TEXT, styler); bool going = sc.More() ; // needed because of a fuzzy end of file state for (; going; sc.Forward()) { if (! sc.More()) { going = false ; } // we need to go one behind the end of text if (inComment) { if (sc.atLineEnd) { sc.SetState(SCE_TEX_TEXT) ; newifDone = false ; inComment = false ; } } else { if (! isTeXfive(sc.ch)) { if (sc.state == SCE_TEX_COMMAND) { if (sc.LengthCurrent() == 1) { // \ if (isTeXseven(sc.ch) && isTeXseven(sc.chNext)) { sc.Forward(2) ; // \^^ and \^^ } sc.ForwardSetState(SCE_TEX_TEXT) ; } else { sc.GetCurrent(key, sizeof(key)-1) ; k = static_cast(strlen(key)) ; memmove(key,key+1,k) ; // shift left over escape token key[k] = '\0' ; k-- ; if (! keywords || ! useKeywords) { sc.SetState(SCE_TEX_COMMAND) ; newifDone = false ; } else if (k == 1) { //\ sc.SetState(SCE_TEX_COMMAND) ; newifDone = false ; } else if (keywords.InList(key)) { sc.SetState(SCE_TEX_COMMAND) ; newifDone = autoIf && (strcmp(key,"newif") == 0) ; } else if (autoIf && ! newifDone && (key[0] == 'i') && (key[1] == 'f') && keywords.InList("if")) { sc.SetState(SCE_TEX_COMMAND) ; } else { sc.ChangeState(SCE_TEX_TEXT) ; sc.SetState(SCE_TEX_TEXT) ; newifDone = false ; } } } if (isTeXzero(sc.ch)) { sc.SetState(SCE_TEX_SYMBOL); if (!endOfLine(styler,sc.currentPos + 1)) sc.ForwardSetState(SCE_TEX_DEFAULT) ; inComment = ! processComment ; newifDone = false ; } else if (isTeXseven(sc.ch) && isTeXseven(sc.chNext)) { sc.SetState(SCE_TEX_TEXT) ; sc.ForwardSetState(SCE_TEX_TEXT) ; } else if (isTeXone(sc.ch)) { sc.SetState(SCE_TEX_SPECIAL) ; newifDone = false ; } else if (isTeXtwo(sc.ch)) { sc.SetState(SCE_TEX_GROUP) ; newifDone = false ; } else if (isTeXthree(sc.ch)) { sc.SetState(SCE_TEX_SYMBOL) ; newifDone = false ; } else if (isTeXfour(sc.ch)) { sc.SetState(SCE_TEX_COMMAND) ; } else if (isTeXsix(sc.ch)) { sc.SetState(SCE_TEX_TEXT) ; } else if (sc.atLineEnd) { sc.SetState(SCE_TEX_TEXT) ; newifDone = false ; inComment = false ; } else { sc.SetState(SCE_TEX_TEXT) ; } } else if (sc.state != SCE_TEX_COMMAND) { sc.SetState(SCE_TEX_TEXT) ; } } } sc.ChangeState(SCE_TEX_TEXT) ; sc.Complete(); } static inline bool isNumber(int ch) { return (ch == '0') || (ch == '1') || (ch == '2') || (ch == '3') || (ch == '4') || (ch == '5') || (ch == '6') || (ch == '7') || (ch == '8') || (ch == '9'); } static inline bool isWordChar(int ch) { return ((ch >= 'a') && (ch <= 'z')) || ((ch >= 'A') && (ch <= 'Z')); } static Sci_Position ParseTeXCommand(Sci_PositionU pos, Accessor &styler, char *command) { Sci_Position length=0; char ch=styler.SafeGetCharAt(pos+1); if(ch==',' || ch==':' || ch==';' || ch=='%'){ command[0]=ch; command[1]=0; return 1; } // find end while(isWordChar(ch) && !isNumber(ch) && ch!='_' && ch!='.' && length<100){ command[length]=ch; length++; ch=styler.SafeGetCharAt(pos+length+1); } command[length]='\0'; if(!length) return 0; return length+1; } static int classifyFoldPointTeXPaired(const char* s) { int lev=0; if (!(isdigit(s[0]) || (s[0] == '.'))){ if (strcmp(s, "begin")==0||strcmp(s,"FoldStart")==0|| strcmp(s,"abstract")==0||strcmp(s,"unprotect")==0|| strcmp(s,"title")==0||strncmp(s,"start",5)==0||strncmp(s,"Start",5)==0|| strcmp(s,"documentclass")==0||strncmp(s,"if",2)==0 ) lev=1; if (strcmp(s, "end")==0||strcmp(s,"FoldStop")==0|| strcmp(s,"maketitle")==0||strcmp(s,"protect")==0|| strncmp(s,"stop",4)==0||strncmp(s,"Stop",4)==0|| strcmp(s,"fi")==0 ) lev=-1; } return lev; } static int classifyFoldPointTeXUnpaired(const char* s) { int lev=0; if (!(isdigit(s[0]) || (s[0] == '.'))){ if (strcmp(s,"part")==0|| strcmp(s,"chapter")==0|| strcmp(s,"section")==0|| strcmp(s,"subsection")==0|| strcmp(s,"subsubsection")==0|| strcmp(s,"CJKfamily")==0|| strcmp(s,"appendix")==0|| strcmp(s,"Topic")==0||strcmp(s,"topic")==0|| strcmp(s,"subject")==0||strcmp(s,"subsubject")==0|| strcmp(s,"def")==0||strcmp(s,"gdef")==0||strcmp(s,"edef")==0|| strcmp(s,"xdef")==0||strcmp(s,"framed")==0|| strcmp(s,"frame")==0|| strcmp(s,"foilhead")==0||strcmp(s,"overlays")==0||strcmp(s,"slide")==0 ){ lev=1; } } return lev; } static bool IsTeXCommentLine(Sci_Position line, Accessor &styler) { Sci_Position pos = styler.LineStart(line); Sci_Position eol_pos = styler.LineStart(line + 1) - 1; Sci_Position startpos = pos; while (startpos SC_FOLDLEVELBASE && ((ch == '\r' || ch=='\n') && (chNext == '\\'))) { ParseTeXCommand(i+1, styler, buffer); levelCurrent -= classifyFoldPointTeXUnpaired(buffer); } char chNext2; char chNext3; char chNext4; char chNext5; chNext2=styler.SafeGetCharAt(i+2); chNext3=styler.SafeGetCharAt(i+3); chNext4=styler.SafeGetCharAt(i+4); chNext5=styler.SafeGetCharAt(i+5); bool atEOfold = (ch == '%') && (chNext == '%') && (chNext2=='}') && (chNext3=='}')&& (chNext4=='-')&& (chNext5=='-'); bool atBOfold = (ch == '%') && (chNext == '%') && (chNext2=='-') && (chNext3=='-')&& (chNext4=='{')&& (chNext5=='{'); if(atBOfold){ levelCurrent+=1; } if(atEOfold){ levelCurrent-=1; } if(ch=='\\' && chNext=='['){ levelCurrent+=1; } if(ch=='\\' && chNext==']'){ levelCurrent-=1; } bool foldComment = styler.GetPropertyInt("fold.comment") != 0; if (foldComment && atEOL && IsTeXCommentLine(lineCurrent, styler)) { if (lineCurrent==0 && IsTeXCommentLine(lineCurrent + 1, styler) ) levelCurrent++; else if (lineCurrent!=0 && !IsTeXCommentLine(lineCurrent - 1, styler) && IsTeXCommentLine(lineCurrent + 1, styler) ) levelCurrent++; else if (lineCurrent!=0 && IsTeXCommentLine(lineCurrent - 1, styler) && !IsTeXCommentLine(lineCurrent+1, styler)) levelCurrent--; } //--------------------------------------------------------------------------------------------- if (atEOL) { int lev = levelPrev; if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if ((levelCurrent > levelPrev) && (visibleChars > 0)) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelPrev = levelCurrent; visibleChars = 0; } if (!isspacechar(ch)) visibleChars++; } // Fill in the real level of the next line, keeping the current flags as they will be filled in later int flagsNext = styler.LevelAt(lineCurrent) & ~SC_FOLDLEVELNUMBERMASK; styler.SetLevel(lineCurrent, levelPrev | flagsNext); } static const char * const texWordListDesc[] = { "TeX, eTeX, pdfTeX, Omega", "ConTeXt Dutch", "ConTeXt English", "ConTeXt German", "ConTeXt Czech", "ConTeXt Italian", "ConTeXt Romanian", 0, } ; LexerModule lmTeX(SCLEX_TEX, ColouriseTeXDoc, "tex", FoldTexDoc, texWordListDesc); lexilla/lexers/LexDiff.cxx0000664000175000017500000001345414647367374014555 0ustar neilneil// Scintilla source code edit control /** @file LexDiff.cxx ** Lexer for diff results. **/ // Copyright 1998-2001 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; namespace { inline bool AtEOL(Accessor &styler, Sci_PositionU i) { return (styler[i] == '\n') || ((styler[i] == '\r') && (styler.SafeGetCharAt(i + 1) != '\n')); } void ColouriseDiffLine(const char *lineBuffer, Sci_Position endLine, Accessor &styler) { // It is needed to remember the current state to recognize starting // comment lines before the first "diff " or "--- ". If a real // difference starts then each line starting with ' ' is a whitespace // otherwise it is considered a comment (Only in..., Binary file...) if (0 == strncmp(lineBuffer, "diff ", 5)) { styler.ColourTo(endLine, SCE_DIFF_COMMAND); } else if (0 == strncmp(lineBuffer, "Index: ", 7)) { // For subversion's diff styler.ColourTo(endLine, SCE_DIFF_COMMAND); } else if (0 == strncmp(lineBuffer, "---", 3) && lineBuffer[3] != '-') { // In a context diff, --- appears in both the header and the position markers if (lineBuffer[3] == ' ' && atoi(lineBuffer + 4) && !strchr(lineBuffer, '/')) styler.ColourTo(endLine, SCE_DIFF_POSITION); else if (lineBuffer[3] == '\r' || lineBuffer[3] == '\n') styler.ColourTo(endLine, SCE_DIFF_POSITION); else if (lineBuffer[3] == ' ') styler.ColourTo(endLine, SCE_DIFF_HEADER); else styler.ColourTo(endLine, SCE_DIFF_DELETED); } else if (0 == strncmp(lineBuffer, "+++ ", 4)) { // I don't know of any diff where "+++ " is a position marker, but for // consistency, do the same as with "--- " and "*** ". if (atoi(lineBuffer+4) && !strchr(lineBuffer, '/')) styler.ColourTo(endLine, SCE_DIFF_POSITION); else styler.ColourTo(endLine, SCE_DIFF_HEADER); } else if (0 == strncmp(lineBuffer, "====", 4)) { // For p4's diff styler.ColourTo(endLine, SCE_DIFF_HEADER); } else if (0 == strncmp(lineBuffer, "***", 3)) { // In a context diff, *** appears in both the header and the position markers. // Also ******** is a chunk header, but here it's treated as part of the // position marker since there is no separate style for a chunk header. if (lineBuffer[3] == ' ' && atoi(lineBuffer+4) && !strchr(lineBuffer, '/')) styler.ColourTo(endLine, SCE_DIFF_POSITION); else if (lineBuffer[3] == '*') styler.ColourTo(endLine, SCE_DIFF_POSITION); else styler.ColourTo(endLine, SCE_DIFF_HEADER); } else if (0 == strncmp(lineBuffer, "? ", 2)) { // For difflib styler.ColourTo(endLine, SCE_DIFF_HEADER); } else if (lineBuffer[0] == '@') { styler.ColourTo(endLine, SCE_DIFF_POSITION); } else if (lineBuffer[0] >= '0' && lineBuffer[0] <= '9') { styler.ColourTo(endLine, SCE_DIFF_POSITION); } else if (0 == strncmp(lineBuffer, "++", 2)) { styler.ColourTo(endLine, SCE_DIFF_PATCH_ADD); } else if (0 == strncmp(lineBuffer, "+-", 2)) { styler.ColourTo(endLine, SCE_DIFF_PATCH_DELETE); } else if (0 == strncmp(lineBuffer, "-+", 2)) { styler.ColourTo(endLine, SCE_DIFF_REMOVED_PATCH_ADD); } else if (0 == strncmp(lineBuffer, "--", 2)) { styler.ColourTo(endLine, SCE_DIFF_REMOVED_PATCH_DELETE); } else if (lineBuffer[0] == '-' || lineBuffer[0] == '<') { styler.ColourTo(endLine, SCE_DIFF_DELETED); } else if (lineBuffer[0] == '+' || lineBuffer[0] == '>') { styler.ColourTo(endLine, SCE_DIFF_ADDED); } else if (lineBuffer[0] == '!') { styler.ColourTo(endLine, SCE_DIFF_CHANGED); } else if (lineBuffer[0] != ' ') { styler.ColourTo(endLine, SCE_DIFF_COMMENT); } else { styler.ColourTo(endLine, SCE_DIFF_DEFAULT); } } void ColouriseDiffDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { std::string lineBuffer; styler.StartAt(startPos); styler.StartSegment(startPos); for (Sci_PositionU i = startPos; i < startPos + length; i++) { if (AtEOL(styler, i)) { ColouriseDiffLine(lineBuffer.c_str(), i, styler); lineBuffer.clear(); } else { lineBuffer.push_back(styler[i]); } } if (!lineBuffer.empty()) { // Last line does not have ending characters ColouriseDiffLine(lineBuffer.c_str(), startPos + length - 1, styler); } } void FoldDiffDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { Sci_Position curLine = styler.GetLine(startPos); Sci_Position curLineStart = styler.LineStart(curLine); int prevLevel = curLine > 0 ? styler.LevelAt(curLine - 1) : SC_FOLDLEVELBASE; do { int nextLevel = 0; const int lineType = styler.StyleAt(curLineStart); if (lineType == SCE_DIFF_COMMAND) nextLevel = SC_FOLDLEVELBASE | SC_FOLDLEVELHEADERFLAG; else if (lineType == SCE_DIFF_HEADER) nextLevel = (SC_FOLDLEVELBASE + 1) | SC_FOLDLEVELHEADERFLAG; else if (lineType == SCE_DIFF_POSITION && styler[curLineStart] != '-') nextLevel = (SC_FOLDLEVELBASE + 2) | SC_FOLDLEVELHEADERFLAG; else if (prevLevel & SC_FOLDLEVELHEADERFLAG) nextLevel = (prevLevel & SC_FOLDLEVELNUMBERMASK) + 1; else nextLevel = prevLevel; if ((nextLevel & SC_FOLDLEVELHEADERFLAG) && (nextLevel == prevLevel)) styler.SetLevel(curLine-1, prevLevel & ~SC_FOLDLEVELHEADERFLAG); styler.SetLevel(curLine, nextLevel); prevLevel = nextLevel; curLineStart = styler.LineStart(++curLine); } while (static_cast(startPos)+length > curLineStart); } const char *const emptyWordListDesc[] = { nullptr }; } LexerModule lmDiff(SCLEX_DIFF, ColouriseDiffDoc, "diff", FoldDiffDoc, emptyWordListDesc); lexilla/lexers/LexBibTeX.cxx0000664000175000017500000002106614647367374015020 0ustar neilneil// Copyright 2008-2010 Sergiu Dotenco. The License.txt file describes the // conditions under which this software may be distributed. /** * @file LexBibTeX.cxx * @brief General BibTeX coloring scheme. * @author Sergiu Dotenco * @date April 18, 2009 */ #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "PropSetSimple.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; namespace { bool IsAlphabetic(unsigned int ch) { return IsASCII(ch) && std::isalpha(ch) != 0; } bool IsAlphaNumeric(char ch) { return IsASCII(ch) && std::isalnum(ch); } bool EqualCaseInsensitive(const char* a, const char* b) { return CompareCaseInsensitive(a, b) == 0; } bool EntryWithoutKey(const char* name) { return EqualCaseInsensitive(name,"string"); } char GetClosingBrace(char openbrace) { char result = openbrace; switch (openbrace) { case '(': result = ')'; break; case '{': result = '}'; break; } return result; } bool IsEntryStart(char prev, char ch) { return prev != '\\' && ch == '@'; } bool IsEntryStart(const StyleContext& sc) { return IsEntryStart(sc.chPrev, sc.ch); } void ColorizeBibTeX(Sci_PositionU start_pos, Sci_Position length, int /*init_style*/, WordList* keywordlists[], Accessor& styler) { WordList &EntryNames = *keywordlists[0]; bool fold_compact = styler.GetPropertyInt("fold.compact", 1) != 0; std::string buffer; buffer.reserve(25); // We always colorize a section from the beginning, so let's // search for the @ character which isn't escaped, i.e. \@ while (start_pos > 0 && !IsEntryStart(styler.SafeGetCharAt(start_pos - 1), styler.SafeGetCharAt(start_pos))) { --start_pos; ++length; } styler.StartAt(start_pos); styler.StartSegment(start_pos); Sci_Position current_line = styler.GetLine(start_pos); int prev_level = styler.LevelAt(current_line) & SC_FOLDLEVELNUMBERMASK; int current_level = prev_level; int visible_chars = 0; bool in_comment = false ; StyleContext sc(start_pos, length, SCE_BIBTEX_DEFAULT, styler); bool going = sc.More(); // needed because of a fuzzy end of file state char closing_brace = 0; bool collect_entry_name = false; for (; going; sc.Forward()) { if (!sc.More()) going = false; // we need to go one behind the end of text if (in_comment) { if (sc.atLineEnd) { sc.SetState(SCE_BIBTEX_DEFAULT); in_comment = false; } } else { // Found @entry if (IsEntryStart(sc)) { sc.SetState(SCE_BIBTEX_UNKNOWN_ENTRY); sc.Forward(); ++current_level; buffer.clear(); collect_entry_name = true; } else if ((sc.state == SCE_BIBTEX_ENTRY || sc.state == SCE_BIBTEX_UNKNOWN_ENTRY) && (sc.ch == '{' || sc.ch == '(')) { // Entry name colorization done // Found either a { or a ( after entry's name, e.g. @entry(...) @entry{...} // Closing counterpart needs to be stored. closing_brace = GetClosingBrace(sc.ch); sc.SetState(SCE_BIBTEX_DEFAULT); // Don't colorize { ( // @string doesn't have any key if (EntryWithoutKey(buffer.c_str())) sc.ForwardSetState(SCE_BIBTEX_PARAMETER); else sc.ForwardSetState(SCE_BIBTEX_KEY); // Key/label colorization } // Need to handle the case where entry's key is empty // e.g. @book{,...} if (sc.state == SCE_BIBTEX_KEY && sc.ch == ',') { // Key/label colorization done sc.SetState(SCE_BIBTEX_DEFAULT); // Don't colorize the , sc.ForwardSetState(SCE_BIBTEX_PARAMETER); // Parameter colorization } else if (sc.state == SCE_BIBTEX_PARAMETER && sc.ch == '=') { sc.SetState(SCE_BIBTEX_DEFAULT); // Don't colorize the = sc.ForwardSetState(SCE_BIBTEX_VALUE); // Parameter value colorization Sci_Position start = sc.currentPos; // We need to handle multiple situations: // 1. name"one two {three}" // 2. name={one {one two {two}} three} // 3. year=2005 // Skip ", { until we encounter the first alphanumerical character while (sc.More() && !(IsAlphaNumeric(sc.ch) || sc.ch == '"' || sc.ch == '{')) sc.Forward(); if (sc.More()) { // Store " or { char ch = sc.ch; // Not interested in alphanumerical characters if (IsAlphaNumeric(ch)) ch = 0; int skipped = 0; if (ch) { // Skip preceding " or { such as in name={{test}}. // Remember how many characters have been skipped // Make sure that empty values, i.e. "" are also handled correctly while (sc.More() && (sc.ch == ch && (ch != '"' || skipped < 1))) { sc.Forward(); ++skipped; } } // Closing counterpart for " is the same character if (ch == '{') ch = '}'; // We have reached the parameter value // In case the open character was a alnum char, skip until , is found // otherwise until skipped == 0 while (sc.More() && (skipped > 0 || (!ch && !(sc.ch == ',' || sc.ch == closing_brace)))) { // Make sure the character isn't escaped if (sc.chPrev != '\\') { // Parameter value contains a { which is the 2nd case described above if (sc.ch == '{') ++skipped; // Remember it else if (sc.ch == '}') --skipped; else if (skipped == 1 && sc.ch == ch && ch == '"') // Don't ignore cases like {"o} skipped = 0; } sc.Forward(); } } // Don't colorize the , sc.SetState(SCE_BIBTEX_DEFAULT); // Skip until the , or entry's closing closing_brace is found // since this parameter might be the last one while (sc.More() && !(sc.ch == ',' || sc.ch == closing_brace)) sc.Forward(); int state = SCE_BIBTEX_PARAMETER; // The might be more parameters // We've reached the closing closing_brace for the bib entry // in case no " or {} has been used to enclose the value, // as in 3rd case described above if (sc.ch == closing_brace) { --current_level; // Make sure the text between entries is not colored // using parameter's style state = SCE_BIBTEX_DEFAULT; } Sci_Position end = sc.currentPos; current_line = styler.GetLine(end); // We have possibly skipped some lines, so the folding levels // have to be adjusted separately for (Sci_Position i = styler.GetLine(start); i <= styler.GetLine(end); ++i) styler.SetLevel(i, prev_level); sc.ForwardSetState(state); } if (sc.state == SCE_BIBTEX_PARAMETER && sc.ch == closing_brace) { sc.SetState(SCE_BIBTEX_DEFAULT); --current_level; } // Non escaped % found which represents a comment until the end of the line if (sc.chPrev != '\\' && sc.ch == '%') { in_comment = true; sc.SetState(SCE_BIBTEX_COMMENT); } } if (sc.state == SCE_BIBTEX_UNKNOWN_ENTRY || sc.state == SCE_BIBTEX_ENTRY) { if (!IsAlphabetic(sc.ch) && collect_entry_name) collect_entry_name = false; if (collect_entry_name) { buffer += static_cast(tolower(sc.ch)); if (EntryNames.InList(buffer.c_str())) sc.ChangeState(SCE_BIBTEX_ENTRY); else sc.ChangeState(SCE_BIBTEX_UNKNOWN_ENTRY); } } if (sc.atLineEnd) { int level = prev_level; if (visible_chars == 0 && fold_compact) level |= SC_FOLDLEVELWHITEFLAG; if ((current_level > prev_level)) level |= SC_FOLDLEVELHEADERFLAG; // else if (current_level < prev_level) // level |= SC_FOLDLEVELBOXFOOTERFLAG; // Deprecated if (level != styler.LevelAt(current_line)) { styler.SetLevel(current_line, level); } ++current_line; prev_level = current_level; visible_chars = 0; } if (!isspacechar(sc.ch)) ++visible_chars; } sc.Complete(); // Fill in the real level of the next line, keeping the current flags as they will be filled in later int flagsNext = styler.LevelAt(current_line) & ~SC_FOLDLEVELNUMBERMASK; styler.SetLevel(current_line, prev_level | flagsNext); } } static const char * const BibTeXWordLists[] = { "Entry Names", 0, }; LexerModule lmBibTeX(SCLEX_BIBTEX, ColorizeBibTeX, "bib", 0, BibTeXWordLists); // Entry Names // article, book, booklet, conference, inbook, // incollection, inproceedings, manual, mastersthesis, // misc, phdthesis, proceedings, techreport, unpublished, // string, url lexilla/lexers/LexHTML.cxx0000664000175000017500000026312514647367374014453 0ustar neilneil// Scintilla source code edit control /** @file LexHTML.cxx ** Lexer for HTML. **/ // Copyright 1998-2005 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "InList.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" #include "OptionSet.h" #include "SubStyles.h" #include "DefaultLexer.h" using namespace Scintilla; using namespace Lexilla; namespace { #define SCE_HA_JS (SCE_HJA_START - SCE_HJ_START) #define SCE_HA_VBS (SCE_HBA_START - SCE_HB_START) #define SCE_HA_PYTHON (SCE_HPA_START - SCE_HP_START) enum script_type { eScriptNone = 0, eScriptJS, eScriptVBS, eScriptPython, eScriptPHP, eScriptXML, eScriptSGML, eScriptSGMLblock, eScriptComment }; enum script_mode { eHtml = 0, eNonHtmlScript, eNonHtmlPreProc, eNonHtmlScriptPreProc }; constexpr bool IsAWordChar(int ch) noexcept { return IsAlphaNumeric(ch) || ch == '.' || ch == '_'; } constexpr bool IsAWordStart(int ch) noexcept { return IsAlphaNumeric(ch) || ch == '_'; } bool IsOperator(int ch) noexcept { if (IsAlphaNumeric(ch)) return false; // '.' left out as it is used to make up numbers if (ch == '%' || ch == '^' || ch == '&' || ch == '*' || ch == '(' || ch == ')' || ch == '-' || ch == '+' || ch == '=' || ch == '|' || ch == '{' || ch == '}' || ch == '[' || ch == ']' || ch == ':' || ch == ';' || ch == '<' || ch == '>' || ch == ',' || ch == '/' || ch == '?' || ch == '!' || ch == '.' || ch == '~') return true; return false; } unsigned char SafeGetUnsignedCharAt(Accessor &styler, Sci_Position position, char chDefault = ' ') { return styler.SafeGetCharAt(position, chDefault); } // Put an upper limit to bound time taken for unexpected text. constexpr Sci_PositionU maxLengthCheck = 200; std::string GetNextWord(Accessor &styler, Sci_PositionU start) { std::string ret; for (Sci_PositionU i = 0; i < maxLengthCheck; i++) { const char ch = styler.SafeGetCharAt(start + i); if ((i == 0) && !IsAWordStart(ch)) break; if ((i > 0) && !IsAWordChar(ch)) break; ret.push_back(ch); } return ret; } bool Contains(const std::string &s, std::string_view search) noexcept { return s.find(search) != std::string::npos; } script_type segIsScriptingIndicator(Accessor &styler, Sci_PositionU start, Sci_PositionU end, script_type prevValue) { const std::string s = styler.GetRangeLowered(start, end+1); if (Contains(s, "vbs")) return eScriptVBS; if (Contains(s, "pyth")) return eScriptPython; // https://html.spec.whatwg.org/multipage/scripting.html#attr-script-type // https://mimesniff.spec.whatwg.org/#javascript-mime-type if (Contains(s, "javas") || Contains(s, "ecmas") || Contains(s, "module") || Contains(s, "jscr")) return eScriptJS; if (Contains(s, "php")) return eScriptPHP; if (Contains(s, "xml")) { const size_t xml = s.find("xml"); if (xml != std::string::npos) { for (size_t t = 0; t < xml; t++) { if (!IsASpace(s[t])) { return prevValue; } } } return eScriptXML; } return prevValue; } int PrintScriptingIndicatorOffset(Accessor &styler, Sci_PositionU start, Sci_PositionU end) { int iResult = 0; const std::string s = styler.GetRangeLowered(start, end+1); if (0 == strncmp(s.c_str(), "php", 3)) { iResult = 3; } return iResult; } script_type ScriptOfState(int state) noexcept { if ((state >= SCE_HP_START) && (state <= SCE_HP_IDENTIFIER)) { return eScriptPython; } else if ((state >= SCE_HB_START && state <= SCE_HB_STRINGEOL) || (state == SCE_H_ASPAT || state == SCE_H_XCCOMMENT)) { return eScriptVBS; } else if ((state >= SCE_HJ_START) && (state <= SCE_HJ_REGEX)) { return eScriptJS; } else if ((state >= SCE_HPHP_DEFAULT && state <= SCE_HPHP_COMMENTLINE) || (state == SCE_HPHP_COMPLEX_VARIABLE)) { return eScriptPHP; } else if ((state >= SCE_H_SGML_DEFAULT) && (state < SCE_H_SGML_BLOCK_DEFAULT)) { return eScriptSGML; } else if (state == SCE_H_SGML_BLOCK_DEFAULT) { return eScriptSGMLblock; } else { return eScriptNone; } } constexpr int statePrintForState(int state, script_mode inScriptType) noexcept { int StateToPrint = state; if (state >= SCE_HJ_START) { if ((state >= SCE_HP_START) && (state <= SCE_HP_IDENTIFIER)) { StateToPrint = state + ((inScriptType == eNonHtmlScript) ? 0 : SCE_HA_PYTHON); } else if ((state >= SCE_HB_START) && (state <= SCE_HB_STRINGEOL)) { StateToPrint = state + ((inScriptType == eNonHtmlScript) ? 0 : SCE_HA_VBS); } else if ((state >= SCE_HJ_START) && (state <= SCE_HJ_REGEX)) { StateToPrint = state + ((inScriptType == eNonHtmlScript) ? 0 : SCE_HA_JS); } } return StateToPrint; } constexpr int stateForPrintState(int StateToPrint) noexcept { int state = StateToPrint; if ((StateToPrint >= SCE_HPA_START) && (StateToPrint <= SCE_HPA_IDENTIFIER)) { state = StateToPrint - SCE_HA_PYTHON; } else if ((StateToPrint >= SCE_HBA_START) && (StateToPrint <= SCE_HBA_STRINGEOL)) { state = StateToPrint - SCE_HA_VBS; } else if ((StateToPrint >= SCE_HJA_START) && (StateToPrint <= SCE_HJA_REGEX)) { state = StateToPrint - SCE_HA_JS; } return state; } constexpr bool IsNumberChar(char ch) noexcept { return IsADigit(ch) || ch == '.' || ch == '-' || ch == '#'; } constexpr bool isStringState(int state) noexcept { bool bResult = false; switch (state) { case SCE_HJ_DOUBLESTRING: case SCE_HJ_SINGLESTRING: case SCE_HJA_DOUBLESTRING: case SCE_HJA_SINGLESTRING: case SCE_HB_STRING: case SCE_HBA_STRING: case SCE_HP_STRING: case SCE_HP_CHARACTER: case SCE_HP_TRIPLE: case SCE_HP_TRIPLEDOUBLE: case SCE_HPA_STRING: case SCE_HPA_CHARACTER: case SCE_HPA_TRIPLE: case SCE_HPA_TRIPLEDOUBLE: case SCE_HPHP_HSTRING: case SCE_HPHP_SIMPLESTRING: case SCE_HPHP_HSTRING_VARIABLE: case SCE_HPHP_COMPLEX_VARIABLE: bResult = true; break; default : break; } return bResult; } constexpr bool stateAllowsTermination(int state) noexcept { bool allowTermination = !isStringState(state); if (allowTermination) { switch (state) { case SCE_HPHP_COMMENT: case SCE_HP_COMMENTLINE: case SCE_HPA_COMMENTLINE: allowTermination = false; break; default: break; } } return allowTermination; } bool isPreProcessorEndTag(int state, int ch) noexcept { const script_type type = ScriptOfState(state); if (state == SCE_H_ASP || AnyOf(type, eScriptVBS, eScriptJS, eScriptPython)) { return ch == '%'; } if (type == eScriptPHP) { return ch == '%' || ch == '?'; } return ch == '?'; } // not really well done, since it's only comments that should lex the %> and <% constexpr bool isCommentASPState(int state) noexcept { bool bResult = false; switch (state) { case SCE_HJ_COMMENT: case SCE_HJ_COMMENTLINE: case SCE_HJ_COMMENTDOC: case SCE_HB_COMMENTLINE: case SCE_HP_COMMENTLINE: case SCE_HPHP_COMMENT: case SCE_HPHP_COMMENTLINE: bResult = true; break; default : break; } return bResult; } bool classifyAttribHTML(script_mode inScriptType, Sci_PositionU start, Sci_PositionU end, const WordList &keywords, const WordClassifier &classifier, Accessor &styler, const std::string &tag) { int chAttr = SCE_H_ATTRIBUTEUNKNOWN; bool isLanguageType = false; if (IsNumberChar(styler[start])) { chAttr = SCE_H_NUMBER; } else { const std::string s = styler.GetRangeLowered(start, end+1); if (keywords.InList(s)) { chAttr = SCE_H_ATTRIBUTE; } else { int subStyle = classifier.ValueFor(s); if (subStyle < 0) { // Didn't find attribute, check for tag.attribute const std::string tagAttribute = tag + "." + s; subStyle = classifier.ValueFor(tagAttribute); } if (subStyle >= 0) { chAttr = subStyle; } } if (inScriptType == eNonHtmlScript) { // see https://html.spec.whatwg.org/multipage/scripting.html#script-processing-model if (s == "type" || s == "language") { isLanguageType = true; } } } if ((chAttr == SCE_H_ATTRIBUTEUNKNOWN) && !keywords) // No keywords -> all are known chAttr = SCE_H_ATTRIBUTE; styler.ColourTo(end, chAttr); return isLanguageType; } // https://html.spec.whatwg.org/multipage/custom-elements.html#custom-elements-core-concepts bool isHTMLCustomElement(const std::string &tag) noexcept { // check valid HTML custom element name: starts with an ASCII lower alpha and contains hyphen. // IsUpperOrLowerCase() is used for `html.tags.case.sensitive=1`. if (tag.length() < 2 || !IsUpperOrLowerCase(tag[0])) { return false; } if (tag.find('-') == std::string::npos) { return false; } return true; } int classifyTagHTML(Sci_PositionU start, Sci_PositionU end, const WordList &keywords, const WordClassifier &classifier, Accessor &styler, bool &tagDontFold, bool caseSensitive, bool isXml, bool allowScripts, const std::set &nonFoldingTags, std::string &tag) { tag.clear(); // Copy after the '<' and stop before ' ' for (Sci_PositionU cPos = start; cPos <= end; cPos++) { const char ch = styler[cPos]; if (IsASpace(ch)) { break; } if ((ch != '<') && (ch != '/')) { tag.push_back(caseSensitive ? ch : MakeLowerCase(ch)); } } // if the current language is XML, I can fold any tag // if the current language is HTML, I don't want to fold certain tags (input, meta, etc.) //...to find it in the list of no-container-tags tagDontFold = (!isXml) && (nonFoldingTags.count(tag) > 0); // No keywords -> all are known int chAttr = SCE_H_TAGUNKNOWN; if (!tag.empty() && (tag[0] == '!')) { chAttr = SCE_H_SGML_DEFAULT; } else if (!keywords || keywords.InList(tag)) { chAttr = SCE_H_TAG; } else if (!isXml && isHTMLCustomElement(tag)) { chAttr = SCE_H_TAG; } else { const int subStyle = classifier.ValueFor(tag); if (subStyle >= 0) { chAttr = subStyle; } } if (chAttr != SCE_H_TAGUNKNOWN) { styler.ColourTo(end, chAttr); } if (chAttr == SCE_H_TAG) { if (allowScripts && (tag == "script")) { // check to see if this is a self-closing tag by sniffing ahead bool isSelfClose = false; for (Sci_PositionU cPos = end; cPos <= end + maxLengthCheck; cPos++) { const char ch = styler.SafeGetCharAt(cPos, '\0'); if (ch == '\0' || ch == '>') break; if (ch == '/' && styler.SafeGetCharAt(cPos + 1, '\0') == '>') { isSelfClose = true; break; } } // do not enter a script state if the tag self-closed if (!isSelfClose) chAttr = SCE_H_SCRIPT; } else if (!isXml && (tag == "comment")) { chAttr = SCE_H_COMMENT; } } return chAttr; } void classifyWordHTJS(Sci_PositionU start, Sci_PositionU end, const WordList &keywords, const WordClassifier &classifier, const WordClassifier &classifierServer, Accessor &styler, script_mode inScriptType) { const std::string s = styler.GetRange(start, end+1); int chAttr = SCE_HJ_WORD; const bool wordIsNumber = IsADigit(s[0]) || ((s[0] == '.') && IsADigit(s[1])); if (wordIsNumber) { chAttr = SCE_HJ_NUMBER; } else if (keywords.InList(s)) { chAttr = SCE_HJ_KEYWORD; } else { const int subStyle = (inScriptType == eNonHtmlScript) ? classifier.ValueFor(s) : classifierServer.ValueFor(s); if (subStyle >= 0) { chAttr = subStyle; } } styler.ColourTo(end, statePrintForState(chAttr, inScriptType)); } int classifyWordHTVB(Sci_PositionU start, Sci_PositionU end, const WordList &keywords, const WordClassifier &classifier, Accessor &styler, script_mode inScriptType) { int chAttr = SCE_HB_IDENTIFIER; const bool wordIsNumber = IsADigit(styler[start]) || (styler[start] == '.'); if (wordIsNumber) { chAttr = SCE_HB_NUMBER; } else { const std::string s = styler.GetRangeLowered(start, end+1); if (keywords.InList(s)) { chAttr = SCE_HB_WORD; if (s == "rem") chAttr = SCE_HB_COMMENTLINE; } else { const int subStyle = classifier.ValueFor(s); if (subStyle >= 0) { chAttr = subStyle; } } } styler.ColourTo(end, statePrintForState(chAttr, inScriptType)); if (chAttr == SCE_HB_COMMENTLINE) return SCE_HB_COMMENTLINE; else return SCE_HB_DEFAULT; } void classifyWordHTPy(Sci_PositionU start, Sci_PositionU end, const WordList &keywords, const WordClassifier &classifier, Accessor &styler, std::string &prevWord, script_mode inScriptType, bool isMako) { const bool wordIsNumber = IsADigit(styler[start]); const std::string s = styler.GetRange(start, end + 1); int chAttr = SCE_HP_IDENTIFIER; if (prevWord == "class") chAttr = SCE_HP_CLASSNAME; else if (prevWord == "def") chAttr = SCE_HP_DEFNAME; else if (wordIsNumber) chAttr = SCE_HP_NUMBER; else if (keywords.InList(s)) chAttr = SCE_HP_WORD; else if (isMako && (s == "block")) chAttr = SCE_HP_WORD; else { const int subStyle = classifier.ValueFor(s); if (subStyle >= 0) { chAttr = subStyle; } } styler.ColourTo(end, statePrintForState(chAttr, inScriptType)); prevWord = s; } // Update the word colour to default or keyword // Called when in a PHP word void classifyWordHTPHP(Sci_PositionU start, Sci_PositionU end, const WordList &keywords, const WordClassifier &classifier, Accessor &styler) { int chAttr = SCE_HPHP_DEFAULT; const bool wordIsNumber = IsADigit(styler[start]) || (styler[start] == '.' && start+1 <= end && IsADigit(styler[start+1])); if (wordIsNumber) { chAttr = SCE_HPHP_NUMBER; } else { const std::string s = styler.GetRangeLowered(start, end+1);; if (keywords.InList(s)) { chAttr = SCE_HPHP_WORD; } else { const int subStyle = classifier.ValueFor(s); if (subStyle >= 0) { chAttr = subStyle; } } } styler.ColourTo(end, chAttr); } bool isWordHSGML(Sci_PositionU start, Sci_PositionU end, const WordList &keywords, Accessor &styler) { const std::string s = styler.GetRange(start, end + 1); return keywords.InList(s); } bool isWordCdata(Sci_PositionU start, Sci_PositionU end, Accessor &styler) { const std::string s = styler.GetRange(start, end + 1); return s == "[CDATA["; } // Return the first state to reach when entering a scripting language constexpr int StateForScript(script_type scriptLanguage) noexcept { int Result = SCE_HJ_START; switch (scriptLanguage) { case eScriptVBS: Result = SCE_HB_START; break; case eScriptPython: Result = SCE_HP_START; break; case eScriptPHP: Result = SCE_HPHP_DEFAULT; break; case eScriptXML: Result = SCE_H_TAGUNKNOWN; break; case eScriptSGML: Result = SCE_H_SGML_DEFAULT; break; case eScriptComment: Result = SCE_H_COMMENT; break; default : break; } return Result; } constexpr bool issgmlwordchar(int ch) noexcept { return !IsASCII(ch) || (IsAlphaNumeric(ch) || ch == '.' || ch == '_' || ch == ':' || ch == '!' || ch == '#' || ch == '['); } constexpr bool IsPhpWordStart(int ch) noexcept { return (IsUpperOrLowerCase(ch) || (ch == '_')) || (ch >= 0x7f); } constexpr bool IsPhpWordChar(int ch) noexcept { return IsADigit(ch) || IsPhpWordStart(ch); } constexpr bool InTagState(int state) noexcept { return AnyOf(state, SCE_H_TAG, SCE_H_TAGUNKNOWN, SCE_H_SCRIPT, SCE_H_ATTRIBUTE, SCE_H_ATTRIBUTEUNKNOWN, SCE_H_NUMBER, SCE_H_OTHER, SCE_H_DOUBLESTRING, SCE_H_SINGLESTRING); } constexpr bool IsCommentState(const int state) noexcept { return state == SCE_H_COMMENT || state == SCE_H_SGML_COMMENT; } constexpr bool IsScriptCommentState(const int state) noexcept { return AnyOf(state, SCE_HJ_COMMENT, SCE_HJ_COMMENTLINE, SCE_HJA_COMMENT, SCE_HJA_COMMENTLINE, SCE_HB_COMMENTLINE, SCE_HBA_COMMENTLINE); } constexpr bool isLineEnd(int ch) noexcept { return ch == '\r' || ch == '\n'; } bool isMakoBlockEnd(const int ch, const int chNext, const std::string &blockType) noexcept { if (blockType.empty()) { return ((ch == '%') && (chNext == '>')); } else if (InList(blockType, { "inherit", "namespace", "include", "page" })) { return ((ch == '/') && (chNext == '>')); } else if (blockType == "%") { if (ch == '/' && isLineEnd(chNext)) return true; else return isLineEnd(ch); } else if (blockType == "{") { return ch == '}'; } else { return (ch == '>'); } } bool isDjangoBlockEnd(const int ch, const int chNext, const std::string &blockType) noexcept { if (blockType.empty()) { return false; } else if (blockType == "%") { return ((ch == '%') && (chNext == '}')); } else if (blockType == "{") { return ((ch == '}') && (chNext == '}')); } else { return false; } } class PhpNumberState { enum NumberBase { BASE_10 = 0, BASE_2, BASE_8, BASE_16 }; static constexpr const char *const digitList[] = { "_0123456789", "_01", "_01234567", "_0123456789abcdefABCDEF" }; NumberBase base = BASE_10; bool decimalPart = false; bool exponentPart = false; bool invalid = false; bool finished = false; bool leadingZero = false; bool invalidBase8 = false; bool betweenDigits = false; bool decimalChar = false; bool exponentChar = false; public: [[nodiscard]] bool isInvalid() const noexcept { return invalid; } [[nodiscard]] bool isFinished() const noexcept { return finished; } bool init(int ch, int chPlus1, int chPlus2) noexcept { base = BASE_10; decimalPart = false; exponentPart = false; invalid = false; finished = false; leadingZero = false; invalidBase8 = false; betweenDigits = false; decimalChar = false; exponentChar = false; if (ch == '.' && strchr(digitList[BASE_10] + !betweenDigits, chPlus1) != nullptr) { decimalPart = true; betweenDigits = true; } else if (ch == '0' && (chPlus1 == 'b' || chPlus1 == 'B')) { base = BASE_2; } else if (ch == '0' && (chPlus1 == 'o' || chPlus1 == 'O')) { base = BASE_8; } else if (ch == '0' && (chPlus1 == 'x' || chPlus1 == 'X')) { base = BASE_16; } else if (strchr(digitList[BASE_10] + !betweenDigits, ch) != nullptr) { leadingZero = ch == '0'; betweenDigits = true; check(chPlus1, chPlus2); if (finished && leadingZero) { // single zero should be base 10 base = BASE_10; } } else { return false; } return true; } bool check(int ch, int chPlus1) noexcept { if (strchr(digitList[base] + !betweenDigits, ch) != nullptr) { if (leadingZero) { invalidBase8 = invalidBase8 || strchr(digitList[BASE_8] + !betweenDigits, ch) == nullptr; } betweenDigits = ch != '_'; decimalChar = false; exponentChar = false; } else if (ch == '_') { invalid = true; betweenDigits = false; decimalChar = false; // exponentChar is unchanged } else if (base == BASE_10 && ch == '.' && ( !(decimalPart || exponentPart) || strchr(digitList[BASE_10] + !betweenDigits, chPlus1) != nullptr) ) { invalid = invalid || !betweenDigits || decimalPart || exponentPart; decimalPart = true; betweenDigits = false; decimalChar = true; exponentChar = false; } else if (base == BASE_10 && (ch == 'e' || ch == 'E')) { invalid = invalid || !(betweenDigits || decimalChar) || exponentPart; exponentPart = true; betweenDigits = false; decimalChar = false; exponentChar = true; } else if (base == BASE_10 && (ch == '-' || ch == '+') && exponentChar) { invalid = invalid || strchr(digitList[BASE_10] + !betweenDigits, chPlus1) == nullptr; betweenDigits = false; decimalChar = false; // exponentChar is unchanged } else if (IsPhpWordChar(ch)) { invalid = true; betweenDigits = false; decimalChar = false; exponentChar = false; } else { invalid = invalid || !(betweenDigits || decimalChar); finished = true; if (base == BASE_10 && leadingZero && !decimalPart && !exponentPart) { base = BASE_8; invalid = invalid || invalidBase8; } } return finished; } }; constexpr bool isPHPStringState(int state) noexcept { return (state == SCE_HPHP_HSTRING) || (state == SCE_HPHP_SIMPLESTRING) || (state == SCE_HPHP_HSTRING_VARIABLE) || (state == SCE_HPHP_COMPLEX_VARIABLE); } enum class AllowPHP : int { None, // No PHP PHP, // { explicit OptionSetHTML(bool isPHPScript_) { DefineProperty("asp.default.language", &OptionsHTML::aspDefaultLanguage, "Script in ASP code is initially assumed to be in JavaScript. " "To change this to VBScript set asp.default.language to 2. Python is 3."); DefineProperty("html.tags.case.sensitive", &OptionsHTML::caseSensitive, "For XML and HTML, setting this property to 1 will make tags match in a case " "sensitive way which is the expected behaviour for XML and XHTML."); DefineProperty("lexer.xml.allow.scripts", &OptionsHTML::allowScripts, "Set to 0 to disable scripts in XML."); DefineProperty("lexer.xml.allow.php", &OptionsHTML::allowPHPinXML, "Set to 0 to disable PHP in XML, 1 to accept '", 12, "SCE_H_XMLSTART", "identifier", "XML identifier start ''", 14, "SCE_H_SCRIPT", "error", "Internal state which should never be visible", 15, "SCE_H_ASP", "preprocessor", "ASP <% ... %>", 16, "SCE_H_ASPAT", "preprocessor", "ASP <% ... %>", 17, "SCE_H_CDATA", "literal", "CDATA", 18, "SCE_H_QUESTION", "preprocessor", "PHP", 19, "SCE_H_VALUE", "literal string", "Unquoted values", 20, "SCE_H_XCCOMMENT", "comment", "ASP.NET, JSP Comment <%-- ... --%>", 21, "SCE_H_SGML_DEFAULT", "default", "SGML tags ", 22, "SCE_H_SGML_COMMAND", "preprocessor", "SGML command", 23, "SCE_H_SGML_1ST_PARAM", "preprocessor", "SGML 1st param", 24, "SCE_H_SGML_DOUBLESTRING", "literal string", "SGML double string", 25, "SCE_H_SGML_SIMPLESTRING", "literal string", "SGML single string", 26, "SCE_H_SGML_ERROR", "error", "SGML error", 27, "SCE_H_SGML_SPECIAL", "literal", "SGML special (#XXXX type)", 28, "SCE_H_SGML_ENTITY", "literal", "SGML entity", 29, "SCE_H_SGML_COMMENT", "comment", "SGML comment", 30, "SCE_H_SGML_1ST_PARAM_COMMENT", "error comment", "SGML first parameter - lexer internal. It is an error if any text is in this style.", 31, "SCE_H_SGML_BLOCK_DEFAULT", "default", "SGML block", 32, "", "predefined", "", 33, "", "predefined", "", 34, "", "predefined", "", 35, "", "predefined", "", 36, "", "predefined", "", 37, "", "predefined", "", 38, "", "predefined", "", 39, "", "predefined", "", 40, "SCE_HJ_START", "client javascript default", "JS Start - allows eol filled background to not start on same line as SCRIPT tag", 41, "SCE_HJ_DEFAULT", "client javascript default", "JS Default", 42, "SCE_HJ_COMMENT", "client javascript comment", "JS Comment", 43, "SCE_HJ_COMMENTLINE", "client javascript comment line", "JS Line Comment", 44, "SCE_HJ_COMMENTDOC", "client javascript comment documentation", "JS Doc comment", 45, "SCE_HJ_NUMBER", "client javascript literal numeric", "JS Number", 46, "SCE_HJ_WORD", "client javascript identifier", "JS Word", 47, "SCE_HJ_KEYWORD", "client javascript keyword", "JS Keyword", 48, "SCE_HJ_DOUBLESTRING", "client javascript literal string", "JS Double quoted string", 49, "SCE_HJ_SINGLESTRING", "client javascript literal string", "JS Single quoted string", 50, "SCE_HJ_SYMBOLS", "client javascript operator", "JS Symbols", 51, "SCE_HJ_STRINGEOL", "client javascript error literal string", "JavaScript EOL", 52, "SCE_HJ_REGEX", "client javascript literal regex", "JavaScript RegEx", 53, "", "unused", "", 54, "", "unused", "", 55, "SCE_HJA_START", "server javascript default", "JS Start - allows eol filled background to not start on same line as SCRIPT tag", 56, "SCE_HJA_DEFAULT", "server javascript default", "JS Default", 57, "SCE_HJA_COMMENT", "server javascript comment", "JS Comment", 58, "SCE_HJA_COMMENTLINE", "server javascript comment line", "JS Line Comment", 59, "SCE_HJA_COMMENTDOC", "server javascript comment documentation", "JS Doc comment", 60, "SCE_HJA_NUMBER", "server javascript literal numeric", "JS Number", 61, "SCE_HJA_WORD", "server javascript identifier", "JS Word", 62, "SCE_HJA_KEYWORD", "server javascript keyword", "JS Keyword", 63, "SCE_HJA_DOUBLESTRING", "server javascript literal string", "JS Double quoted string", 64, "SCE_HJA_SINGLESTRING", "server javascript literal string", "JS Single quoted string", 65, "SCE_HJA_SYMBOLS", "server javascript operator", "JS Symbols", 66, "SCE_HJA_STRINGEOL", "server javascript error literal string", "JavaScript EOL", 67, "SCE_HJA_REGEX", "server javascript literal regex", "JavaScript RegEx", 68, "", "unused", "", 69, "", "unused", "", 70, "SCE_HB_START", "client basic default", "Start", 71, "SCE_HB_DEFAULT", "client basic default", "Default", 72, "SCE_HB_COMMENTLINE", "client basic comment line", "Comment", 73, "SCE_HB_NUMBER", "client basic literal numeric", "Number", 74, "SCE_HB_WORD", "client basic keyword", "KeyWord", 75, "SCE_HB_STRING", "client basic literal string", "String", 76, "SCE_HB_IDENTIFIER", "client basic identifier", "Identifier", 77, "SCE_HB_STRINGEOL", "client basic literal string", "Unterminated string", 78, "", "unused", "", 79, "", "unused", "", 80, "SCE_HBA_START", "server basic default", "Start", 81, "SCE_HBA_DEFAULT", "server basic default", "Default", 82, "SCE_HBA_COMMENTLINE", "server basic comment line", "Comment", 83, "SCE_HBA_NUMBER", "server basic literal numeric", "Number", 84, "SCE_HBA_WORD", "server basic keyword", "KeyWord", 85, "SCE_HBA_STRING", "server basic literal string", "String", 86, "SCE_HBA_IDENTIFIER", "server basic identifier", "Identifier", 87, "SCE_HBA_STRINGEOL", "server basic literal string", "Unterminated string", 88, "", "unused", "", 89, "", "unused", "", 90, "SCE_HP_START", "client python default", "Embedded Python", 91, "SCE_HP_DEFAULT", "client python default", "Embedded Python", 92, "SCE_HP_COMMENTLINE", "client python comment line", "Comment", 93, "SCE_HP_NUMBER", "client python literal numeric", "Number", 94, "SCE_HP_STRING", "client python literal string", "String", 95, "SCE_HP_CHARACTER", "client python literal string character", "Single quoted string", 96, "SCE_HP_WORD", "client python keyword", "Keyword", 97, "SCE_HP_TRIPLE", "client python literal string", "Triple quotes", 98, "SCE_HP_TRIPLEDOUBLE", "client python literal string", "Triple double quotes", 99, "SCE_HP_CLASSNAME", "client python identifier", "Class name definition", 100, "SCE_HP_DEFNAME", "client python identifier", "Function or method name definition", 101, "SCE_HP_OPERATOR", "client python operator", "Operators", 102, "SCE_HP_IDENTIFIER", "client python identifier", "Identifiers", 103, "", "unused", "", 104, "SCE_HPHP_COMPLEX_VARIABLE", "server php identifier", "PHP complex variable", 105, "SCE_HPA_START", "server python default", "ASP Python", 106, "SCE_HPA_DEFAULT", "server python default", "ASP Python", 107, "SCE_HPA_COMMENTLINE", "server python comment line", "Comment", 108, "SCE_HPA_NUMBER", "server python literal numeric", "Number", 109, "SCE_HPA_STRING", "server python literal string", "String", 110, "SCE_HPA_CHARACTER", "server python literal string character", "Single quoted string", 111, "SCE_HPA_WORD", "server python keyword", "Keyword", 112, "SCE_HPA_TRIPLE", "server python literal string", "Triple quotes", 113, "SCE_HPA_TRIPLEDOUBLE", "server python literal string", "Triple double quotes", 114, "SCE_HPA_CLASSNAME", "server python identifier", "Class name definition", 115, "SCE_HPA_DEFNAME", "server python identifier", "Function or method name definition", 116, "SCE_HPA_OPERATOR", "server python operator", "Operators", 117, "SCE_HPA_IDENTIFIER", "server python identifier", "Identifiers", 118, "SCE_HPHP_DEFAULT", "server php default", "Default", 119, "SCE_HPHP_HSTRING", "server php literal string", "Double quoted String", 120, "SCE_HPHP_SIMPLESTRING", "server php literal string", "Single quoted string", 121, "SCE_HPHP_WORD", "server php keyword", "Keyword", 122, "SCE_HPHP_NUMBER", "server php literal numeric", "Number", 123, "SCE_HPHP_VARIABLE", "server php identifier", "Variable", 124, "SCE_HPHP_COMMENT", "server php comment", "Comment", 125, "SCE_HPHP_COMMENTLINE", "server php comment line", "One line comment", 126, "SCE_HPHP_HSTRING_VARIABLE", "server php literal string identifier", "PHP variable in double quoted string", 127, "SCE_HPHP_OPERATOR", "server php operator", "PHP operator", }; const LexicalClass lexicalClassesXML[] = { // Lexer.Secondary XML SCLEX_XML SCE_H_: 0, "SCE_H_DEFAULT", "default", "Default", 1, "SCE_H_TAG", "tag", "Tags", 2, "SCE_H_TAGUNKNOWN", "error tag", "Unknown Tags", 3, "SCE_H_ATTRIBUTE", "attribute", "Attributes", 4, "SCE_H_ERRORATTRIBUTEUNKNOWN", "error attribute", "Unknown Attributes", 5, "SCE_H_NUMBER", "literal numeric", "Numbers", 6, "SCE_H_DOUBLESTRING", "literal string", "Double quoted strings", 7, "SCE_H_SINGLESTRING", "literal string", "Single quoted strings", 8, "SCE_H_OTHER", "tag operator", "Other inside tag, including space and '='", 9, "SCE_H_COMMENT", "comment", "Comment", 10, "SCE_H_ENTITY", "literal", "Entities", 11, "SCE_H_TAGEND", "tag", "XML style tag ends '/>'", 12, "SCE_H_XMLSTART", "identifier", "XML identifier start ''", 14, "", "unused", "", 15, "", "unused", "", 16, "", "unused", "", 17, "SCE_H_CDATA", "literal", "CDATA", 18, "SCE_H_QUESTION", "preprocessor", "Question", 19, "SCE_H_VALUE", "literal string", "Unquoted Value", 20, "", "unused", "", 21, "SCE_H_SGML_DEFAULT", "default", "SGML tags ", 22, "SCE_H_SGML_COMMAND", "preprocessor", "SGML command", 23, "SCE_H_SGML_1ST_PARAM", "preprocessor", "SGML 1st param", 24, "SCE_H_SGML_DOUBLESTRING", "literal string", "SGML double string", 25, "SCE_H_SGML_SIMPLESTRING", "literal string", "SGML single string", 26, "SCE_H_SGML_ERROR", "error", "SGML error", 27, "SCE_H_SGML_SPECIAL", "literal", "SGML special (#XXXX type)", 28, "SCE_H_SGML_ENTITY", "literal", "SGML entity", 29, "SCE_H_SGML_COMMENT", "comment", "SGML comment", 30, "", "unused", "", 31, "SCE_H_SGML_BLOCK_DEFAULT", "default", "SGML block", }; const char * const tagsThatDoNotFold[] = { "area", "base", "basefont", "br", "col", "command", "embed", "frame", "hr", "img", "input", "isindex", "keygen", "link", "meta", "param", "source", "track", "wbr" }; } class LexerHTML : public DefaultLexer { bool isXml; bool isPHPScript; WordList keywords; WordList keywords2; WordList keywords3; WordList keywords4; WordList keywords5; WordList keywords6; // SGML (DTD) keywords OptionsHTML options; OptionSetHTML osHTML; std::set nonFoldingTags; SubStyles subStyles{styleSubable,SubStylesHTML,SubStylesAvailable,0}; public: explicit LexerHTML(bool isXml_, bool isPHPScript_) : DefaultLexer( isXml_ ? "xml" : (isPHPScript_ ? "phpscript" : "hypertext"), isXml_ ? SCLEX_XML : (isPHPScript_ ? SCLEX_PHPSCRIPT : SCLEX_HTML), isXml_ ? lexicalClassesXML : lexicalClassesHTML, isXml_ ? std::size(lexicalClassesXML) : std::size(lexicalClassesHTML)), isXml(isXml_), isPHPScript(isPHPScript_), osHTML(isPHPScript_), nonFoldingTags(std::begin(tagsThatDoNotFold), std::end(tagsThatDoNotFold)) { } ~LexerHTML() override { } void SCI_METHOD Release() override { delete this; } const char *SCI_METHOD PropertyNames() override { return osHTML.PropertyNames(); } int SCI_METHOD PropertyType(const char *name) override { return osHTML.PropertyType(name); } const char *SCI_METHOD DescribeProperty(const char *name) override { return osHTML.DescribeProperty(name); } Sci_Position SCI_METHOD PropertySet(const char *key, const char *val) override; const char * SCI_METHOD PropertyGet(const char *key) override { return osHTML.PropertyGet(key); } const char *SCI_METHOD DescribeWordListSets() override { return osHTML.DescribeWordListSets(); } Sci_Position SCI_METHOD WordListSet(int n, const char *wl) override; void SCI_METHOD Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; // No Fold as all folding performs in Lex. int SCI_METHOD AllocateSubStyles(int styleBase, int numberStyles) override { return subStyles.Allocate(styleBase, numberStyles); } int SCI_METHOD SubStylesStart(int styleBase) override { return subStyles.Start(styleBase); } int SCI_METHOD SubStylesLength(int styleBase) override { return subStyles.Length(styleBase); } int SCI_METHOD StyleFromSubStyle(int subStyle) override { const int styleBase = subStyles.BaseStyle(subStyle); return styleBase; } int SCI_METHOD PrimaryStyleFromStyle(int style) override { return style; } void SCI_METHOD FreeSubStyles() override { subStyles.Free(); } void SCI_METHOD SetIdentifiers(int style, const char *identifiers) override { subStyles.SetIdentifiers(style, identifiers); } int SCI_METHOD DistanceToSecondaryStyles() override { return 0; } const char *SCI_METHOD GetSubStyleBases() override { return styleSubable; } static ILexer5 *LexerFactoryHTML() { return new LexerHTML(false, false); } static ILexer5 *LexerFactoryXML() { return new LexerHTML(true, false); } static ILexer5 *LexerFactoryPHPScript() { return new LexerHTML(false, true); } }; Sci_Position SCI_METHOD LexerHTML::PropertySet(const char *key, const char *val) { if (osHTML.PropertySet(&options, key, val)) { return 0; } return -1; } Sci_Position SCI_METHOD LexerHTML::WordListSet(int n, const char *wl) { WordList *wordListN = nullptr; switch (n) { case 0: wordListN = &keywords; break; case 1: wordListN = &keywords2; break; case 2: wordListN = &keywords3; break; case 3: wordListN = &keywords4; break; case 4: wordListN = &keywords5; break; case 5: wordListN = &keywords6; break; default: break; } Sci_Position firstModification = -1; if (wordListN) { if (wordListN->Set(wl)) { firstModification = 0; } } return firstModification; } void SCI_METHOD LexerHTML::Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { Accessor styler(pAccess, nullptr); const WordClassifier &classifierTags = subStyles.Classifier(SCE_H_TAG); const WordClassifier &classifierAttributes = subStyles.Classifier(SCE_H_ATTRIBUTE); const WordClassifier &classifierJavaScript = subStyles.Classifier(SCE_HJ_WORD); const WordClassifier &classifierJavaScriptServer = subStyles.Classifier(SCE_HJA_WORD); const WordClassifier &classifierBasic = subStyles.Classifier(SCE_HB_WORD); const WordClassifier &classifierPython = subStyles.Classifier(SCE_HP_WORD); const WordClassifier &classifierPHP = subStyles.Classifier(SCE_HPHP_WORD); if (isPHPScript && (startPos == 0)) { initStyle = SCE_HPHP_DEFAULT; } styler.StartAt(startPos); std::string lastTag; std::string prevWord; PhpNumberState phpNumber; std::string phpStringDelimiter; int StateToPrint = initStyle; int state = stateForPrintState(StateToPrint); std::string makoBlockType; int makoComment = 0; std::string djangoBlockType; // If inside a tag, it may be a script tag, so reread from the start of line starting tag to ensure any language tags are seen if (InTagState(state)) { while ((startPos > 0) && (InTagState(styler.StyleIndexAt(startPos - 1)))) { const Sci_Position backLineStart = styler.LineStart(styler.GetLine(startPos-1)); length += startPos - backLineStart; startPos = backLineStart; } state = SCE_H_DEFAULT; } // String can be heredoc, must find a delimiter first. Reread from beginning of line containing the string, to get the correct lineState if (isPHPStringState(state)) { while (startPos > 0 && (isPHPStringState(state) || !isLineEnd(styler[startPos - 1]))) { startPos--; length++; state = styler.StyleIndexAt(startPos); } if (startPos == 0) state = SCE_H_DEFAULT; } styler.StartAt(startPos); /* Nothing handles getting out of these, so we need not start in any of them. * As we're at line start and they can't span lines, we'll re-detect them anyway */ switch (state) { case SCE_H_QUESTION: case SCE_H_XMLSTART: case SCE_H_XMLEND: case SCE_H_ASP: state = SCE_H_DEFAULT; break; default: break; } Sci_Position lineCurrent = styler.GetLine(startPos); int lineState; if (lineCurrent > 0) { lineState = styler.GetLineState(lineCurrent-1); } else { // Default client and ASP scripting language is JavaScript lineState = eScriptJS << 8; lineState |= options.aspDefaultLanguage << 4; } script_mode inScriptType = static_cast((lineState >> 0) & 0x03); // 2 bits of scripting mode bool tagOpened = (lineState >> 2) & 0x01; // 1 bit to know if we are in an opened tag bool tagClosing = (lineState >> 3) & 0x01; // 1 bit to know if we are in a closing tag bool tagDontFold = false; //some HTML tags should not be folded script_type aspScript = static_cast((lineState >> 4) & 0x0F); // 4 bits of script name script_type clientScript = static_cast((lineState >> 8) & 0x0F); // 4 bits of script name int beforePreProc = (lineState >> 12) & 0xFF; // 8 bits of state bool isLanguageType = (lineState >> 20) & 1; // type or language attribute for script tag script_type scriptLanguage = ScriptOfState(state); // If eNonHtmlScript coincides with SCE_H_COMMENT, assume eScriptComment if (inScriptType == eNonHtmlScript && state == SCE_H_COMMENT) { scriptLanguage = eScriptComment; } script_type beforeLanguage = ScriptOfState(beforePreProc); const bool foldHTML = options.foldHTML; const bool fold = foldHTML && options.fold; const bool foldHTMLPreprocessor = foldHTML && options.foldHTMLPreprocessor; const bool foldCompact = options.foldCompact; const bool foldComment = fold && options.foldComment; const bool foldHeredoc = fold && options.foldHeredoc; const bool foldXmlAtTagOpen = isXml && fold && options.foldXmlAtTagOpen; const bool caseSensitive = options.caseSensitive; const bool allowScripts = options.allowScripts; const AllowPHP allowPHP = isXml ? options.allowPHPinXML : options.allowPHPinHTML; const bool isMako = options.isMako; const bool isDjango = options.isDjango; const bool allowASP = (isXml ? options.allowASPinXML : options.allowASPinHTML) && !isMako && !isDjango; const CharacterSet setHTMLWord(CharacterSet::setAlphaNum, ".-_:!#", true); const CharacterSet setTagContinue(CharacterSet::setAlphaNum, ".-_:!#[", true); const CharacterSet setAttributeContinue(CharacterSet::setAlphaNum, ".-_:!#/", true); // TODO: also handle + and - (except if they're part of ++ or --) and return keywords const CharacterSet setOKBeforeJSRE(CharacterSet::setNone, "([{=,:;!%^&*|?~> "); // Only allow [A-Za-z0-9.#-_:] in entities const CharacterSet setEntity(CharacterSet::setAlphaNum, ".#-_:"); int levelPrev = styler.LevelAt(lineCurrent) & SC_FOLDLEVELNUMBERMASK; int levelCurrent = levelPrev; Sci_Position visibleChars = 0; int lineStartVisibleChars = 0; int chPrev = ' '; int ch = ' '; int chPrevNonWhite = ' '; // look back to set chPrevNonWhite properly for better regex colouring if (scriptLanguage == eScriptJS && startPos > 0) { Sci_Position back = startPos; int style = 0; while (--back) { style = styler.StyleIndexAt(back); if (style < SCE_HJ_DEFAULT || style > SCE_HJ_COMMENTDOC) // includes SCE_HJ_COMMENT & SCE_HJ_COMMENTLINE break; } if (style == SCE_HJ_SYMBOLS) { chPrevNonWhite = SafeGetUnsignedCharAt(styler, back); } } styler.StartSegment(startPos); const Sci_Position lengthDoc = startPos + length; for (Sci_Position i = startPos; i < lengthDoc; i++) { const int chPrev2 = chPrev; chPrev = ch; if (!IsASpace(ch) && state != SCE_HJ_COMMENT && state != SCE_HJ_COMMENTLINE && state != SCE_HJ_COMMENTDOC) chPrevNonWhite = ch; ch = static_cast(styler[i]); int chNext = SafeGetUnsignedCharAt(styler, i + 1); const int chNext2 = SafeGetUnsignedCharAt(styler, i + 2); // Handle DBCS codepages if (styler.IsLeadByte(static_cast(ch))) { chPrev = ' '; i += 1; continue; } if ((!IsASpace(ch) || !foldCompact) && fold) visibleChars++; if (!IsASpace(ch)) lineStartVisibleChars++; // decide what is the current state to print (depending of the script tag) StateToPrint = statePrintForState(state, inScriptType); // handle script folding if (fold) { switch (scriptLanguage) { case eScriptJS: case eScriptPHP: //not currently supported case eScriptVBS: if (!AnyOf(state, SCE_HPHP_COMMENT, SCE_HPHP_COMMENTLINE, SCE_HJ_REGEX, SCE_HJ_COMMENT, SCE_HJ_COMMENTLINE, SCE_HJ_COMMENTDOC) && !isStringState(state)) { //Platform::DebugPrintf("state=%d, StateToPrint=%d, initStyle=%d\n", state, StateToPrint, initStyle); //if ((state == SCE_HPHP_OPERATOR) || (state == SCE_HPHP_DEFAULT) || (state == SCE_HJ_SYMBOLS) || (state == SCE_HJ_START) || (state == SCE_HJ_DEFAULT)) { if (ch == '#') { Sci_Position j = i + 1; while ((j < lengthDoc) && IsASpaceOrTab(styler.SafeGetCharAt(j))) { j++; } if (styler.Match(j, "region") || styler.Match(j, "if")) { levelCurrent++; } else if (styler.Match(j, "end")) { levelCurrent--; } } else if ((ch == '{') || (ch == '}') || (foldComment && (ch == '/') && (chNext == '*'))) { levelCurrent += (((ch == '{') || (ch == '/')) ? 1 : -1); } } else if (((state == SCE_HPHP_COMMENT) || (state == SCE_HJ_COMMENT || state == SCE_HJ_COMMENTDOC)) && foldComment && (ch == '*') && (chNext == '/')) { levelCurrent--; } break; case eScriptPython: if (state != SCE_HP_COMMENTLINE && !isMako) { if ((ch == ':') && ((chNext == '\n') || (chNext == '\r' && chNext2 == '\n'))) { levelCurrent++; } else if ((ch == '\n') && !((chNext == '\r') && (chNext2 == '\n')) && (chNext != '\n')) { // check if the number of tabs is lower than the level constexpr int tabWidth = 8; int Findlevel = (levelCurrent & ~SC_FOLDLEVELBASE) * tabWidth; for (Sci_Position j = 0; Findlevel > 0; j++) { const char chTmp = styler.SafeGetCharAt(i + j + 1); if (chTmp == '\t') { Findlevel -= tabWidth; } else if (chTmp == ' ') { Findlevel--; } else { break; } } if (Findlevel > 0) { levelCurrent -= Findlevel / tabWidth; if (Findlevel % tabWidth) levelCurrent--; } } } break; default: break; } } if ((ch == '\r' && chNext != '\n') || (ch == '\n')) { // Trigger on CR only (Mac style) or either on LF from CR+LF (Dos/Win) or on LF alone (Unix) // Avoid triggering two times on Dos/Win // New line -> record any line state onto /next/ line if (fold) { int lev = levelPrev; if (visibleChars == 0) lev |= SC_FOLDLEVELWHITEFLAG; if ((levelCurrent > levelPrev) && (visibleChars > 0)) lev |= SC_FOLDLEVELHEADERFLAG; styler.SetLevel(lineCurrent, lev); visibleChars = 0; levelPrev = levelCurrent; } styler.SetLineState(lineCurrent, ((inScriptType & 0x03) << 0) | ((tagOpened ? 1 : 0) << 2) | ((tagClosing ? 1 : 0) << 3) | ((aspScript & 0x0F) << 4) | ((clientScript & 0x0F) << 8) | ((beforePreProc & 0xFF) << 12) | ((isLanguageType ? 1 : 0) << 20)); lineCurrent++; lineStartVisibleChars = 0; } // handle start of Mako comment line if (isMako && ch == '#' && chNext == '#') { makoComment = 1; state = SCE_HP_COMMENTLINE; } // handle end of Mako comment line else if (isMako && makoComment && (ch == '\r' || ch == '\n')) { makoComment = 0; styler.ColourTo(i - 1, StateToPrint); if (scriptLanguage == eScriptPython) { state = SCE_HP_DEFAULT; } else { state = SCE_H_DEFAULT; } } // Allow falling through to mako handling code if newline is going to end a block if (((ch == '\r' && chNext != '\n') || (ch == '\n')) && (!isMako || (makoBlockType != "%"))) { } // Ignore everything in mako comment until the line ends else if (isMako && makoComment) { } // generic end of script processing else if ((inScriptType == eNonHtmlScript) && (ch == '<') && (chNext == '/')) { // Check if it's the end of the script tag (or any other HTML tag) switch (state) { // in these cases, you can embed HTML tags (to confirm !!!!!!!!!!!!!!!!!!!!!!) case SCE_H_DOUBLESTRING: case SCE_H_SINGLESTRING: case SCE_HJ_COMMENT: case SCE_HJ_COMMENTDOC: //case SCE_HJ_COMMENTLINE: // removed as this is a common thing done to hide // the end of script marker from some JS interpreters. //case SCE_HB_COMMENTLINE: case SCE_HBA_COMMENTLINE: case SCE_HJ_DOUBLESTRING: case SCE_HJ_SINGLESTRING: case SCE_HJ_REGEX: case SCE_HB_STRING: case SCE_HBA_STRING: case SCE_HP_STRING: case SCE_HP_TRIPLE: case SCE_HP_TRIPLEDOUBLE: case SCE_HPHP_HSTRING: case SCE_HPHP_SIMPLESTRING: case SCE_HPHP_COMMENT: case SCE_HPHP_COMMENTLINE: break; default : // check if the closing tag is a script tag if (const char *tag = (state == SCE_HJ_COMMENTLINE || state == SCE_HB_COMMENTLINE || isXml) ? "script" : state == SCE_H_COMMENT ? "comment" : nullptr) { Sci_Position j = i + 2; int chr; do { chr = static_cast(*tag++); } while (chr != 0 && chr == MakeLowerCase(styler.SafeGetCharAt(j++))); if (chr != 0) break; } // closing tag of the script (it's a closing HTML tag anyway) styler.ColourTo(i - 1, StateToPrint); state = SCE_H_TAGUNKNOWN; inScriptType = eHtml; scriptLanguage = eScriptNone; clientScript = eScriptJS; isLanguageType = false; i += 2; visibleChars += 2; tagClosing = true; if (foldXmlAtTagOpen) { levelCurrent--; } continue; } } ///////////////////////////////////// // handle the start of PHP pre-processor = Non-HTML else if ((ch == '<') && (chNext == '?') && IsPHPEntryState(state) && IsPHPStart(allowPHP, styler, i)) { beforeLanguage = scriptLanguage; scriptLanguage = segIsScriptingIndicator(styler, i + 2, i + 6, isXml ? eScriptXML : eScriptPHP); if ((scriptLanguage != eScriptPHP) && (isStringState(state) || (state==SCE_H_COMMENT))) continue; styler.ColourTo(i - 1, StateToPrint); beforePreProc = state; i++; visibleChars++; i += PrintScriptingIndicatorOffset(styler, styler.GetStartSegment() + 2, i + 6); if (scriptLanguage == eScriptXML) styler.ColourTo(i, SCE_H_XMLSTART); else styler.ColourTo(i, SCE_H_QUESTION); state = StateForScript(scriptLanguage); if (inScriptType == eNonHtmlScript) inScriptType = eNonHtmlScriptPreProc; else inScriptType = eNonHtmlPreProc; // Fold whole script, but not if the XML first tag (all XML-like tags in this case) if (foldHTMLPreprocessor && (scriptLanguage != eScriptXML)) { levelCurrent++; } // should be better ch = SafeGetUnsignedCharAt(styler, i); continue; } // handle the start Mako template Python code else if (isMako && scriptLanguage == eScriptNone && ((ch == '<' && chNext == '%') || (lineStartVisibleChars == 1 && ch == '%') || (lineStartVisibleChars == 1 && ch == '/' && chNext == '%') || (ch == '$' && chNext == '{') || (ch == '<' && chNext == '/' && chNext2 == '%'))) { if (ch == '%' || ch == '/') makoBlockType = "%"; else if (ch == '$') makoBlockType = "{"; else if (chNext == '/') makoBlockType = GetNextWord(styler, i+3); // Tag end: else makoBlockType = GetNextWord(styler, i+2); // Tag: <%tag...> styler.ColourTo(i - 1, StateToPrint); beforePreProc = state; if (inScriptType == eNonHtmlScript) inScriptType = eNonHtmlScriptPreProc; else inScriptType = eNonHtmlPreProc; if (chNext == '/') { i += 2; visibleChars += 2; } else if (ch != '%') { i++; visibleChars++; } state = SCE_HP_START; scriptLanguage = eScriptPython; styler.ColourTo(i, SCE_H_ASP); if (ch != '%' && ch != '$' && ch != '/') { i += makoBlockType.length(); visibleChars += makoBlockType.length(); if (keywords4.InList(makoBlockType)) styler.ColourTo(i, SCE_HP_WORD); else styler.ColourTo(i, SCE_H_TAGUNKNOWN); } ch = SafeGetUnsignedCharAt(styler, i); continue; } // handle the start/end of Django comment else if (isDjango && state != SCE_H_COMMENT && (ch == '{' && chNext == '#')) { styler.ColourTo(i - 1, StateToPrint); beforePreProc = state; beforeLanguage = scriptLanguage; if (inScriptType == eNonHtmlScript) inScriptType = eNonHtmlScriptPreProc; else inScriptType = eNonHtmlPreProc; i += 1; visibleChars += 1; scriptLanguage = eScriptComment; state = SCE_H_COMMENT; styler.ColourTo(i, SCE_H_ASP); ch = SafeGetUnsignedCharAt(styler, i); continue; } else if (isDjango && state == SCE_H_COMMENT && (ch == '#' && chNext == '}')) { styler.ColourTo(i - 1, StateToPrint); i += 1; visibleChars += 1; styler.ColourTo(i, SCE_H_ASP); state = beforePreProc; if (inScriptType == eNonHtmlScriptPreProc) inScriptType = eNonHtmlScript; else inScriptType = eHtml; scriptLanguage = beforeLanguage; continue; } // handle the start Django template code else if (isDjango && scriptLanguage != eScriptPython && scriptLanguage != eScriptComment && (ch == '{' && (chNext == '%' || chNext == '{'))) { if (chNext == '%') djangoBlockType = "%"; else djangoBlockType = "{"; styler.ColourTo(i - 1, StateToPrint); beforePreProc = state; if (inScriptType == eNonHtmlScript) inScriptType = eNonHtmlScriptPreProc; else inScriptType = eNonHtmlPreProc; i += 1; visibleChars += 1; state = SCE_HP_START; beforeLanguage = scriptLanguage; scriptLanguage = eScriptPython; styler.ColourTo(i, SCE_H_ASP); ch = SafeGetUnsignedCharAt(styler, i); continue; } // handle the start of ASP pre-processor = Non-HTML else if ((ch == '<') && (chNext == '%') && allowASP && !isCommentASPState(state) && !isPHPStringState(state)) { styler.ColourTo(i - 1, StateToPrint); beforePreProc = state; if (inScriptType == eNonHtmlScript) inScriptType = eNonHtmlScriptPreProc; else inScriptType = eNonHtmlPreProc; // fold whole script if (foldHTMLPreprocessor) levelCurrent++; if (chNext2 == '@') { i += 2; // place as if it was the second next char treated visibleChars += 2; state = SCE_H_ASPAT; scriptLanguage = eScriptVBS; } else if ((chNext2 == '-') && (styler.SafeGetCharAt(i + 3) == '-')) { styler.ColourTo(i + 3, SCE_H_ASP); state = SCE_H_XCCOMMENT; scriptLanguage = eScriptVBS; continue; } else { if (chNext2 == '=') { i += 2; // place as if it was the second next char treated visibleChars += 2; } else { i++; // place as if it was the next char treated visibleChars++; } state = StateForScript(aspScript); scriptLanguage = aspScript; } styler.ColourTo(i, SCE_H_ASP); // should be better ch = SafeGetUnsignedCharAt(styler, i); continue; } ///////////////////////////////////// // handle the start of SGML language (DTD) else if (((scriptLanguage == eScriptNone) || (scriptLanguage == eScriptXML)) && (chPrev == '<') && (ch == '!') && (StateToPrint != SCE_H_CDATA) && (!isStringState(StateToPrint)) && (!IsCommentState(StateToPrint)) && (!IsScriptCommentState(StateToPrint))) { beforePreProc = state; styler.ColourTo(i - 2, StateToPrint); if ((chNext == '-') && (chNext2 == '-')) { state = SCE_H_COMMENT; // wait for a pending command styler.ColourTo(i + 2, SCE_H_COMMENT); i += 2; // follow styling after the -- if (!isXml) { // handle empty comment: , // https://html.spec.whatwg.org/multipage/parsing.html#parse-error-abrupt-closing-of-empty-comment chNext = SafeGetUnsignedCharAt(styler, i + 1); if ((chNext == '>') || (chNext == '-' && SafeGetUnsignedCharAt(styler, i + 2) == '>')) { if (chNext == '-') { i += 1; } chPrev = '-'; ch = '-'; } } } else if (isWordCdata(i + 1, i + 7, styler)) { state = SCE_H_CDATA; } else { styler.ColourTo(i, SCE_H_SGML_DEFAULT); // ') { i++; visibleChars++; } else if ((makoBlockType == "%") && ch == '/') { i++; visibleChars++; } if ((makoBlockType != "%") || ch == '/') { styler.ColourTo(i, SCE_H_ASP); } state = beforePreProc; if (inScriptType == eNonHtmlScriptPreProc) inScriptType = eNonHtmlScript; else inScriptType = eHtml; scriptLanguage = eScriptNone; continue; } // handle the end of Django template code else if (isDjango && ((inScriptType == eNonHtmlPreProc) || (inScriptType == eNonHtmlScriptPreProc)) && (scriptLanguage != eScriptNone) && stateAllowsTermination(state) && isDjangoBlockEnd(ch, chNext, djangoBlockType)) { if (state == SCE_H_ASPAT) { aspScript = segIsScriptingIndicator(styler, styler.GetStartSegment(), i - 1, aspScript); } if (state == SCE_HP_WORD) { classifyWordHTPy(styler.GetStartSegment(), i - 1, keywords4, classifierPython, styler, prevWord, inScriptType, isMako); } else { styler.ColourTo(i - 1, StateToPrint); } i += 1; visibleChars += 1; styler.ColourTo(i, SCE_H_ASP); state = beforePreProc; if (inScriptType == eNonHtmlScriptPreProc) inScriptType = eNonHtmlScript; else inScriptType = eHtml; scriptLanguage = beforeLanguage; continue; } // handle the end of a pre-processor = Non-HTML else if ((!isMako && !isDjango && ((inScriptType == eNonHtmlPreProc) || (inScriptType == eNonHtmlScriptPreProc)) && (((scriptLanguage != eScriptNone) && stateAllowsTermination(state))) && ((chNext == '>') && isPreProcessorEndTag(state, ch))) || ((scriptLanguage == eScriptSGML) && (ch == '>') && (state != SCE_H_SGML_COMMENT))) { if (state == SCE_H_ASPAT) { aspScript = segIsScriptingIndicator(styler, styler.GetStartSegment(), i - 1, aspScript); } // Bounce out of any ASP mode switch (state) { case SCE_HJ_WORD: classifyWordHTJS(styler.GetStartSegment(), i - 1, keywords2, classifierJavaScript, classifierJavaScriptServer, styler, inScriptType); break; case SCE_HB_WORD: classifyWordHTVB(styler.GetStartSegment(), i - 1, keywords3, classifierBasic, styler, inScriptType); break; case SCE_HP_WORD: classifyWordHTPy(styler.GetStartSegment(), i - 1, keywords4, classifierPython, styler, prevWord, inScriptType, isMako); break; case SCE_HPHP_WORD: classifyWordHTPHP(styler.GetStartSegment(), i - 1, keywords5, classifierPHP, styler); break; case SCE_H_XCCOMMENT: styler.ColourTo(i - 1, state); break; default : styler.ColourTo(i - 1, StateToPrint); break; } if (scriptLanguage != eScriptSGML) { i++; visibleChars++; } if (ch == '%') styler.ColourTo(i, SCE_H_ASP); else if (scriptLanguage == eScriptXML) styler.ColourTo(i, SCE_H_XMLEND); else if (scriptLanguage == eScriptSGML) styler.ColourTo(i, SCE_H_SGML_DEFAULT); else styler.ColourTo(i, SCE_H_QUESTION); state = beforePreProc; if (inScriptType == eNonHtmlScriptPreProc) inScriptType = eNonHtmlScript; else inScriptType = eHtml; // Unfold all scripting languages, except for XML tag if (foldHTMLPreprocessor && (scriptLanguage != eScriptXML)) { levelCurrent--; } scriptLanguage = beforeLanguage; continue; } ///////////////////////////////////// switch (state) { case SCE_H_DEFAULT: if (ch == '<') { // in HTML, fold on tag open and unfold on tag close tagOpened = true; tagClosing = (chNext == '/'); if (foldXmlAtTagOpen && !AnyOf(chNext, '/', '?', '!', '-', '%')) { levelCurrent++; } if (foldXmlAtTagOpen && chNext == '/') { levelCurrent--; } styler.ColourTo(i - 1, StateToPrint); if (chNext != '!') state = SCE_H_TAGUNKNOWN; } else if (ch == '&') { styler.ColourTo(i - 1, SCE_H_DEFAULT); state = SCE_H_ENTITY; } break; case SCE_H_SGML_DEFAULT: case SCE_H_SGML_BLOCK_DEFAULT: // if (scriptLanguage == eScriptSGMLblock) // StateToPrint = SCE_H_SGML_BLOCK_DEFAULT; if (ch == '\"') { styler.ColourTo(i - 1, StateToPrint); state = SCE_H_SGML_DOUBLESTRING; } else if (ch == '\'') { styler.ColourTo(i - 1, StateToPrint); state = SCE_H_SGML_SIMPLESTRING; } else if ((ch == '-') && (chPrev == '-')) { if (static_cast(styler.GetStartSegment()) <= (i - 2)) { styler.ColourTo(i - 2, StateToPrint); } state = SCE_H_SGML_COMMENT; } else if (IsUpperOrLowerCase(ch) && (chPrev == '%')) { styler.ColourTo(i - 2, StateToPrint); state = SCE_H_SGML_ENTITY; } else if (ch == '#') { styler.ColourTo(i - 1, StateToPrint); state = SCE_H_SGML_SPECIAL; } else if (ch == '[') { styler.ColourTo(i - 1, StateToPrint); scriptLanguage = eScriptSGMLblock; state = SCE_H_SGML_BLOCK_DEFAULT; } else if (ch == ']') { if (scriptLanguage == eScriptSGMLblock) { styler.ColourTo(i, StateToPrint); scriptLanguage = eScriptSGML; } else { styler.ColourTo(i - 1, StateToPrint); styler.ColourTo(i, SCE_H_SGML_ERROR); } state = SCE_H_SGML_DEFAULT; } else if (scriptLanguage == eScriptSGMLblock) { if ((ch == '!') && (chPrev == '<')) { styler.ColourTo(i - 2, StateToPrint); styler.ColourTo(i, SCE_H_SGML_DEFAULT); state = SCE_H_SGML_COMMAND; } else if (ch == '>') { styler.ColourTo(i - 1, StateToPrint); styler.ColourTo(i, SCE_H_SGML_DEFAULT); } } break; case SCE_H_SGML_COMMAND: if ((ch == '-') && (chPrev == '-')) { styler.ColourTo(i - 2, StateToPrint); state = SCE_H_SGML_COMMENT; } else if (!issgmlwordchar(ch)) { if (isWordHSGML(styler.GetStartSegment(), i - 1, keywords6, styler)) { styler.ColourTo(i - 1, StateToPrint); state = SCE_H_SGML_1ST_PARAM; } else { state = SCE_H_SGML_ERROR; } } break; case SCE_H_SGML_1ST_PARAM: // wait for the beginning of the word if ((ch == '-') && (chPrev == '-')) { if (scriptLanguage == eScriptSGMLblock) { styler.ColourTo(i - 2, SCE_H_SGML_BLOCK_DEFAULT); } else { styler.ColourTo(i - 2, SCE_H_SGML_DEFAULT); } state = SCE_H_SGML_1ST_PARAM_COMMENT; } else if (issgmlwordchar(ch)) { if (scriptLanguage == eScriptSGMLblock) { styler.ColourTo(i - 1, SCE_H_SGML_BLOCK_DEFAULT); } else { styler.ColourTo(i - 1, SCE_H_SGML_DEFAULT); } // find the length of the word Sci_Position size = 1; while (setHTMLWord.Contains(SafeGetUnsignedCharAt(styler, i + size))) size++; styler.ColourTo(i + size - 1, StateToPrint); i += size - 1; visibleChars += size - 1; ch = SafeGetUnsignedCharAt(styler, i); if (scriptLanguage == eScriptSGMLblock) { state = SCE_H_SGML_BLOCK_DEFAULT; } else { state = SCE_H_SGML_DEFAULT; } continue; } break; case SCE_H_SGML_ERROR: if ((ch == '-') && (chPrev == '-')) { styler.ColourTo(i - 2, StateToPrint); state = SCE_H_SGML_COMMENT; } break; case SCE_H_SGML_DOUBLESTRING: if (ch == '\"') { styler.ColourTo(i, StateToPrint); state = SCE_H_SGML_DEFAULT; } break; case SCE_H_SGML_SIMPLESTRING: if (ch == '\'') { styler.ColourTo(i, StateToPrint); state = SCE_H_SGML_DEFAULT; } break; case SCE_H_SGML_COMMENT: if ((ch == '-') && (chPrev == '-')) { styler.ColourTo(i, StateToPrint); state = SCE_H_SGML_DEFAULT; } break; case SCE_H_CDATA: if ((chPrev2 == ']') && (chPrev == ']') && (ch == '>')) { styler.ColourTo(i, StateToPrint); state = SCE_H_DEFAULT; levelCurrent--; } break; case SCE_H_COMMENT: if ((scriptLanguage != eScriptComment) && (chPrev2 == '-') && (chPrev == '-') && (ch == '>' || (!isXml && ch == '!' && chNext == '>'))) { // close HTML comment with --!> // https://html.spec.whatwg.org/multipage/parsing.html#parse-error-incorrectly-closed-comment if (ch == '!') { i += 1; } styler.ColourTo(i, StateToPrint); state = SCE_H_DEFAULT; levelCurrent--; } break; case SCE_H_SGML_1ST_PARAM_COMMENT: if ((ch == '-') && (chPrev == '-')) { styler.ColourTo(i, SCE_H_SGML_COMMENT); state = SCE_H_SGML_1ST_PARAM; } break; case SCE_H_SGML_SPECIAL: if (!IsUpperCase(ch)) { styler.ColourTo(i - 1, StateToPrint); if (IsAlphaNumeric(ch)) { state = SCE_H_SGML_ERROR; } else { state = SCE_H_SGML_DEFAULT; } } break; case SCE_H_SGML_ENTITY: if (ch == ';') { styler.ColourTo(i, StateToPrint); state = SCE_H_SGML_DEFAULT; } else if (!(IsAlphaNumeric(ch)) && ch != '-' && ch != '.') { styler.ColourTo(i, SCE_H_SGML_ERROR); state = SCE_H_SGML_DEFAULT; } break; case SCE_H_ENTITY: if (ch == ';') { styler.ColourTo(i, StateToPrint); state = SCE_H_DEFAULT; } else if (!setEntity.Contains(ch)) { styler.ColourTo(i-1, SCE_H_TAGUNKNOWN); state = SCE_H_DEFAULT; if (!isLineEnd(ch)) { // Retreat one byte so the character that is invalid inside entity // may start something else like a tag. --i; continue; } } break; case SCE_H_TAGUNKNOWN: if (!setTagContinue.Contains(ch) && !((ch == '/') && (chPrev == '<'))) { int eClass = classifyTagHTML(styler.GetStartSegment(), i - 1, keywords, classifierTags, styler, tagDontFold, caseSensitive, isXml, allowScripts, nonFoldingTags, lastTag); if (eClass == SCE_H_SCRIPT || eClass == SCE_H_COMMENT) { if (!tagClosing) { inScriptType = eNonHtmlScript; scriptLanguage = eClass == SCE_H_SCRIPT ? clientScript : eScriptComment; } else { scriptLanguage = eScriptNone; } isLanguageType = false; eClass = SCE_H_TAG; } if (ch == '>') { styler.ColourTo(i, eClass); if (inScriptType == eNonHtmlScript) { state = StateForScript(scriptLanguage); } else { state = SCE_H_DEFAULT; } tagOpened = false; if (!(foldXmlAtTagOpen || tagDontFold)) { if (tagClosing) { levelCurrent--; } else { levelCurrent++; } } tagClosing = false; } else if (ch == '/' && chNext == '>') { if (eClass == SCE_H_TAGUNKNOWN) { styler.ColourTo(i + 1, SCE_H_TAGUNKNOWN); } else { styler.ColourTo(i - 1, StateToPrint); styler.ColourTo(i + 1, SCE_H_TAGEND); } i++; ch = chNext; state = SCE_H_DEFAULT; tagOpened = false; if (foldXmlAtTagOpen) { levelCurrent--; } } else { if (eClass != SCE_H_TAGUNKNOWN) { if (eClass == SCE_H_SGML_DEFAULT) { state = SCE_H_SGML_DEFAULT; } else { state = SCE_H_OTHER; } } } } break; case SCE_H_ATTRIBUTE: if (!setAttributeContinue.Contains(ch)) { isLanguageType = classifyAttribHTML(inScriptType, styler.GetStartSegment(), i - 1, keywords, classifierAttributes, styler, lastTag); if (ch == '>') { styler.ColourTo(i, SCE_H_TAG); if (inScriptType == eNonHtmlScript) { state = StateForScript(scriptLanguage); } else { state = SCE_H_DEFAULT; } tagOpened = false; if (!(foldXmlAtTagOpen || tagDontFold)) { if (tagClosing) { levelCurrent--; } else { levelCurrent++; } } tagClosing = false; } else if (ch == '=') { styler.ColourTo(i, SCE_H_OTHER); state = SCE_H_VALUE; } else { state = SCE_H_OTHER; } } break; case SCE_H_OTHER: if (ch == '>') { styler.ColourTo(i - 1, StateToPrint); styler.ColourTo(i, SCE_H_TAG); if (inScriptType == eNonHtmlScript) { state = StateForScript(scriptLanguage); } else { state = SCE_H_DEFAULT; } tagOpened = false; if (!(foldXmlAtTagOpen || tagDontFold)) { if (tagClosing) { levelCurrent--; } else { levelCurrent++; } } tagClosing = false; } else if (ch == '\"') { styler.ColourTo(i - 1, StateToPrint); state = SCE_H_DOUBLESTRING; } else if (ch == '\'') { styler.ColourTo(i - 1, StateToPrint); state = SCE_H_SINGLESTRING; } else if (ch == '=') { styler.ColourTo(i, StateToPrint); state = SCE_H_VALUE; } else if (ch == '/' && chNext == '>') { styler.ColourTo(i - 1, StateToPrint); styler.ColourTo(i + 1, SCE_H_TAGEND); i++; ch = chNext; state = SCE_H_DEFAULT; tagOpened = false; if (foldXmlAtTagOpen) { levelCurrent--; } } else if (ch == '?' && chNext == '>') { styler.ColourTo(i - 1, StateToPrint); styler.ColourTo(i + 1, SCE_H_XMLEND); i++; ch = chNext; state = SCE_H_DEFAULT; } else if (setHTMLWord.Contains(ch)) { styler.ColourTo(i - 1, StateToPrint); state = SCE_H_ATTRIBUTE; } break; case SCE_H_DOUBLESTRING: if (ch == '\"') { if (isLanguageType) { scriptLanguage = segIsScriptingIndicator(styler, styler.GetStartSegment(), i, scriptLanguage); clientScript = scriptLanguage; isLanguageType = false; } styler.ColourTo(i, SCE_H_DOUBLESTRING); state = SCE_H_OTHER; } break; case SCE_H_SINGLESTRING: if (ch == '\'') { if (isLanguageType) { scriptLanguage = segIsScriptingIndicator(styler, styler.GetStartSegment(), i, scriptLanguage); clientScript = scriptLanguage; isLanguageType = false; } styler.ColourTo(i, SCE_H_SINGLESTRING); state = SCE_H_OTHER; } break; case SCE_H_VALUE: if (!setHTMLWord.Contains(ch)) { if (ch == '\"' && chPrev == '=') { // Should really test for being first character state = SCE_H_DOUBLESTRING; } else if (ch == '\'' && chPrev == '=') { state = SCE_H_SINGLESTRING; } else { if (IsNumberChar(styler[styler.GetStartSegment()])) { styler.ColourTo(i - 1, SCE_H_NUMBER); } else { styler.ColourTo(i - 1, StateToPrint); } if (ch == '>') { styler.ColourTo(i, SCE_H_TAG); if (inScriptType == eNonHtmlScript) { state = StateForScript(scriptLanguage); } else { state = SCE_H_DEFAULT; } tagOpened = false; if (!tagDontFold) { if (tagClosing) { levelCurrent--; } else { levelCurrent++; } } tagClosing = false; } else { state = SCE_H_OTHER; } } } break; case SCE_HJ_DEFAULT: case SCE_HJ_START: case SCE_HJ_SYMBOLS: if (IsAWordStart(ch)) { styler.ColourTo(i - 1, StateToPrint); state = SCE_HJ_WORD; } else if (ch == '/' && chNext == '*') { styler.ColourTo(i - 1, StateToPrint); if (chNext2 == '*') state = SCE_HJ_COMMENTDOC; else state = SCE_HJ_COMMENT; if (chNext2 == '/') { // Eat the * so it isn't used for the end of the comment i++; } } else if (ch == '/' && chNext == '/') { styler.ColourTo(i - 1, StateToPrint); state = SCE_HJ_COMMENTLINE; } else if (ch == '/' && setOKBeforeJSRE.Contains(chPrevNonWhite)) { styler.ColourTo(i - 1, StateToPrint); state = SCE_HJ_REGEX; } else if (ch == '\"') { styler.ColourTo(i - 1, StateToPrint); state = SCE_HJ_DOUBLESTRING; } else if (ch == '\'') { styler.ColourTo(i - 1, StateToPrint); state = SCE_HJ_SINGLESTRING; } else if ((ch == '<') && (chNext == '!') && (chNext2 == '-') && styler.SafeGetCharAt(i + 3) == '-') { styler.ColourTo(i - 1, StateToPrint); state = SCE_HJ_COMMENTLINE; } else if ((ch == '-') && (chNext == '-') && (chNext2 == '>')) { styler.ColourTo(i - 1, StateToPrint); state = SCE_HJ_COMMENTLINE; i += 2; } else if (IsOperator(ch)) { styler.ColourTo(i - 1, StateToPrint); styler.ColourTo(i, statePrintForState(SCE_HJ_SYMBOLS, inScriptType)); state = SCE_HJ_DEFAULT; } else if ((ch == ' ') || (ch == '\t')) { if (state == SCE_HJ_START) { styler.ColourTo(i - 1, StateToPrint); state = SCE_HJ_DEFAULT; } } break; case SCE_HJ_WORD: if (!IsAWordChar(ch)) { classifyWordHTJS(styler.GetStartSegment(), i - 1, keywords2, classifierJavaScript, classifierJavaScriptServer, styler, inScriptType); //styler.ColourTo(i - 1, eHTJSKeyword); state = SCE_HJ_DEFAULT; if (ch == '/' && chNext == '*') { if (chNext2 == '*') state = SCE_HJ_COMMENTDOC; else state = SCE_HJ_COMMENT; } else if (ch == '/' && chNext == '/') { state = SCE_HJ_COMMENTLINE; } else if (ch == '\"') { state = SCE_HJ_DOUBLESTRING; } else if (ch == '\'') { state = SCE_HJ_SINGLESTRING; } else if ((ch == '-') && (chNext == '-') && (chNext2 == '>')) { styler.ColourTo(i - 1, StateToPrint); state = SCE_HJ_COMMENTLINE; i += 2; } else if (IsOperator(ch)) { styler.ColourTo(i, statePrintForState(SCE_HJ_SYMBOLS, inScriptType)); state = SCE_HJ_DEFAULT; } } break; case SCE_HJ_COMMENT: case SCE_HJ_COMMENTDOC: if (ch == '/' && chPrev == '*') { styler.ColourTo(i, StateToPrint); state = SCE_HJ_DEFAULT; ch = ' '; } break; case SCE_HJ_COMMENTLINE: if (ch == '\r' || ch == '\n') { styler.ColourTo(i - 1, statePrintForState(SCE_HJ_COMMENTLINE, inScriptType)); state = SCE_HJ_DEFAULT; ch = ' '; } break; case SCE_HJ_DOUBLESTRING: if (ch == '\\') { if (chNext == '\"' || chNext == '\'' || chNext == '\\') { i++; } } else if (ch == '\"') { styler.ColourTo(i, statePrintForState(SCE_HJ_DOUBLESTRING, inScriptType)); state = SCE_HJ_DEFAULT; } else if (isLineEnd(ch)) { styler.ColourTo(i - 1, StateToPrint); if (chPrev != '\\' && (chPrev2 != '\\' || chPrev != '\r' || ch != '\n')) { state = SCE_HJ_STRINGEOL; } } break; case SCE_HJ_SINGLESTRING: if (ch == '\\') { if (chNext == '\"' || chNext == '\'' || chNext == '\\') { i++; } } else if (ch == '\'') { styler.ColourTo(i, statePrintForState(SCE_HJ_SINGLESTRING, inScriptType)); state = SCE_HJ_DEFAULT; } else if (isLineEnd(ch)) { styler.ColourTo(i - 1, StateToPrint); if (chPrev != '\\' && (chPrev2 != '\\' || chPrev != '\r' || ch != '\n')) { state = SCE_HJ_STRINGEOL; } } break; case SCE_HJ_STRINGEOL: if (!isLineEnd(ch)) { styler.ColourTo(i - 1, StateToPrint); state = SCE_HJ_DEFAULT; } else if (!isLineEnd(chNext)) { styler.ColourTo(i, StateToPrint); state = SCE_HJ_DEFAULT; } break; case SCE_HJ_REGEX: if (ch == '\r' || ch == '\n' || ch == '/') { if (ch == '/') { while (IsLowerCase(chNext)) { // gobble regex flags i++; ch = chNext; chNext = SafeGetUnsignedCharAt(styler, i + 1); } } styler.ColourTo(i, StateToPrint); state = SCE_HJ_DEFAULT; } else if (ch == '\\') { // Gobble up the quoted character if (chNext == '\\' || chNext == '/') { i++; ch = chNext; chNext = SafeGetUnsignedCharAt(styler, i + 1); } } break; case SCE_HB_DEFAULT: case SCE_HB_START: if (IsAWordStart(ch)) { styler.ColourTo(i - 1, StateToPrint); state = SCE_HB_WORD; } else if (ch == '\'') { styler.ColourTo(i - 1, StateToPrint); state = SCE_HB_COMMENTLINE; } else if (ch == '\"') { styler.ColourTo(i - 1, StateToPrint); state = SCE_HB_STRING; } else if ((ch == '<') && (chNext == '!') && (chNext2 == '-') && styler.SafeGetCharAt(i + 3) == '-') { styler.ColourTo(i - 1, StateToPrint); state = SCE_HB_COMMENTLINE; } else if (IsOperator(ch)) { styler.ColourTo(i - 1, StateToPrint); styler.ColourTo(i, statePrintForState(SCE_HB_DEFAULT, inScriptType)); state = SCE_HB_DEFAULT; } else if ((ch == ' ') || (ch == '\t')) { if (state == SCE_HB_START) { styler.ColourTo(i - 1, StateToPrint); state = SCE_HB_DEFAULT; } } break; case SCE_HB_WORD: if (!IsAWordChar(ch)) { state = classifyWordHTVB(styler.GetStartSegment(), i - 1, keywords3, classifierBasic, styler, inScriptType); if (state == SCE_HB_DEFAULT) { if (ch == '\"') { state = SCE_HB_STRING; } else if (ch == '\'') { state = SCE_HB_COMMENTLINE; } else if (IsOperator(ch)) { styler.ColourTo(i, statePrintForState(SCE_HB_DEFAULT, inScriptType)); state = SCE_HB_DEFAULT; } } } break; case SCE_HB_STRING: if (ch == '\"') { styler.ColourTo(i, StateToPrint); state = SCE_HB_DEFAULT; } else if (ch == '\r' || ch == '\n') { styler.ColourTo(i - 1, StateToPrint); state = SCE_HB_STRINGEOL; } break; case SCE_HB_COMMENTLINE: if (ch == '\r' || ch == '\n') { styler.ColourTo(i - 1, StateToPrint); state = SCE_HB_DEFAULT; } break; case SCE_HB_STRINGEOL: if (!isLineEnd(ch)) { styler.ColourTo(i - 1, StateToPrint); state = SCE_HB_DEFAULT; } else if (!isLineEnd(chNext)) { styler.ColourTo(i, StateToPrint); state = SCE_HB_DEFAULT; } break; case SCE_HP_DEFAULT: case SCE_HP_START: if (IsAWordStart(ch)) { styler.ColourTo(i - 1, StateToPrint); state = SCE_HP_WORD; } else if ((ch == '<') && (chNext == '!') && (chNext2 == '-') && styler.SafeGetCharAt(i + 3) == '-') { styler.ColourTo(i - 1, StateToPrint); state = SCE_HP_COMMENTLINE; } else if (ch == '#') { styler.ColourTo(i - 1, StateToPrint); state = SCE_HP_COMMENTLINE; } else if (ch == '\"') { styler.ColourTo(i - 1, StateToPrint); if (chNext == '\"' && chNext2 == '\"') { i += 2; state = SCE_HP_TRIPLEDOUBLE; ch = ' '; chPrev = ' '; chNext = SafeGetUnsignedCharAt(styler, i + 1); } else { // state = statePrintForState(SCE_HP_STRING,inScriptType); state = SCE_HP_STRING; } } else if (ch == '\'') { styler.ColourTo(i - 1, StateToPrint); if (chNext == '\'' && chNext2 == '\'') { i += 2; state = SCE_HP_TRIPLE; ch = ' '; chPrev = ' '; chNext = SafeGetUnsignedCharAt(styler, i + 1); } else { state = SCE_HP_CHARACTER; } } else if (IsOperator(ch)) { styler.ColourTo(i - 1, StateToPrint); styler.ColourTo(i, statePrintForState(SCE_HP_OPERATOR, inScriptType)); } else if ((ch == ' ') || (ch == '\t')) { if (state == SCE_HP_START) { styler.ColourTo(i - 1, StateToPrint); state = SCE_HP_DEFAULT; } } break; case SCE_HP_WORD: if (!IsAWordChar(ch)) { classifyWordHTPy(styler.GetStartSegment(), i - 1, keywords4, classifierPython, styler, prevWord, inScriptType, isMako); state = SCE_HP_DEFAULT; if (ch == '#') { state = SCE_HP_COMMENTLINE; } else if (ch == '\"') { if (chNext == '\"' && chNext2 == '\"') { i += 2; state = SCE_HP_TRIPLEDOUBLE; ch = ' '; chPrev = ' '; chNext = SafeGetUnsignedCharAt(styler, i + 1); } else { state = SCE_HP_STRING; } } else if (ch == '\'') { if (chNext == '\'' && chNext2 == '\'') { i += 2; state = SCE_HP_TRIPLE; ch = ' '; chPrev = ' '; chNext = SafeGetUnsignedCharAt(styler, i + 1); } else { state = SCE_HP_CHARACTER; } } else if (IsOperator(ch)) { styler.ColourTo(i, statePrintForState(SCE_HP_OPERATOR, inScriptType)); } } break; case SCE_HP_COMMENTLINE: if (ch == '\r' || ch == '\n') { styler.ColourTo(i - 1, StateToPrint); state = SCE_HP_DEFAULT; } break; case SCE_HP_STRING: if (ch == '\\') { if (chNext == '\"' || chNext == '\'' || chNext == '\\') { i++; ch = chNext; chNext = SafeGetUnsignedCharAt(styler, i + 1); } } else if (ch == '\"') { styler.ColourTo(i, StateToPrint); state = SCE_HP_DEFAULT; } break; case SCE_HP_CHARACTER: if (ch == '\\') { if (chNext == '\"' || chNext == '\'' || chNext == '\\') { i++; ch = chNext; chNext = SafeGetUnsignedCharAt(styler, i + 1); } } else if (ch == '\'') { styler.ColourTo(i, StateToPrint); state = SCE_HP_DEFAULT; } break; case SCE_HP_TRIPLE: if (ch == '\'' && chPrev == '\'' && chPrev2 == '\'') { styler.ColourTo(i, StateToPrint); state = SCE_HP_DEFAULT; } break; case SCE_HP_TRIPLEDOUBLE: if (ch == '\"' && chPrev == '\"' && chPrev2 == '\"') { styler.ColourTo(i, StateToPrint); state = SCE_HP_DEFAULT; } break; ///////////// start - PHP state handling case SCE_HPHP_WORD: if (!IsPhpWordChar(ch)) { classifyWordHTPHP(styler.GetStartSegment(), i - 1, keywords5, classifierPHP, styler); if (ch == '/' && chNext == '*') { i++; state = SCE_HPHP_COMMENT; } else if (ch == '/' && chNext == '/') { i++; state = SCE_HPHP_COMMENTLINE; } else if (ch == '#' && chNext != '[') { state = SCE_HPHP_COMMENTLINE; } else if (ch == '\"') { state = SCE_HPHP_HSTRING; phpStringDelimiter = "\""; } else if (styler.Match(i, "<<<")) { bool isSimpleString = false; i = FindPhpStringDelimiter(phpStringDelimiter, i + 3, lengthDoc, styler, isSimpleString); if (!phpStringDelimiter.empty()) { state = (isSimpleString ? SCE_HPHP_SIMPLESTRING : SCE_HPHP_HSTRING); if (foldHeredoc) levelCurrent++; } } else if (ch == '\'') { state = SCE_HPHP_SIMPLESTRING; phpStringDelimiter = "\'"; } else if (ch == '$' && IsPhpWordStart(chNext)) { state = SCE_HPHP_VARIABLE; } else if (IsOperator(ch)) { state = SCE_HPHP_OPERATOR; } else { state = SCE_HPHP_DEFAULT; } } break; case SCE_HPHP_NUMBER: if (phpNumber.check(chNext, chNext2)) { styler.ColourTo(i, phpNumber.isInvalid() ? SCE_HPHP_DEFAULT : SCE_HPHP_NUMBER); state = SCE_HPHP_DEFAULT; } break; case SCE_HPHP_VARIABLE: if (!IsPhpWordChar(chNext)) { styler.ColourTo(i, SCE_HPHP_VARIABLE); state = SCE_HPHP_DEFAULT; } break; case SCE_HPHP_COMMENT: if (ch == '/' && chPrev == '*') { styler.ColourTo(i, StateToPrint); state = SCE_HPHP_DEFAULT; } break; case SCE_HPHP_COMMENTLINE: if (ch == '\r' || ch == '\n') { styler.ColourTo(i - 1, StateToPrint); state = SCE_HPHP_DEFAULT; } break; case SCE_HPHP_HSTRING: if (ch == '\\' && ((phpStringDelimiter == "\"") || chNext == '$' || chNext == '{')) { // skip the next char i++; } else if (((ch == '{' && chNext == '$') || (ch == '$' && chNext == '{')) && IsPhpWordStart(chNext2)) { styler.ColourTo(i - 1, StateToPrint); state = SCE_HPHP_COMPLEX_VARIABLE; } else if (ch == '$' && IsPhpWordStart(chNext)) { styler.ColourTo(i - 1, StateToPrint); state = SCE_HPHP_HSTRING_VARIABLE; } else if (styler.Match(i, phpStringDelimiter.c_str())) { if (phpStringDelimiter == "\"") { styler.ColourTo(i, StateToPrint); state = SCE_HPHP_DEFAULT; } else if (lineStartVisibleChars == 1) { const int psdLength = static_cast(phpStringDelimiter.length()); if (!IsPhpWordChar(styler.SafeGetCharAt(i + psdLength))) { i += (((i + psdLength) < lengthDoc) ? psdLength : lengthDoc) - 1; styler.ColourTo(i, StateToPrint); state = SCE_HPHP_DEFAULT; if (foldHeredoc) levelCurrent--; } } } break; case SCE_HPHP_SIMPLESTRING: if (phpStringDelimiter == "\'") { if (ch == '\\') { // skip the next char i++; } else if (ch == '\'') { styler.ColourTo(i, StateToPrint); state = SCE_HPHP_DEFAULT; } } else if (lineStartVisibleChars == 1 && styler.Match(i, phpStringDelimiter.c_str())) { const int psdLength = static_cast(phpStringDelimiter.length()); if (!IsPhpWordChar(styler.SafeGetCharAt(i + psdLength))) { i += (((i + psdLength) < lengthDoc) ? psdLength : lengthDoc) - 1; styler.ColourTo(i, StateToPrint); state = SCE_HPHP_DEFAULT; if (foldHeredoc) levelCurrent--; } } break; case SCE_HPHP_HSTRING_VARIABLE: if (!IsPhpWordChar(chNext)) { styler.ColourTo(i, StateToPrint); state = SCE_HPHP_HSTRING; } break; case SCE_HPHP_COMPLEX_VARIABLE: if (ch == '}') { styler.ColourTo(i, StateToPrint); state = SCE_HPHP_HSTRING; } break; case SCE_HPHP_OPERATOR: case SCE_HPHP_DEFAULT: styler.ColourTo(i - 1, StateToPrint); if (phpNumber.init(ch, chNext, chNext2)) { if (phpNumber.isFinished()) { styler.ColourTo(i, phpNumber.isInvalid() ? SCE_HPHP_DEFAULT : SCE_HPHP_NUMBER); state = SCE_HPHP_DEFAULT; } else { state = SCE_HPHP_NUMBER; } } else if (IsAWordStart(ch)) { state = SCE_HPHP_WORD; } else if (ch == '/' && chNext == '*') { i++; state = SCE_HPHP_COMMENT; } else if (ch == '/' && chNext == '/') { i++; state = SCE_HPHP_COMMENTLINE; } else if (ch == '#' && chNext != '[') { state = SCE_HPHP_COMMENTLINE; } else if (ch == '\"') { state = SCE_HPHP_HSTRING; phpStringDelimiter = "\""; } else if (styler.Match(i, "<<<")) { bool isSimpleString = false; i = FindPhpStringDelimiter(phpStringDelimiter, i + 3, lengthDoc, styler, isSimpleString); if (!phpStringDelimiter.empty()) { state = (isSimpleString ? SCE_HPHP_SIMPLESTRING : SCE_HPHP_HSTRING); if (foldHeredoc) levelCurrent++; } } else if (ch == '\'') { state = SCE_HPHP_SIMPLESTRING; phpStringDelimiter = "\'"; } else if (ch == '$' && IsPhpWordStart(chNext)) { state = SCE_HPHP_VARIABLE; } else if (IsOperator(ch)) { state = SCE_HPHP_OPERATOR; } else if ((state == SCE_HPHP_OPERATOR) && (IsASpace(ch))) { state = SCE_HPHP_DEFAULT; } break; ///////////// end - PHP state handling } // Some of the above terminated their lexeme but since the same character starts // the same class again, only reenter if non empty segment. const bool nonEmptySegment = i >= static_cast(styler.GetStartSegment()); if (state == SCE_HB_DEFAULT) { // One of the above succeeded if ((ch == '\"') && (nonEmptySegment)) { state = SCE_HB_STRING; } else if (ch == '\'') { state = SCE_HB_COMMENTLINE; } else if (IsAWordStart(ch)) { state = SCE_HB_WORD; } else if (IsOperator(ch)) { styler.ColourTo(i, SCE_HB_DEFAULT); } } else if (state == SCE_HBA_DEFAULT) { // One of the above succeeded if ((ch == '\"') && (nonEmptySegment)) { state = SCE_HBA_STRING; } else if (ch == '\'') { state = SCE_HBA_COMMENTLINE; } else if (IsAWordStart(ch)) { state = SCE_HBA_WORD; } else if (IsOperator(ch)) { styler.ColourTo(i, SCE_HBA_DEFAULT); } } else if (state == SCE_HJ_DEFAULT) { // One of the above succeeded if (ch == '/' && chNext == '*') { if (styler.SafeGetCharAt(i + 2) == '*') state = SCE_HJ_COMMENTDOC; else state = SCE_HJ_COMMENT; } else if (ch == '/' && chNext == '/') { state = SCE_HJ_COMMENTLINE; } else if ((ch == '\"') && (nonEmptySegment)) { state = SCE_HJ_DOUBLESTRING; } else if ((ch == '\'') && (nonEmptySegment)) { state = SCE_HJ_SINGLESTRING; } else if (IsAWordStart(ch)) { state = SCE_HJ_WORD; } else if (IsOperator(ch)) { styler.ColourTo(i, statePrintForState(SCE_HJ_SYMBOLS, inScriptType)); } } } switch (state) { case SCE_HJ_WORD: classifyWordHTJS(styler.GetStartSegment(), lengthDoc - 1, keywords2, classifierJavaScript, classifierJavaScriptServer, styler, inScriptType); break; case SCE_HB_WORD: classifyWordHTVB(styler.GetStartSegment(), lengthDoc - 1, keywords3, classifierBasic, styler, inScriptType); break; case SCE_HP_WORD: classifyWordHTPy(styler.GetStartSegment(), lengthDoc - 1, keywords4, classifierPython, styler, prevWord, inScriptType, isMako); break; case SCE_HPHP_WORD: classifyWordHTPHP(styler.GetStartSegment(), lengthDoc - 1, keywords5, classifierPHP, styler); break; default: StateToPrint = statePrintForState(state, inScriptType); if (static_cast(styler.GetStartSegment()) < lengthDoc) styler.ColourTo(lengthDoc - 1, StateToPrint); break; } // Fill in the real level of the next line, keeping the current flags as they will be filled in later if (fold) { const int flagsNext = styler.LevelAt(lineCurrent) & ~SC_FOLDLEVELNUMBERMASK; styler.SetLevel(lineCurrent, levelPrev | flagsNext); } styler.Flush(); } LexerModule lmHTML(SCLEX_HTML, LexerHTML::LexerFactoryHTML, "hypertext", htmlWordListDesc); LexerModule lmXML(SCLEX_XML, LexerHTML::LexerFactoryXML, "xml", htmlWordListDesc); LexerModule lmPHPSCRIPT(SCLEX_PHPSCRIPT, LexerHTML::LexerFactoryPHPScript, "phpscript", phpscriptWordListDesc); lexilla/lexers/LexPascal.cxx0000664000175000017500000005066514647367374015115 0ustar neilneil// Scintilla source code edit control /** @file LexPascal.cxx ** Lexer for Pascal. ** Written by Laurent le Tynevez ** Updated by Simon Steele September 2002 ** Updated by Mathias Rauen May 2003 (Delphi adjustments) ** Completely rewritten by Marko Njezic October 2008 **/ /* A few words about features of the new completely rewritten LexPascal... Generally speaking LexPascal tries to support all available Delphi features (up to Delphi XE4 at this time). ~ HIGHLIGHTING: If you enable "lexer.pascal.smart.highlighting" property, some keywords will only be highlighted in appropriate context. As implemented those are keywords related to property and DLL exports declarations (similar to how Delphi IDE works). For example, keywords "read" and "write" will only be highlighted if they are in property declaration: property MyProperty: boolean read FMyProperty write FMyProperty; ~ FOLDING: Folding is supported in the following cases: - Folding of stream-like comments - Folding of groups of consecutive line comments - Folding of preprocessor blocks (the following preprocessor blocks are supported: IF / IFEND; IFDEF, IFNDEF, IFOPT / ENDIF and REGION / ENDREGION blocks), including nesting of preprocessor blocks up to 255 levels - Folding of code blocks on appropriate keywords (the following code blocks are supported: "begin, asm, record, try, case / end" blocks, class & object declarations and interface declarations) Remarks: - Folding of code blocks tries to handle all special cases in which folding should not occur. As implemented those are: 1. Structure "record case / end" (there's only one "end" statement and "case" is ignored as fold point) 2. Forward class declarations ("type TMyClass = class;") and object method declarations ("TNotifyEvent = procedure(Sender: TObject) of object;") are ignored as fold points 3. Simplified complete class declarations ("type TMyClass = class(TObject);") are ignored as fold points 4. Every other situation when class keyword doesn't actually start class declaration ("class procedure", "class function", "class of", "class var", "class property" and "class operator") 5. Forward (disp)interface declarations ("type IMyInterface = interface;") are ignored as fold points - Folding of code blocks inside preprocessor blocks is disabled (any comments inside them will be folded fine) because there is no guarantee that complete code block will be contained inside folded preprocessor block in which case folded code block could end prematurely at the end of preprocessor block if there is no closing statement inside. This was done in order to properly process document that may contain something like this: type {$IFDEF UNICODE} TMyClass = class(UnicodeAncestor) {$ELSE} TMyClass = class(AnsiAncestor) {$ENDIF} private ... public ... published ... end; If class declarations were folded, then the second class declaration would end at "$ENDIF" statement, first class statement would end at "end;" statement and preprocessor "$IFDEF" block would go all the way to the end of document. However, having in mind all this, if you want to enable folding of code blocks inside preprocessor blocks, you can disable folding of preprocessor blocks by changing "fold.preprocessor" property, in which case everything inside them would be folded. ~ KEYWORDS: The list of keywords that can be used in pascal.properties file (up to Delphi XE4): - Keywords: absolute abstract and array as asm assembler automated begin case cdecl class const constructor delayed deprecated destructor dispid dispinterface div do downto dynamic else end except experimental export exports external far file final finalization finally for forward function goto helper if implementation in inherited initialization inline interface is label library message mod near nil not object of on operator or out overload override packed pascal platform private procedure program property protected public published raise record reference register reintroduce repeat resourcestring safecall sealed set shl shr static stdcall strict string then threadvar to try type unit unsafe until uses var varargs virtual while winapi with xor - Keywords related to the "smart highlithing" feature: add default implements index name nodefault read readonly remove stored write writeonly - Keywords related to Delphi packages (in addition to all above): package contains requires */ #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static void GetRangeLowered(Sci_PositionU start, Sci_PositionU end, Accessor &styler, char *s, Sci_PositionU len) { Sci_PositionU i = 0; while ((i < end - start + 1) && (i < len-1)) { s[i] = static_cast(tolower(styler[start + i])); i++; } s[i] = '\0'; } static void GetForwardRangeLowered(Sci_PositionU start, CharacterSet &charSet, Accessor &styler, char *s, Sci_PositionU len) { Sci_PositionU i = 0; while ((i < len-1) && charSet.Contains(styler.SafeGetCharAt(start + i))) { s[i] = static_cast(tolower(styler.SafeGetCharAt(start + i))); i++; } s[i] = '\0'; } enum { stateInAsm = 0x1000, stateInProperty = 0x2000, stateInExport = 0x4000, stateFoldInPreprocessor = 0x0100, stateFoldInRecord = 0x0200, stateFoldInPreprocessorLevelMask = 0x00FF, stateFoldMaskAll = 0x0FFF }; static void ClassifyPascalWord(WordList *keywordlists[], StyleContext &sc, int &curLineState, bool bSmartHighlighting) { WordList& keywords = *keywordlists[0]; char s[100]; sc.GetCurrentLowered(s, sizeof(s)); if (keywords.InList(s)) { if (curLineState & stateInAsm) { if (strcmp(s, "end") == 0 && sc.GetRelative(-4) != '@') { curLineState &= ~stateInAsm; sc.ChangeState(SCE_PAS_WORD); } else { sc.ChangeState(SCE_PAS_ASM); } } else { bool ignoreKeyword = false; if (strcmp(s, "asm") == 0) { curLineState |= stateInAsm; } else if (bSmartHighlighting) { if (strcmp(s, "property") == 0) { curLineState |= stateInProperty; } else if (strcmp(s, "exports") == 0) { curLineState |= stateInExport; } else if (!(curLineState & (stateInProperty | stateInExport)) && strcmp(s, "index") == 0) { ignoreKeyword = true; } else if (!(curLineState & stateInExport) && strcmp(s, "name") == 0) { ignoreKeyword = true; } else if (!(curLineState & stateInProperty) && (strcmp(s, "read") == 0 || strcmp(s, "write") == 0 || strcmp(s, "default") == 0 || strcmp(s, "nodefault") == 0 || strcmp(s, "stored") == 0 || strcmp(s, "implements") == 0 || strcmp(s, "readonly") == 0 || strcmp(s, "writeonly") == 0 || strcmp(s, "add") == 0 || strcmp(s, "remove") == 0)) { ignoreKeyword = true; } } if (!ignoreKeyword) { sc.ChangeState(SCE_PAS_WORD); } } } else if (curLineState & stateInAsm) { sc.ChangeState(SCE_PAS_ASM); } sc.SetState(SCE_PAS_DEFAULT); } static void ColourisePascalDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { bool bSmartHighlighting = styler.GetPropertyInt("lexer.pascal.smart.highlighting", 1) != 0; CharacterSet setWordStart(CharacterSet::setAlpha, "_", 0x80, true); CharacterSet setWord(CharacterSet::setAlphaNum, "_", 0x80, true); CharacterSet setNumber(CharacterSet::setDigits, ".-+eE"); CharacterSet setHexNumber(CharacterSet::setDigits, "abcdefABCDEF"); CharacterSet setOperator(CharacterSet::setNone, "#$&'()*+,-./:;<=>@[]^{}"); Sci_Position curLine = styler.GetLine(startPos); int curLineState = curLine > 0 ? styler.GetLineState(curLine - 1) : 0; StyleContext sc(startPos, length, initStyle, styler); for (; sc.More(); sc.Forward()) { if (sc.atLineEnd) { // Update the line state, so it can be seen by next line curLine = styler.GetLine(sc.currentPos); styler.SetLineState(curLine, curLineState); } // Determine if the current state should terminate. switch (sc.state) { case SCE_PAS_NUMBER: if (!setNumber.Contains(sc.ch) || (sc.ch == '.' && sc.chNext == '.')) { sc.SetState(SCE_PAS_DEFAULT); } else if (sc.ch == '-' || sc.ch == '+') { if (sc.chPrev != 'E' && sc.chPrev != 'e') { sc.SetState(SCE_PAS_DEFAULT); } } break; case SCE_PAS_IDENTIFIER: if (!setWord.Contains(sc.ch)) { ClassifyPascalWord(keywordlists, sc, curLineState, bSmartHighlighting); } break; case SCE_PAS_HEXNUMBER: if (!setHexNumber.Contains(sc.ch)) { sc.SetState(SCE_PAS_DEFAULT); } break; case SCE_PAS_COMMENT: case SCE_PAS_PREPROCESSOR: if (sc.ch == '}') { sc.ForwardSetState(SCE_PAS_DEFAULT); } break; case SCE_PAS_COMMENT2: case SCE_PAS_PREPROCESSOR2: if (sc.Match('*', ')')) { sc.Forward(); sc.ForwardSetState(SCE_PAS_DEFAULT); } break; case SCE_PAS_COMMENTLINE: if (sc.atLineStart) { sc.SetState(SCE_PAS_DEFAULT); } break; case SCE_PAS_STRING: if (sc.atLineEnd) { sc.ChangeState(SCE_PAS_STRINGEOL); } else if (sc.ch == '\'' && sc.chNext == '\'') { sc.Forward(); } else if (sc.ch == '\'') { sc.ForwardSetState(SCE_PAS_DEFAULT); } break; case SCE_PAS_STRINGEOL: if (sc.atLineStart) { sc.SetState(SCE_PAS_DEFAULT); } break; case SCE_PAS_CHARACTER: if (!setHexNumber.Contains(sc.ch) && sc.ch != '$') { sc.SetState(SCE_PAS_DEFAULT); } break; case SCE_PAS_OPERATOR: if (bSmartHighlighting && sc.chPrev == ';') { curLineState &= ~(stateInProperty | stateInExport); } sc.SetState(SCE_PAS_DEFAULT); break; case SCE_PAS_ASM: sc.SetState(SCE_PAS_DEFAULT); break; } // Determine if a new state should be entered. if (sc.state == SCE_PAS_DEFAULT) { if (IsADigit(sc.ch) && !(curLineState & stateInAsm)) { sc.SetState(SCE_PAS_NUMBER); } else if (setWordStart.Contains(sc.ch)) { sc.SetState(SCE_PAS_IDENTIFIER); } else if (sc.ch == '$' && !(curLineState & stateInAsm)) { sc.SetState(SCE_PAS_HEXNUMBER); } else if (sc.Match('{', '$')) { sc.SetState(SCE_PAS_PREPROCESSOR); } else if (sc.ch == '{') { sc.SetState(SCE_PAS_COMMENT); } else if (sc.Match("(*$")) { sc.SetState(SCE_PAS_PREPROCESSOR2); } else if (sc.Match('(', '*')) { sc.SetState(SCE_PAS_COMMENT2); sc.Forward(); // Eat the * so it isn't used for the end of the comment } else if (sc.Match('/', '/')) { sc.SetState(SCE_PAS_COMMENTLINE); } else if (sc.ch == '\'') { sc.SetState(SCE_PAS_STRING); } else if (sc.ch == '#') { sc.SetState(SCE_PAS_CHARACTER); } else if (setOperator.Contains(sc.ch) && !(curLineState & stateInAsm)) { sc.SetState(SCE_PAS_OPERATOR); } else if (curLineState & stateInAsm) { sc.SetState(SCE_PAS_ASM); } } } if (sc.state == SCE_PAS_IDENTIFIER && setWord.Contains(sc.chPrev)) { ClassifyPascalWord(keywordlists, sc, curLineState, bSmartHighlighting); } sc.Complete(); } static bool IsStreamCommentStyle(int style) { return style == SCE_PAS_COMMENT || style == SCE_PAS_COMMENT2; } static bool IsCommentLine(Sci_Position line, Accessor &styler) { Sci_Position pos = styler.LineStart(line); Sci_Position eolPos = styler.LineStart(line + 1) - 1; for (Sci_Position i = pos; i < eolPos; i++) { char ch = styler[i]; char chNext = styler.SafeGetCharAt(i + 1); int style = styler.StyleAt(i); if (ch == '/' && chNext == '/' && style == SCE_PAS_COMMENTLINE) { return true; } else if (!IsASpaceOrTab(ch)) { return false; } } return false; } static unsigned int GetFoldInPreprocessorLevelFlag(int lineFoldStateCurrent) { return lineFoldStateCurrent & stateFoldInPreprocessorLevelMask; } static void SetFoldInPreprocessorLevelFlag(int &lineFoldStateCurrent, unsigned int nestLevel) { lineFoldStateCurrent &= ~stateFoldInPreprocessorLevelMask; lineFoldStateCurrent |= nestLevel & stateFoldInPreprocessorLevelMask; } static void ClassifyPascalPreprocessorFoldPoint(int &levelCurrent, int &lineFoldStateCurrent, Sci_PositionU startPos, Accessor &styler) { CharacterSet setWord(CharacterSet::setAlpha); char s[11]; // Size of the longest possible keyword + one additional character + null GetForwardRangeLowered(startPos, setWord, styler, s, sizeof(s)); unsigned int nestLevel = GetFoldInPreprocessorLevelFlag(lineFoldStateCurrent); if (strcmp(s, "if") == 0 || strcmp(s, "ifdef") == 0 || strcmp(s, "ifndef") == 0 || strcmp(s, "ifopt") == 0 || strcmp(s, "region") == 0) { nestLevel++; SetFoldInPreprocessorLevelFlag(lineFoldStateCurrent, nestLevel); lineFoldStateCurrent |= stateFoldInPreprocessor; levelCurrent++; } else if (strcmp(s, "endif") == 0 || strcmp(s, "ifend") == 0 || strcmp(s, "endregion") == 0) { nestLevel--; SetFoldInPreprocessorLevelFlag(lineFoldStateCurrent, nestLevel); if (nestLevel == 0) { lineFoldStateCurrent &= ~stateFoldInPreprocessor; } levelCurrent--; if (levelCurrent < SC_FOLDLEVELBASE) { levelCurrent = SC_FOLDLEVELBASE; } } } static Sci_PositionU SkipWhiteSpace(Sci_PositionU currentPos, Sci_PositionU endPos, Accessor &styler, bool includeChars = false) { CharacterSet setWord(CharacterSet::setAlphaNum, "_"); Sci_PositionU j = currentPos + 1; char ch = styler.SafeGetCharAt(j); while ((j < endPos) && (IsASpaceOrTab(ch) || ch == '\r' || ch == '\n' || IsStreamCommentStyle(styler.StyleAt(j)) || (includeChars && setWord.Contains(ch)))) { j++; ch = styler.SafeGetCharAt(j); } return j; } static void ClassifyPascalWordFoldPoint(int &levelCurrent, int &lineFoldStateCurrent, Sci_Position startPos, Sci_PositionU endPos, Sci_PositionU lastStart, Sci_PositionU currentPos, Accessor &styler) { char s[100]; GetRangeLowered(lastStart, currentPos, styler, s, sizeof(s)); if (strcmp(s, "record") == 0) { lineFoldStateCurrent |= stateFoldInRecord; levelCurrent++; } else if (strcmp(s, "begin") == 0 || strcmp(s, "asm") == 0 || strcmp(s, "try") == 0 || (strcmp(s, "case") == 0 && !(lineFoldStateCurrent & stateFoldInRecord))) { levelCurrent++; } else if (strcmp(s, "class") == 0 || strcmp(s, "object") == 0) { // "class" & "object" keywords require special handling... bool ignoreKeyword = false; Sci_PositionU j = SkipWhiteSpace(currentPos, endPos, styler); if (j < endPos) { CharacterSet setWordStart(CharacterSet::setAlpha, "_"); CharacterSet setWord(CharacterSet::setAlphaNum, "_"); if (styler.SafeGetCharAt(j) == ';') { // Handle forward class declarations ("type TMyClass = class;") // and object method declarations ("TNotifyEvent = procedure(Sender: TObject) of object;") ignoreKeyword = true; } else if (strcmp(s, "class") == 0) { // "class" keyword has a few more special cases... if (styler.SafeGetCharAt(j) == '(') { // Handle simplified complete class declarations ("type TMyClass = class(TObject);") j = SkipWhiteSpace(j, endPos, styler, true); if (j < endPos && styler.SafeGetCharAt(j) == ')') { j = SkipWhiteSpace(j, endPos, styler); if (j < endPos && styler.SafeGetCharAt(j) == ';') { ignoreKeyword = true; } } } else if (setWordStart.Contains(styler.SafeGetCharAt(j))) { char s2[11]; // Size of the longest possible keyword + one additional character + null GetForwardRangeLowered(j, setWord, styler, s2, sizeof(s2)); if (strcmp(s2, "procedure") == 0 || strcmp(s2, "function") == 0 || strcmp(s2, "of") == 0 || strcmp(s2, "var") == 0 || strcmp(s2, "property") == 0 || strcmp(s2, "operator") == 0) { ignoreKeyword = true; } } } } if (!ignoreKeyword) { levelCurrent++; } } else if (strcmp(s, "interface") == 0) { // "interface" keyword requires special handling... bool ignoreKeyword = true; Sci_Position j = lastStart - 1; char ch = styler.SafeGetCharAt(j); while ((j >= startPos) && (IsASpaceOrTab(ch) || ch == '\r' || ch == '\n' || IsStreamCommentStyle(styler.StyleAt(j)))) { j--; ch = styler.SafeGetCharAt(j); } if (j >= startPos && styler.SafeGetCharAt(j) == '=') { ignoreKeyword = false; } if (!ignoreKeyword) { Sci_PositionU k = SkipWhiteSpace(currentPos, endPos, styler); if (k < endPos && styler.SafeGetCharAt(k) == ';') { // Handle forward interface declarations ("type IMyInterface = interface;") ignoreKeyword = true; } } if (!ignoreKeyword) { levelCurrent++; } } else if (strcmp(s, "dispinterface") == 0) { // "dispinterface" keyword requires special handling... bool ignoreKeyword = false; Sci_PositionU j = SkipWhiteSpace(currentPos, endPos, styler); if (j < endPos && styler.SafeGetCharAt(j) == ';') { // Handle forward dispinterface declarations ("type IMyInterface = dispinterface;") ignoreKeyword = true; } if (!ignoreKeyword) { levelCurrent++; } } else if (strcmp(s, "end") == 0) { lineFoldStateCurrent &= ~stateFoldInRecord; levelCurrent--; if (levelCurrent < SC_FOLDLEVELBASE) { levelCurrent = SC_FOLDLEVELBASE; } } } static void FoldPascalDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *[], Accessor &styler) { bool foldComment = styler.GetPropertyInt("fold.comment") != 0; bool foldPreprocessor = styler.GetPropertyInt("fold.preprocessor") != 0; bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelPrev = styler.LevelAt(lineCurrent) & SC_FOLDLEVELNUMBERMASK; int levelCurrent = levelPrev; int lineFoldStateCurrent = lineCurrent > 0 ? styler.GetLineState(lineCurrent - 1) & stateFoldMaskAll : 0; char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); int style = initStyle; Sci_Position lastStart = 0; CharacterSet setWord(CharacterSet::setAlphaNum, "_", 0x80, true); for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); int stylePrev = style; style = styleNext; styleNext = styler.StyleAt(i + 1); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (foldComment && IsStreamCommentStyle(style)) { if (!IsStreamCommentStyle(stylePrev)) { levelCurrent++; } else if (!IsStreamCommentStyle(styleNext) && !atEOL) { // Comments don't end at end of line and the next character may be unstyled. levelCurrent--; } } if (foldComment && atEOL && IsCommentLine(lineCurrent, styler)) { if (!IsCommentLine(lineCurrent - 1, styler) && IsCommentLine(lineCurrent + 1, styler)) levelCurrent++; else if (IsCommentLine(lineCurrent - 1, styler) && !IsCommentLine(lineCurrent+1, styler)) levelCurrent--; } if (foldPreprocessor) { if (style == SCE_PAS_PREPROCESSOR && ch == '{' && chNext == '$') { ClassifyPascalPreprocessorFoldPoint(levelCurrent, lineFoldStateCurrent, i + 2, styler); } else if (style == SCE_PAS_PREPROCESSOR2 && ch == '(' && chNext == '*' && styler.SafeGetCharAt(i + 2) == '$') { ClassifyPascalPreprocessorFoldPoint(levelCurrent, lineFoldStateCurrent, i + 3, styler); } } if (stylePrev != SCE_PAS_WORD && style == SCE_PAS_WORD) { // Store last word start point. lastStart = i; } if (stylePrev == SCE_PAS_WORD && !(lineFoldStateCurrent & stateFoldInPreprocessor)) { if(setWord.Contains(ch) && !setWord.Contains(chNext)) { ClassifyPascalWordFoldPoint(levelCurrent, lineFoldStateCurrent, startPos, endPos, lastStart, i, styler); } } if (!IsASpace(ch)) visibleChars++; if (atEOL) { int lev = levelPrev; if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if ((levelCurrent > levelPrev) && (visibleChars > 0)) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } int newLineState = (styler.GetLineState(lineCurrent) & ~stateFoldMaskAll) | lineFoldStateCurrent; styler.SetLineState(lineCurrent, newLineState); lineCurrent++; levelPrev = levelCurrent; visibleChars = 0; } } // If we didn't reach the EOL in previous loop, store line level and whitespace information. // The rest will be filled in later... int lev = levelPrev; if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; styler.SetLevel(lineCurrent, lev); } static const char * const pascalWordListDesc[] = { "Keywords", 0 }; LexerModule lmPascal(SCLEX_PASCAL, ColourisePascalDoc, "pascal", FoldPascalDoc, pascalWordListDesc); lexilla/lexers/LexAbaqus.cxx0000664000175000017500000004637214647367374015126 0ustar neilneil// Scintilla source code edit control /** @file LexAbaqus.cxx ** Lexer for ABAQUS. Based on the lexer for APDL by Hadar Raz. ** By Sergio Lucato. ** Sort of completely rewritten by Gertjan Kloosterman **/ // The License.txt file describes the conditions under which this software may be distributed. // Code folding copyied and modified from LexBasic.cxx #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static inline bool IsAKeywordChar(const int ch) { return (ch < 0x80 && (isalnum(ch) || (ch == '_') || (ch == ' '))); } static inline bool IsASetChar(const int ch) { return (ch < 0x80 && (isalnum(ch) || (ch == '_') || (ch == '.') || (ch == '-'))); } static void ColouriseABAQUSDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList*[] /* *keywordlists[] */, Accessor &styler) { enum localState { KW_LINE_KW, KW_LINE_COMMA, KW_LINE_PAR, KW_LINE_EQ, KW_LINE_VAL, \ DAT_LINE_VAL, DAT_LINE_COMMA,\ COMMENT_LINE,\ ST_ERROR, LINE_END } state ; // Do not leak onto next line state = LINE_END ; initStyle = SCE_ABAQUS_DEFAULT; StyleContext sc(startPos, length, initStyle, styler); // Things are actually quite simple // we have commentlines // keywordlines and datalines // On a data line there will only be colouring of numbers // a keyword line is constructed as // *word,[ paramname[=paramvalue]]* // if the line ends with a , the keyword line continues onto the new line for (; sc.More(); sc.Forward()) { switch ( state ) { case KW_LINE_KW : if ( sc.atLineEnd ) { // finished the line in keyword state, switch to LINE_END sc.SetState(SCE_ABAQUS_DEFAULT) ; state = LINE_END ; } else if ( IsAKeywordChar(sc.ch) ) { // nothing changes state = KW_LINE_KW ; } else if ( sc.ch == ',' ) { // Well well we say a comma, arguments *MUST* follow sc.SetState(SCE_ABAQUS_OPERATOR) ; state = KW_LINE_COMMA ; } else { // Flag an error sc.SetState(SCE_ABAQUS_PROCESSOR) ; state = ST_ERROR ; } // Done with processing break ; case KW_LINE_COMMA : // acomma on a keywordline was seen if ( IsAKeywordChar(sc.ch)) { sc.SetState(SCE_ABAQUS_ARGUMENT) ; state = KW_LINE_PAR ; } else if ( sc.atLineEnd || (sc.ch == ',') ) { // we remain in keyword mode state = KW_LINE_COMMA ; } else if ( sc.ch == ' ' ) { sc.SetState(SCE_ABAQUS_DEFAULT) ; state = KW_LINE_COMMA ; } else { // Anything else constitutes an error sc.SetState(SCE_ABAQUS_PROCESSOR) ; state = ST_ERROR ; } break ; case KW_LINE_PAR : if ( sc.atLineEnd ) { sc.SetState(SCE_ABAQUS_DEFAULT) ; state = LINE_END ; } else if ( IsAKeywordChar(sc.ch) || (sc.ch == '-') ) { // remain in this state state = KW_LINE_PAR ; } else if ( sc.ch == ',' ) { sc.SetState(SCE_ABAQUS_OPERATOR) ; state = KW_LINE_COMMA ; } else if ( sc.ch == '=' ) { sc.SetState(SCE_ABAQUS_OPERATOR) ; state = KW_LINE_EQ ; } else { // Anything else constitutes an error sc.SetState(SCE_ABAQUS_PROCESSOR) ; state = ST_ERROR ; } break ; case KW_LINE_EQ : if ( sc.ch == ' ' ) { sc.SetState(SCE_ABAQUS_DEFAULT) ; // remain in this state state = KW_LINE_EQ ; } else if ( IsADigit(sc.ch) || (sc.ch == '-') || (sc.ch == '.' && IsADigit(sc.chNext)) ) { sc.SetState(SCE_ABAQUS_NUMBER) ; state = KW_LINE_VAL ; } else if ( IsAKeywordChar(sc.ch) ) { sc.SetState(SCE_ABAQUS_DEFAULT) ; state = KW_LINE_VAL ; } else if ( (sc.ch == '\'') || (sc.ch == '\"') ) { sc.SetState(SCE_ABAQUS_STRING) ; state = KW_LINE_VAL ; } else { sc.SetState(SCE_ABAQUS_PROCESSOR) ; state = ST_ERROR ; } break ; case KW_LINE_VAL : if ( sc.atLineEnd ) { sc.SetState(SCE_ABAQUS_DEFAULT) ; state = LINE_END ; } else if ( IsASetChar(sc.ch) && (sc.state == SCE_ABAQUS_DEFAULT) ) { // nothing changes state = KW_LINE_VAL ; } else if (( (IsADigit(sc.ch) || sc.ch == '.' || (sc.ch == 'e' || sc.ch == 'E') || ((sc.ch == '+' || sc.ch == '-') && (sc.chPrev == 'e' || sc.chPrev == 'E')))) && (sc.state == SCE_ABAQUS_NUMBER)) { // remain in number mode state = KW_LINE_VAL ; } else if (sc.state == SCE_ABAQUS_STRING) { // accept everything until a closing quote if ( sc.ch == '\'' || sc.ch == '\"' ) { sc.SetState(SCE_ABAQUS_DEFAULT) ; state = KW_LINE_VAL ; } } else if ( sc.ch == ',' ) { sc.SetState(SCE_ABAQUS_OPERATOR) ; state = KW_LINE_COMMA ; } else { // anything else is an error sc.SetState(SCE_ABAQUS_PROCESSOR) ; state = ST_ERROR ; } break ; case DAT_LINE_VAL : if ( sc.atLineEnd ) { sc.SetState(SCE_ABAQUS_DEFAULT) ; state = LINE_END ; } else if ( IsASetChar(sc.ch) && (sc.state == SCE_ABAQUS_DEFAULT) ) { // nothing changes state = DAT_LINE_VAL ; } else if (( (IsADigit(sc.ch) || sc.ch == '.' || (sc.ch == 'e' || sc.ch == 'E') || ((sc.ch == '+' || sc.ch == '-') && (sc.chPrev == 'e' || sc.chPrev == 'E')))) && (sc.state == SCE_ABAQUS_NUMBER)) { // remain in number mode state = DAT_LINE_VAL ; } else if (sc.state == SCE_ABAQUS_STRING) { // accept everything until a closing quote if ( sc.ch == '\'' || sc.ch == '\"' ) { sc.SetState(SCE_ABAQUS_DEFAULT) ; state = DAT_LINE_VAL ; } } else if ( sc.ch == ',' ) { sc.SetState(SCE_ABAQUS_OPERATOR) ; state = DAT_LINE_COMMA ; } else { // anything else is an error sc.SetState(SCE_ABAQUS_PROCESSOR) ; state = ST_ERROR ; } break ; case DAT_LINE_COMMA : // a comma on a data line was seen if ( sc.atLineEnd ) { sc.SetState(SCE_ABAQUS_DEFAULT) ; state = LINE_END ; } else if ( sc.ch == ' ' ) { sc.SetState(SCE_ABAQUS_DEFAULT) ; state = DAT_LINE_COMMA ; } else if (sc.ch == ',') { sc.SetState(SCE_ABAQUS_OPERATOR) ; state = DAT_LINE_COMMA ; } else if ( IsADigit(sc.ch) || (sc.ch == '-')|| (sc.ch == '.' && IsADigit(sc.chNext)) ) { sc.SetState(SCE_ABAQUS_NUMBER) ; state = DAT_LINE_VAL ; } else if ( IsAKeywordChar(sc.ch) ) { sc.SetState(SCE_ABAQUS_DEFAULT) ; state = DAT_LINE_VAL ; } else if ( (sc.ch == '\'') || (sc.ch == '\"') ) { sc.SetState(SCE_ABAQUS_STRING) ; state = DAT_LINE_VAL ; } else { sc.SetState(SCE_ABAQUS_PROCESSOR) ; state = ST_ERROR ; } break ; case COMMENT_LINE : if ( sc.atLineEnd ) { sc.SetState(SCE_ABAQUS_DEFAULT) ; state = LINE_END ; } break ; case ST_ERROR : if ( sc.atLineEnd ) { sc.SetState(SCE_ABAQUS_DEFAULT) ; state = LINE_END ; } break ; case LINE_END : if ( sc.atLineEnd || sc.ch == ' ' ) { // nothing changes state = LINE_END ; } else if ( sc.ch == '*' ) { if ( sc.chNext == '*' ) { state = COMMENT_LINE ; sc.SetState(SCE_ABAQUS_COMMENT) ; } else { state = KW_LINE_KW ; sc.SetState(SCE_ABAQUS_STARCOMMAND) ; } } else { // it must be a data line, things are as if we are in DAT_LINE_COMMA if ( sc.ch == ',' ) { sc.SetState(SCE_ABAQUS_OPERATOR) ; state = DAT_LINE_COMMA ; } else if ( IsADigit(sc.ch) || (sc.ch == '-')|| (sc.ch == '.' && IsADigit(sc.chNext)) ) { sc.SetState(SCE_ABAQUS_NUMBER) ; state = DAT_LINE_VAL ; } else if ( IsAKeywordChar(sc.ch) ) { sc.SetState(SCE_ABAQUS_DEFAULT) ; state = DAT_LINE_VAL ; } else if ( (sc.ch == '\'') || (sc.ch == '\"') ) { sc.SetState(SCE_ABAQUS_STRING) ; state = DAT_LINE_VAL ; } else { sc.SetState(SCE_ABAQUS_PROCESSOR) ; state = ST_ERROR ; } } break ; } } sc.Complete(); } //------------------------------------------------------------------------------ // This copyied and modified from LexBasic.cxx //------------------------------------------------------------------------------ /* Bits: * 1 - whitespace * 2 - operator * 4 - identifier * 8 - decimal digit * 16 - hex digit * 32 - bin digit */ static int character_classification[128] = { 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 1, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 2, 0, 2, 2, 2, 2, 2, 2, 2, 6, 2, 2, 2, 10, 6, 60, 60, 28, 28, 28, 28, 28, 28, 28, 28, 2, 2, 2, 2, 2, 2, 2, 20, 20, 20, 20, 20, 20, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 2, 2, 2, 2, 4, 2, 20, 20, 20, 20, 20, 20, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 2, 2, 2, 2, 0 }; static bool IsSpace(int c) { return c < 128 && (character_classification[c] & 1); } static bool IsIdentifier(int c) { return c < 128 && (character_classification[c] & 4); } static int LowerCase(int c) { if (c >= 'A' && c <= 'Z') return 'a' + c - 'A'; return c; } static Sci_Position LineEnd(Sci_Position line, Accessor &styler) { const Sci_Position docLines = styler.GetLine(styler.Length() - 1); // Available last line Sci_Position eol_pos ; // if the line is the last line, the eol_pos is styler.Length() // eol will contain a new line, or a virtual new line if ( docLines == line ) eol_pos = styler.Length() ; else eol_pos = styler.LineStart(line + 1) - 1; return eol_pos ; } static Sci_Position LineStart(Sci_Position line, Accessor &styler) { return styler.LineStart(line) ; } // LineType // // bits determines the line type // 1 : data line // 2 : only whitespace // 3 : data line with only whitespace // 4 : keyword line // 5 : block open keyword line // 6 : block close keyword line // 7 : keyword line in error // 8 : comment line static int LineType(Sci_Position line, Accessor &styler) { Sci_Position pos = LineStart(line, styler) ; Sci_Position eol_pos = LineEnd(line, styler) ; int c ; char ch = ' '; Sci_Position i = pos ; while ( i < eol_pos ) { c = styler.SafeGetCharAt(i); ch = static_cast(LowerCase(c)); // We can say something as soon as no whitespace // was encountered if ( !IsSpace(c) ) break ; i++ ; } if ( i >= eol_pos ) { // This is a whitespace line, currently // classifies as data line return 3 ; } if ( ch != '*' ) { // This is a data line return 1 ; } if ( i == eol_pos - 1 ) { // Only a single *, error but make keyword line return 4+3 ; } // This means we can have a second character // if that is also a * this means a comment // otherwise it is a keyword. c = styler.SafeGetCharAt(i+1); ch = static_cast(LowerCase(c)); if ( ch == '*' ) { return 8 ; } // At this point we know this is a keyword line // the character at position i is a * // it is not a comment line char word[256] ; int wlen = 0; word[wlen] = '*' ; wlen++ ; i++ ; while ( (i < eol_pos) && (wlen < 255) ) { c = styler.SafeGetCharAt(i); ch = static_cast(LowerCase(c)); if ( (!IsSpace(c)) && (!IsIdentifier(c)) ) break ; if ( IsIdentifier(c) ) { word[wlen] = ch ; wlen++ ; } i++ ; } word[wlen] = 0 ; // Make a comparison if ( !strcmp(word, "*step") || !strcmp(word, "*part") || !strcmp(word, "*instance") || !strcmp(word, "*assembly")) { return 4+1 ; } if ( !strcmp(word, "*endstep") || !strcmp(word, "*endpart") || !strcmp(word, "*endinstance") || !strcmp(word, "*endassembly")) { return 4+2 ; } return 4 ; } static void SafeSetLevel(Sci_Position line, int level, Accessor &styler) { if ( line < 0 ) return ; int mask = ((~SC_FOLDLEVELHEADERFLAG) | (~SC_FOLDLEVELWHITEFLAG)); if ( (level & mask) < 0 ) return ; if ( styler.LevelAt(line) != level ) styler.SetLevel(line, level) ; } static void FoldABAQUSDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { Sci_Position startLine = styler.GetLine(startPos) ; Sci_Position endLine = styler.GetLine(startPos+length-1) ; // bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; // We want to deal with all the cases // To know the correct indentlevel, we need to look back to the // previous command line indentation level // order of formatting keyline datalines commentlines Sci_Position beginData = -1 ; Sci_Position beginComment = -1 ; Sci_Position prvKeyLine = startLine ; Sci_Position prvKeyLineTp = 0 ; // Scan until we find the previous keyword line // this will give us the level reference that we need while ( prvKeyLine > 0 ) { prvKeyLine-- ; prvKeyLineTp = LineType(prvKeyLine, styler) ; if ( prvKeyLineTp & 4 ) break ; } // Determine the base line level of all lines following // the previous keyword // new keyword lines are placed on this level //if ( prvKeyLineTp & 4 ) { int level = styler.LevelAt(prvKeyLine) & ~SC_FOLDLEVELHEADERFLAG ; //} // uncomment line below if weird behaviour continues prvKeyLine = -1 ; // Now start scanning over the lines. for ( Sci_Position line = startLine; line <= endLine; line++ ) { int lineType = LineType(line, styler) ; // Check for comment line if ( lineType == 8 ) { if ( beginComment < 0 ) { beginComment = line ; } } // Check for data line if ( (lineType == 1) || (lineType == 3) ) { if ( beginData < 0 ) { if ( beginComment >= 0 ) { beginData = beginComment ; } else { beginData = line ; } } beginComment = -1 ; } // Check for keywordline. // As soon as a keyword line is encountered, we can set the // levels of everything from the previous keyword line to this one if ( lineType & 4 ) { // this is a keyword, we can now place the previous keyword // all its data lines and the remainder // Write comments and data line if ( beginComment < 0 ) { beginComment = line ; } if ( beginData < 0 ) { beginData = beginComment ; if ( prvKeyLineTp != 5 ) SafeSetLevel(prvKeyLine, level, styler) ; else SafeSetLevel(prvKeyLine, level | SC_FOLDLEVELHEADERFLAG, styler) ; } else { SafeSetLevel(prvKeyLine, level | SC_FOLDLEVELHEADERFLAG, styler) ; } int datLevel = level + 1 ; if ( !(prvKeyLineTp & 4) ) { datLevel = level ; } for ( Sci_Position ll = beginData; ll < beginComment; ll++ ) SafeSetLevel(ll, datLevel, styler) ; // The keyword we just found is going to be written at another level // if we have a type 5 and type 6 if ( prvKeyLineTp == 5 ) { level += 1 ; } if ( prvKeyLineTp == 6 ) { level -= 1 ; if ( level < 0 ) { level = 0 ; } } for ( Sci_Position lll = beginComment; lll < line; lll++ ) SafeSetLevel(lll, level, styler) ; // wrap and reset beginComment = -1 ; beginData = -1 ; prvKeyLine = line ; prvKeyLineTp = lineType ; } } if ( beginComment < 0 ) { beginComment = endLine + 1 ; } else { // We need to find out whether this comment block is followed by // a data line or a keyword line const Sci_Position docLines = styler.GetLine(styler.Length() - 1); for ( Sci_Position line = endLine + 1; line <= docLines; line++ ) { Sci_Position lineType = LineType(line, styler) ; if ( lineType != 8 ) { if ( !(lineType & 4) ) { beginComment = endLine + 1 ; } break ; } } } if ( beginData < 0 ) { beginData = beginComment ; if ( prvKeyLineTp != 5 ) SafeSetLevel(prvKeyLine, level, styler) ; else SafeSetLevel(prvKeyLine, level | SC_FOLDLEVELHEADERFLAG, styler) ; } else { SafeSetLevel(prvKeyLine, level | SC_FOLDLEVELHEADERFLAG, styler) ; } int datLevel = level + 1 ; if ( !(prvKeyLineTp & 4) ) { datLevel = level ; } for ( Sci_Position ll = beginData; ll < beginComment; ll++ ) SafeSetLevel(ll, datLevel, styler) ; if ( prvKeyLineTp == 5 ) { level += 1 ; } if ( prvKeyLineTp == 6 ) { level -= 1 ; } for ( Sci_Position m = beginComment; m <= endLine; m++ ) SafeSetLevel(m, level, styler) ; } static const char * const abaqusWordListDesc[] = { "processors", "commands", "slashommands", "starcommands", "arguments", "functions", 0 }; LexerModule lmAbaqus(SCLEX_ABAQUS, ColouriseABAQUSDoc, "abaqus", FoldABAQUSDoc, abaqusWordListDesc); lexilla/lexers/LexConf.cxx0000664000175000017500000001316114647367374014565 0ustar neilneil// Scintilla source code edit control /** @file LexConf.cxx ** Lexer for Apache Configuration Files. ** ** First working version contributed by Ahmad Zawawi on October 28, 2000. ** i created this lexer because i needed something pretty when dealing ** when Apache Configuration files... **/ // Copyright 1998-2001 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static void ColouriseConfDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *keywordLists[], Accessor &styler) { int state = SCE_CONF_DEFAULT; char chNext = styler[startPos]; Sci_Position lengthDoc = startPos + length; // create a buffer large enough to take the largest chunk... char *buffer = new char[length+1]; Sci_Position bufferCount = 0; // this assumes that we have 2 keyword list in conf.properties WordList &directives = *keywordLists[0]; WordList ¶ms = *keywordLists[1]; // go through all provided text segment // using the hand-written state machine shown below styler.StartAt(startPos); styler.StartSegment(startPos); for (Sci_Position i = startPos; i < lengthDoc; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); if (styler.IsLeadByte(ch)) { chNext = styler.SafeGetCharAt(i + 2); i++; continue; } switch(state) { case SCE_CONF_DEFAULT: if( ch == '\n' || ch == '\r' || ch == '\t' || ch == ' ') { // whitespace is simply ignored here... styler.ColourTo(i,SCE_CONF_DEFAULT); break; } else if( ch == '#' ) { // signals the start of a comment... state = SCE_CONF_COMMENT; styler.ColourTo(i,SCE_CONF_COMMENT); } else if( ch == '.' /*|| ch == '/'*/) { // signals the start of a file... state = SCE_CONF_EXTENSION; styler.ColourTo(i,SCE_CONF_EXTENSION); } else if( ch == '"') { state = SCE_CONF_STRING; styler.ColourTo(i,SCE_CONF_STRING); } else if( IsASCII(ch) && ispunct(ch) ) { // signals an operator... // no state jump necessary for this // simple case... styler.ColourTo(i,SCE_CONF_OPERATOR); } else if( IsASCII(ch) && isalpha(ch) ) { // signals the start of an identifier bufferCount = 0; buffer[bufferCount++] = static_cast(tolower(ch)); state = SCE_CONF_IDENTIFIER; } else if( IsASCII(ch) && isdigit(ch) ) { // signals the start of a number bufferCount = 0; buffer[bufferCount++] = ch; //styler.ColourTo(i,SCE_CONF_NUMBER); state = SCE_CONF_NUMBER; } else { // style it the default style.. styler.ColourTo(i,SCE_CONF_DEFAULT); } break; case SCE_CONF_COMMENT: // if we find a newline here, // we simply go to default state // else continue to work on it... if( ch == '\n' || ch == '\r' ) { state = SCE_CONF_DEFAULT; } else { styler.ColourTo(i,SCE_CONF_COMMENT); } break; case SCE_CONF_EXTENSION: // if we find a non-alphanumeric char, // we simply go to default state // else we're still dealing with an extension... if( (IsASCII(ch) && isalnum(ch)) || (ch == '_') || (ch == '-') || (ch == '$') || (ch == '/') || (ch == '.') || (ch == '*') ) { styler.ColourTo(i,SCE_CONF_EXTENSION); } else { state = SCE_CONF_DEFAULT; chNext = styler[i--]; } break; case SCE_CONF_STRING: // if we find the end of a string char, we simply go to default state // else we're still dealing with an string... if( (ch == '"' && styler.SafeGetCharAt(i-1)!='\\') || (ch == '\n') || (ch == '\r') ) { state = SCE_CONF_DEFAULT; } styler.ColourTo(i,SCE_CONF_STRING); break; case SCE_CONF_IDENTIFIER: // stay in CONF_IDENTIFIER state until we find a non-alphanumeric if( (IsASCII(ch) && isalnum(ch)) || (ch == '_') || (ch == '-') || (ch == '/') || (ch == '$') || (ch == '.') || (ch == '*')) { buffer[bufferCount++] = static_cast(tolower(ch)); } else { state = SCE_CONF_DEFAULT; buffer[bufferCount] = '\0'; // check if the buffer contains a keyword, and highlight it if it is a keyword... if(directives.InList(buffer)) { styler.ColourTo(i-1,SCE_CONF_DIRECTIVE ); } else if(params.InList(buffer)) { styler.ColourTo(i-1,SCE_CONF_PARAMETER ); } else if(strchr(buffer,'/') || strchr(buffer,'.')) { styler.ColourTo(i-1,SCE_CONF_EXTENSION); } else { styler.ColourTo(i-1,SCE_CONF_DEFAULT); } // push back the faulty character chNext = styler[i--]; } break; case SCE_CONF_NUMBER: // stay in CONF_NUMBER state until we find a non-numeric if( (IsASCII(ch) && isdigit(ch)) || ch == '.') { buffer[bufferCount++] = ch; } else { state = SCE_CONF_DEFAULT; buffer[bufferCount] = '\0'; // Colourize here... if( strchr(buffer,'.') ) { // it is an IP address... styler.ColourTo(i-1,SCE_CONF_IP); } else { // normal number styler.ColourTo(i-1,SCE_CONF_NUMBER); } // push back a character chNext = styler[i--]; } break; } } delete []buffer; } static const char * const confWordListDesc[] = { "Directives", "Parameters", 0 }; LexerModule lmConf(SCLEX_CONF, ColouriseConfDoc, "conf", 0, confWordListDesc); lexilla/lexers/LexDMIS.cxx0000664000175000017500000002122714647367374014436 0ustar neilneil// Scintilla source code edit control /** @file LexDMIS.cxx ** Lexer for DMIS. **/ // Copyright 1998-2005 by Neil Hodgson // Copyright 2013-2014 by Andreas Tscharner // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" #include "DefaultLexer.h" using namespace Lexilla; static const char *const DMISWordListDesc[] = { "DMIS Major Words", "DMIS Minor Words", "Unsupported DMIS Major Words", "Unsupported DMIS Minor Words", "Keywords for code folding start", "Corresponding keywords for code folding end", 0 }; class LexerDMIS : public DefaultLexer { private: char *m_wordListSets; WordList m_majorWords; WordList m_minorWords; WordList m_unsupportedMajor; WordList m_unsupportedMinor; WordList m_codeFoldingStart; WordList m_codeFoldingEnd; char * SCI_METHOD UpperCase(char *item); void SCI_METHOD InitWordListSets(void); public: LexerDMIS(void); virtual ~LexerDMIS(void); int SCI_METHOD Version() const override { return Scintilla::lvRelease5; } void SCI_METHOD Release() override { delete this; } const char * SCI_METHOD PropertyNames() override { return NULL; } int SCI_METHOD PropertyType(const char *) override { return -1; } const char * SCI_METHOD DescribeProperty(const char *) override { return NULL; } Sci_Position SCI_METHOD PropertySet(const char *, const char *) override { return -1; } const char * SCI_METHOD PropertyGet(const char *) override { return NULL; } Sci_Position SCI_METHOD WordListSet(int n, const char *wl) override; void * SCI_METHOD PrivateCall(int, void *) override { return NULL; } static ILexer5 *LexerFactoryDMIS() { return new LexerDMIS; } const char * SCI_METHOD DescribeWordListSets() override; void SCI_METHOD Lex(Sci_PositionU startPos, Sci_Position lengthDoc, int initStyle, Scintilla::IDocument *pAccess) override; void SCI_METHOD Fold(Sci_PositionU startPos, Sci_Position lengthDoc, int initStyle, Scintilla::IDocument *pAccess) override; }; char * SCI_METHOD LexerDMIS::UpperCase(char *item) { char *itemStart; itemStart = item; while (item && *item) { *item = toupper(*item); item++; }; return itemStart; } void SCI_METHOD LexerDMIS::InitWordListSets(void) { size_t totalLen = 0; for (int i=0; DMISWordListDesc[i]; i++) { totalLen += strlen(DMISWordListDesc[i]); totalLen++; }; totalLen++; this->m_wordListSets = new char[totalLen]; memset(this->m_wordListSets, 0, totalLen); for (int i=0; DMISWordListDesc[i]; i++) { strcat(this->m_wordListSets, DMISWordListDesc[i]); strcat(this->m_wordListSets, "\n"); }; } LexerDMIS::LexerDMIS(void) : DefaultLexer("DMIS", SCLEX_DMIS) { this->InitWordListSets(); this->m_majorWords.Clear(); this->m_minorWords.Clear(); this->m_unsupportedMajor.Clear(); this->m_unsupportedMinor.Clear(); this->m_codeFoldingStart.Clear(); this->m_codeFoldingEnd.Clear(); } LexerDMIS::~LexerDMIS(void) { delete[] this->m_wordListSets; } Sci_Position SCI_METHOD LexerDMIS::WordListSet(int n, const char *wl) { switch (n) { case 0: this->m_majorWords.Clear(); this->m_majorWords.Set(wl); break; case 1: this->m_minorWords.Clear(); this->m_minorWords.Set(wl); break; case 2: this->m_unsupportedMajor.Clear(); this->m_unsupportedMajor.Set(wl); break; case 3: this->m_unsupportedMinor.Clear(); this->m_unsupportedMinor.Set(wl); break; case 4: this->m_codeFoldingStart.Clear(); this->m_codeFoldingStart.Set(wl); break; case 5: this->m_codeFoldingEnd.Clear(); this->m_codeFoldingEnd.Set(wl); break; default: return -1; break; } return 0; } const char * SCI_METHOD LexerDMIS::DescribeWordListSets() { return this->m_wordListSets; } void SCI_METHOD LexerDMIS::Lex(Sci_PositionU startPos, Sci_Position lengthDoc, int initStyle, Scintilla::IDocument *pAccess) { const Sci_PositionU MAX_STR_LEN = 100; LexAccessor styler(pAccess); StyleContext scCTX(startPos, lengthDoc, initStyle, styler); CharacterSet setDMISNumber(CharacterSet::setDigits, ".-+eE"); CharacterSet setDMISWordStart(CharacterSet::setAlpha, "-234", 0x80, true); CharacterSet setDMISWord(CharacterSet::setAlpha); bool isIFLine = false; for (; scCTX.More(); scCTX.Forward()) { if (scCTX.atLineEnd) { isIFLine = false; }; switch (scCTX.state) { case SCE_DMIS_DEFAULT: if (scCTX.Match('$', '$')) { scCTX.SetState(SCE_DMIS_COMMENT); scCTX.Forward(); }; if (scCTX.Match('\'')) { scCTX.SetState(SCE_DMIS_STRING); }; if (IsADigit(scCTX.ch) || ((scCTX.Match('-') || scCTX.Match('+')) && IsADigit(scCTX.chNext))) { scCTX.SetState(SCE_DMIS_NUMBER); break; }; if (setDMISWordStart.Contains(scCTX.ch)) { scCTX.SetState(SCE_DMIS_KEYWORD); }; if (scCTX.Match('(') && (!isIFLine)) { scCTX.SetState(SCE_DMIS_LABEL); }; break; case SCE_DMIS_COMMENT: if (scCTX.atLineEnd) { scCTX.SetState(SCE_DMIS_DEFAULT); }; break; case SCE_DMIS_STRING: if (scCTX.Match('\'')) { scCTX.SetState(SCE_DMIS_DEFAULT); }; break; case SCE_DMIS_NUMBER: if (!setDMISNumber.Contains(scCTX.ch)) { scCTX.SetState(SCE_DMIS_DEFAULT); }; break; case SCE_DMIS_KEYWORD: if (!setDMISWord.Contains(scCTX.ch)) { char tmpStr[MAX_STR_LEN]; memset(tmpStr, 0, MAX_STR_LEN*sizeof(char)); scCTX.GetCurrent(tmpStr, (MAX_STR_LEN-1)); // The following strncpy is copying from a string back onto itself which is weird and causes warnings // but is harmless so turn off the warning #if defined(__GNUC__) && !defined(__clang__) // Disable warning for strncpy #pragma GCC diagnostic ignored "-Wrestrict" #endif strncpy(tmpStr, this->UpperCase(tmpStr), (MAX_STR_LEN-1)); if (this->m_minorWords.InList(tmpStr)) { scCTX.ChangeState(SCE_DMIS_MINORWORD); }; if (this->m_majorWords.InList(tmpStr)) { isIFLine = (strcmp(tmpStr, "IF") == 0); scCTX.ChangeState(SCE_DMIS_MAJORWORD); }; if (this->m_unsupportedMajor.InList(tmpStr)) { scCTX.ChangeState(SCE_DMIS_UNSUPPORTED_MAJOR); }; if (this->m_unsupportedMinor.InList(tmpStr)) { scCTX.ChangeState(SCE_DMIS_UNSUPPORTED_MINOR); }; if (scCTX.Match('(') && (!isIFLine)) { scCTX.SetState(SCE_DMIS_LABEL); } else { scCTX.SetState(SCE_DMIS_DEFAULT); }; }; break; case SCE_DMIS_LABEL: if (scCTX.Match(')')) { scCTX.SetState(SCE_DMIS_DEFAULT); }; break; }; }; scCTX.Complete(); } void SCI_METHOD LexerDMIS::Fold(Sci_PositionU startPos, Sci_Position lengthDoc, int, Scintilla::IDocument *pAccess) { const int MAX_STR_LEN = 100; LexAccessor styler(pAccess); Sci_PositionU endPos = startPos + lengthDoc; char chNext = styler[startPos]; Sci_Position lineCurrent = styler.GetLine(startPos); int levelPrev = styler.LevelAt(lineCurrent) & SC_FOLDLEVELNUMBERMASK; int levelCurrent = levelPrev; int strPos = 0; bool foldWordPossible = false; CharacterSet setDMISFoldWord(CharacterSet::setAlpha); char *tmpStr; tmpStr = new char[MAX_STR_LEN]; memset(tmpStr, 0, MAX_STR_LEN*sizeof(char)); for (Sci_PositionU i=startPos; i= (MAX_STR_LEN-1)) { strPos = MAX_STR_LEN-1; }; int style = styler.StyleAt(i); bool noFoldPos = ((style == SCE_DMIS_COMMENT) || (style == SCE_DMIS_STRING)); if (foldWordPossible) { if (setDMISFoldWord.Contains(ch)) { tmpStr[strPos++] = ch; } else { tmpStr = this->UpperCase(tmpStr); if (this->m_codeFoldingStart.InList(tmpStr) && (!noFoldPos)) { levelCurrent++; }; if (this->m_codeFoldingEnd.InList(tmpStr) && (!noFoldPos)) { levelCurrent--; }; memset(tmpStr, 0, MAX_STR_LEN*sizeof(char)); strPos = 0; foldWordPossible = false; }; } else { if (setDMISFoldWord.Contains(ch)) { tmpStr[strPos++] = ch; foldWordPossible = true; }; }; if (atEOL || (i == (endPos-1))) { int lev = levelPrev; if (levelCurrent > levelPrev) { lev |= SC_FOLDLEVELHEADERFLAG; }; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); }; lineCurrent++; levelPrev = levelCurrent; }; }; delete[] tmpStr; } LexerModule lmDMIS(SCLEX_DMIS, LexerDMIS::LexerFactoryDMIS, "DMIS", DMISWordListDesc); lexilla/lexers/LexTxt2tags.cxx0000664000175000017500000004135114647367374015422 0ustar neilneil/****************************************************************** * LexTxt2tags.cxx * * A simple Txt2tags lexer for scintilla. * * * Adapted by Eric Forgeot * Based on the LexMarkdown.cxx by Jon Strait - jstrait@moonloop.net * * What could be improved: * - Verbatim lines could be like for raw lines : when there is no space between the ``` and the following text, the first letter should be colored so the user would understand there must be a space for a valid tag. * - marks such as bold, italic, strikeout, underline should begin to be highlighted only when they are closed and valid. * - verbatim and raw area should be highlighted too. * * The License.txt file describes the conditions under which this * software may be distributed. * *****************************************************************/ #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static inline bool IsNewline(const int ch) { return (ch == '\n' || ch == '\r'); } // True if can follow ch down to the end with possibly trailing whitespace static bool FollowToLineEnd(const int ch, const int state, const Sci_PositionU endPos, StyleContext &sc) { Sci_PositionU i = 0; while (sc.GetRelative(++i) == ch) ; // Skip over whitespace while (IsASpaceOrTab(sc.GetRelative(i)) && sc.currentPos + i < endPos) ++i; if (IsNewline(sc.GetRelative(i)) || sc.currentPos + i == endPos) { sc.Forward(i); sc.ChangeState(state); sc.SetState(SCE_TXT2TAGS_LINE_BEGIN); return true; } else return false; } // Does the previous line have more than spaces and tabs? static bool HasPrevLineContent(StyleContext &sc) { Sci_Position i = 0; // Go back to the previous newline while ((--i + sc.currentPos) && !IsNewline(sc.GetRelative(i))) ; while (--i + sc.currentPos) { if (IsNewline(sc.GetRelative(i))) break; if (!IsASpaceOrTab(sc.GetRelative(i))) return true; } return false; } // Separator line static bool IsValidHrule(const Sci_PositionU endPos, StyleContext &sc) { int count = 1; Sci_PositionU i = 0; for (;;) { ++i; int c = sc.GetRelative(i); if (c == sc.ch) ++count; // hit a terminating character else if (!IsASpaceOrTab(c) || sc.currentPos + i == endPos) { // Are we a valid HRULE if ((IsNewline(c) || sc.currentPos + i == endPos) && count >= 20 && !HasPrevLineContent(sc)) { sc.SetState(SCE_TXT2TAGS_HRULE); sc.Forward(i); sc.SetState(SCE_TXT2TAGS_LINE_BEGIN); return true; } else { sc.SetState(SCE_TXT2TAGS_DEFAULT); return false; } } } } static void ColorizeTxt2tagsDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList **, Accessor &styler) { Sci_PositionU endPos = startPos + length; int precharCount = 0; // Don't advance on a new loop iteration and retry at the same position. // Useful in the corner case of having to start at the beginning file position // in the default state. bool freezeCursor = false; StyleContext sc(startPos, length, initStyle, styler); while (sc.More()) { // Skip past escaped characters if (sc.ch == '\\') { sc.Forward(); continue; } // A blockquotes resets the line semantics if (sc.state == SCE_TXT2TAGS_BLOCKQUOTE){ sc.Forward(2); sc.SetState(SCE_TXT2TAGS_LINE_BEGIN); } // An option colors the whole line if (sc.state == SCE_TXT2TAGS_OPTION){ FollowToLineEnd('%', SCE_TXT2TAGS_OPTION, endPos, sc); } if (sc.state == SCE_TXT2TAGS_POSTPROC){ FollowToLineEnd('%', SCE_TXT2TAGS_POSTPROC, endPos, sc); } if (sc.state == SCE_TXT2TAGS_PREPROC){ FollowToLineEnd('%', SCE_TXT2TAGS_PREPROC, endPos, sc); } // A comment colors the whole line if (sc.state == SCE_TXT2TAGS_COMMENT){ FollowToLineEnd('%', SCE_TXT2TAGS_COMMENT, endPos, sc); } // Conditional state-based actions if (sc.state == SCE_TXT2TAGS_CODE2) { if (IsNewline(sc.ch)) sc.SetState(SCE_TXT2TAGS_LINE_BEGIN); if (sc.Match("``") && sc.GetRelative(-2) != ' ') { sc.Forward(2); sc.SetState(SCE_TXT2TAGS_DEFAULT); } } // Table else if (sc.state == SCE_TXT2TAGS_CODE) { if (IsNewline(sc.ch)) sc.SetState(SCE_TXT2TAGS_LINE_BEGIN); if (sc.ch == '|' && sc.chPrev != ' ') sc.ForwardSetState(SCE_TXT2TAGS_DEFAULT); } // Strong else if (sc.state == SCE_TXT2TAGS_STRONG1) { if (IsNewline(sc.ch)) sc.SetState(SCE_TXT2TAGS_LINE_BEGIN); if (sc.Match("**") && sc.chPrev != ' ') { sc.Forward(2); sc.SetState(SCE_TXT2TAGS_DEFAULT); } } // Emphasis else if (sc.state == SCE_TXT2TAGS_EM1) { if (IsNewline(sc.ch)) sc.SetState(SCE_TXT2TAGS_LINE_BEGIN); if (sc.Match("//") && sc.chPrev != ' ') { sc.Forward(2); sc.ForwardSetState(SCE_TXT2TAGS_DEFAULT); } } // Underline else if (sc.state == SCE_TXT2TAGS_EM2) { if (IsNewline(sc.ch)) sc.SetState(SCE_TXT2TAGS_LINE_BEGIN); if (sc.Match("__") && sc.chPrev != ' ') { sc.Forward(2); sc.ForwardSetState(SCE_TXT2TAGS_DEFAULT); } } // codeblock else if (sc.state == SCE_TXT2TAGS_CODEBK) { if (IsNewline(sc.ch)) sc.SetState(SCE_TXT2TAGS_LINE_BEGIN); if (sc.atLineStart && sc.Match("```")) { Sci_Position i = 1; while (!IsNewline(sc.GetRelative(i)) && sc.currentPos + i < endPos) i++; sc.Forward(i); sc.SetState(SCE_TXT2TAGS_DEFAULT); } } // strikeout else if (sc.state == SCE_TXT2TAGS_STRIKEOUT) { if (IsNewline(sc.ch)) sc.SetState(SCE_TXT2TAGS_LINE_BEGIN); if (sc.Match("--") && sc.chPrev != ' ') { sc.Forward(2); sc.SetState(SCE_TXT2TAGS_DEFAULT); } } // Headers else if (sc.state == SCE_TXT2TAGS_LINE_BEGIN) { if (sc.Match("======")) { sc.SetState(SCE_TXT2TAGS_HEADER6); sc.Forward(); } else if (sc.Match("=====")) { sc.SetState(SCE_TXT2TAGS_HEADER5); sc.Forward(); } else if (sc.Match("====")) { sc.SetState(SCE_TXT2TAGS_HEADER4); sc.Forward(); } else if (sc.Match("===")) { sc.SetState(SCE_TXT2TAGS_HEADER3); sc.Forward(); } //SetStateAndZoom(SCE_TXT2TAGS_HEADER3, 3, '=', sc); else if (sc.Match("==")) { sc.SetState(SCE_TXT2TAGS_HEADER2); sc.Forward(); } //SetStateAndZoom(SCE_TXT2TAGS_HEADER2, 2, '=', sc); else if (sc.Match("=")) { // Catch the special case of an unordered list if (sc.chNext == '.' && IsASpaceOrTab(sc.GetRelative(2))) { precharCount = 0; sc.SetState(SCE_TXT2TAGS_PRECHAR); } else { sc.SetState(SCE_TXT2TAGS_HEADER1); sc.Forward(); } //SetStateAndZoom(SCE_TXT2TAGS_HEADER1, 1, '=', sc); } // Numbered title else if (sc.Match("++++++")) { sc.SetState(SCE_TXT2TAGS_HEADER6); sc.Forward(); } else if (sc.Match("+++++")) { sc.SetState(SCE_TXT2TAGS_HEADER5); sc.Forward(); } else if (sc.Match("++++")) { sc.SetState(SCE_TXT2TAGS_HEADER4); sc.Forward(); } else if (sc.Match("+++")) { sc.SetState(SCE_TXT2TAGS_HEADER3); sc.Forward(); } //SetStateAndZoom(SCE_TXT2TAGS_HEADER3, 3, '+', sc); else if (sc.Match("++")) { sc.SetState(SCE_TXT2TAGS_HEADER2); sc.Forward(); } //SetStateAndZoom(SCE_TXT2TAGS_HEADER2, 2, '+', sc); else if (sc.Match("+")) { // Catch the special case of an unordered list if (sc.chNext == ' ' && IsASpaceOrTab(sc.GetRelative(1))) { // if (IsNewline(sc.ch)) { //precharCount = 0; // sc.SetState(SCE_TXT2TAGS_LINE_BEGIN); //sc.SetState(SCE_TXT2TAGS_PRECHAR); // } // else { // precharCount = 0; sc.SetState(SCE_TXT2TAGS_OLIST_ITEM); sc.Forward(2); sc.SetState(SCE_TXT2TAGS_DEFAULT); // sc.SetState(SCE_TXT2TAGS_PRECHAR); // } } else { sc.SetState(SCE_TXT2TAGS_HEADER1); sc.Forward(); } } // Codeblock else if (sc.Match("```")) { if (!HasPrevLineContent(sc)) // if (!FollowToLineEnd(sc)) sc.SetState(SCE_TXT2TAGS_CODEBK); else sc.SetState(SCE_TXT2TAGS_DEFAULT); } // Preproc else if (sc.Match("%!preproc")) { sc.SetState(SCE_TXT2TAGS_PREPROC); } // Postproc else if (sc.Match("%!postproc")) { sc.SetState(SCE_TXT2TAGS_POSTPROC); } // Option else if (sc.Match("%!")) { sc.SetState(SCE_TXT2TAGS_OPTION); } // Comment else if (sc.ch == '%') { sc.SetState(SCE_TXT2TAGS_COMMENT); } // list else if (sc.ch == '-') { precharCount = 0; sc.SetState(SCE_TXT2TAGS_PRECHAR); } // def list else if (sc.ch == ':') { precharCount = 0; sc.SetState(SCE_TXT2TAGS_OLIST_ITEM); sc.Forward(1); sc.SetState(SCE_TXT2TAGS_PRECHAR); } else if (IsNewline(sc.ch)) sc.SetState(SCE_TXT2TAGS_LINE_BEGIN); else { precharCount = 0; sc.SetState(SCE_TXT2TAGS_PRECHAR); } } // The header lasts until the newline else if (sc.state == SCE_TXT2TAGS_HEADER1 || sc.state == SCE_TXT2TAGS_HEADER2 || sc.state == SCE_TXT2TAGS_HEADER3 || sc.state == SCE_TXT2TAGS_HEADER4 || sc.state == SCE_TXT2TAGS_HEADER5 || sc.state == SCE_TXT2TAGS_HEADER6) { if (IsNewline(sc.ch)) sc.SetState(SCE_TXT2TAGS_LINE_BEGIN); } // New state only within the initial whitespace if (sc.state == SCE_TXT2TAGS_PRECHAR) { // Blockquote if (sc.Match("\"\"\"") && precharCount < 5){ sc.SetState(SCE_TXT2TAGS_BLOCKQUOTE); sc.Forward(1); } /* // Begin of code block else if (!HasPrevLineContent(sc) && (sc.chPrev == '\t' || precharCount >= 4)) sc.SetState(SCE_TXT2TAGS_CODEBK); */ // HRule - Total of 20 or more hyphens, asterisks, or underscores // on a line by themselves else if ((sc.ch == '-' ) && IsValidHrule(endPos, sc)) ; // Unordered list else if ((sc.ch == '-') && IsASpaceOrTab(sc.chNext)) { sc.SetState(SCE_TXT2TAGS_ULIST_ITEM); sc.ForwardSetState(SCE_TXT2TAGS_DEFAULT); } // Ordered list else if (IsADigit(sc.ch)) { Sci_Position digitCount = 0; while (IsADigit(sc.GetRelative(++digitCount))) ; if (sc.GetRelative(digitCount) == '.' && IsASpaceOrTab(sc.GetRelative(digitCount + 1))) { sc.SetState(SCE_TXT2TAGS_OLIST_ITEM); sc.Forward(digitCount + 1); sc.SetState(SCE_TXT2TAGS_DEFAULT); } } // Alternate Ordered list else if (sc.ch == '+' && sc.chNext == ' ' && IsASpaceOrTab(sc.GetRelative(2))) { // sc.SetState(SCE_TXT2TAGS_OLIST_ITEM); // sc.Forward(2); // sc.SetState(SCE_TXT2TAGS_DEFAULT); } else if (sc.ch != ' ' || precharCount > 2) sc.SetState(SCE_TXT2TAGS_DEFAULT); else ++precharCount; } // New state anywhere in doc if (sc.state == SCE_TXT2TAGS_DEFAULT) { // if (sc.atLineStart && sc.ch == '#') { // sc.SetState(SCE_TXT2TAGS_LINE_BEGIN); // freezeCursor = true; // } // Links and Images if (sc.Match("![") || sc.ch == '[') { Sci_Position i = 0, j = 0, k = 0; Sci_Position len = endPos - sc.currentPos; while (i < len && (sc.GetRelative(++i) != ']' || sc.GetRelative(i - 1) == '\\')) ; if (sc.GetRelative(i) == ']') { j = i; if (sc.GetRelative(++i) == '(') { while (i < len && (sc.GetRelative(++i) != '(' || sc.GetRelative(i - 1) == '\\')) ; if (sc.GetRelative(i) == '(') k = i; } else if (sc.GetRelative(i) == '[' || sc.GetRelative(++i) == '[') { while (i < len && (sc.GetRelative(++i) != ']' || sc.GetRelative(i - 1) == '\\')) ; if (sc.GetRelative(i) == ']') k = i; } } // At least a link text if (j) { sc.SetState(SCE_TXT2TAGS_LINK); sc.Forward(j); // Also has a URL or reference portion if (k) sc.Forward(k - j); sc.ForwardSetState(SCE_TXT2TAGS_DEFAULT); } } // Code - also a special case for alternate inside spacing if (sc.Match("``") && sc.GetRelative(3) != ' ') { sc.SetState(SCE_TXT2TAGS_CODE2); sc.Forward(); } else if (sc.ch == '|' && sc.GetRelative(3) != ' ') { sc.SetState(SCE_TXT2TAGS_CODE); } // Strong else if (sc.Match("**") && sc.GetRelative(2) != ' ') { sc.SetState(SCE_TXT2TAGS_STRONG1); sc.Forward(); } // Emphasis else if (sc.Match("//") && sc.GetRelative(2) != ' ') { sc.SetState(SCE_TXT2TAGS_EM1); sc.Forward(); } else if (sc.Match("__") && sc.GetRelative(2) != ' ') { sc.SetState(SCE_TXT2TAGS_EM2); sc.Forward(); } // Strikeout else if (sc.Match("--") && sc.GetRelative(2) != ' ') { sc.SetState(SCE_TXT2TAGS_STRIKEOUT); sc.Forward(); } // Beginning of line else if (IsNewline(sc.ch)) sc.SetState(SCE_TXT2TAGS_LINE_BEGIN); } // Advance if not holding back the cursor for this iteration. if (!freezeCursor) sc.Forward(); freezeCursor = false; } sc.Complete(); } LexerModule lmTxt2tags(SCLEX_TXT2TAGS, ColorizeTxt2tagsDoc, "txt2tags"); lexilla/lexers/LexOpal.cxx0000664000175000017500000002312014647367374014567 0ustar neilneil// Scintilla source code edit control /** @file LexOpal.cxx ** Lexer for OPAL (functional language similar to Haskell) ** Written by Sebastian Pipping **/ #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; inline static void getRange( Sci_PositionU start, Sci_PositionU end, Accessor & styler, char * s, Sci_PositionU len ) { Sci_PositionU i = 0; while( ( i < end - start + 1 ) && ( i < len - 1 ) ) { s[i] = static_cast( styler[ start + i ] ); i++; } s[ i ] = '\0'; } inline bool HandleString( Sci_PositionU & cur, Sci_PositionU one_too_much, Accessor & styler ) { char ch; // Wait for string to close bool even_backslash_count = true; // Without gaps in between cur++; // Skip initial quote for( ; ; ) { if( cur >= one_too_much ) { styler.ColourTo( cur - 1, SCE_OPAL_STRING ); return false; // STOP } ch = styler.SafeGetCharAt( cur ); if( ( ch == '\015' ) || ( ch == '\012' ) ) // Deny multi-line strings { styler.ColourTo( cur - 1, SCE_OPAL_STRING ); styler.StartSegment( cur ); return true; } else { if( even_backslash_count ) { if( ch == '"' ) { styler.ColourTo( cur, SCE_OPAL_STRING ); cur++; if( cur >= one_too_much ) { return false; // STOP } else { styler.StartSegment( cur ); return true; } } else if( ch == '\\' ) { even_backslash_count = false; } } else { even_backslash_count = true; } } cur++; } } inline bool HandleCommentBlock( Sci_PositionU & cur, Sci_PositionU one_too_much, Accessor & styler, bool could_fail ) { char ch; if( could_fail ) { cur++; if( cur >= one_too_much ) { styler.ColourTo( cur - 1, SCE_OPAL_DEFAULT ); return false; // STOP } ch = styler.SafeGetCharAt( cur ); if( ch != '*' ) { styler.ColourTo( cur - 1, SCE_OPAL_DEFAULT ); styler.StartSegment( cur ); return true; } } // Wait for comment close cur++; bool star_found = false; for( ; ; ) { if( cur >= one_too_much ) { styler.ColourTo( cur - 1, SCE_OPAL_COMMENT_BLOCK ); return false; // STOP } ch = styler.SafeGetCharAt( cur ); if( star_found ) { if( ch == '/' ) { styler.ColourTo( cur, SCE_OPAL_COMMENT_BLOCK ); cur++; if( cur >= one_too_much ) { return false; // STOP } else { styler.StartSegment( cur ); return true; } } else if( ch != '*' ) { star_found = false; } } else if( ch == '*' ) { star_found = true; } cur++; } } inline bool HandleCommentLine( Sci_PositionU & cur, Sci_PositionU one_too_much, Accessor & styler, bool could_fail ) { char ch; if( could_fail ) { cur++; if( cur >= one_too_much ) { styler.ColourTo( cur - 1, SCE_OPAL_DEFAULT ); return false; // STOP } ch = styler.SafeGetCharAt( cur ); if( ch != '-' ) { styler.ColourTo( cur - 1, SCE_OPAL_DEFAULT ); styler.StartSegment( cur ); return true; } cur++; if( cur >= one_too_much ) { styler.ColourTo( cur - 1, SCE_OPAL_DEFAULT ); return false; // STOP } ch = styler.SafeGetCharAt( cur ); if( ( ch != ' ' ) && ( ch != '\t' ) ) { styler.ColourTo( cur - 1, SCE_OPAL_DEFAULT ); styler.StartSegment( cur ); return true; } } // Wait for end of line bool fifteen_found = false; for( ; ; ) { cur++; if( cur >= one_too_much ) { styler.ColourTo( cur - 1, SCE_OPAL_COMMENT_LINE ); return false; // STOP } ch = styler.SafeGetCharAt( cur ); if( fifteen_found ) { /* if( ch == '\012' ) { // One newline on Windows (015, 012) } else { // One newline on MAC (015) and another char } */ cur--; styler.ColourTo( cur - 1, SCE_OPAL_COMMENT_LINE ); styler.StartSegment( cur ); return true; } else { if( ch == '\015' ) { fifteen_found = true; } else if( ch == '\012' ) { // One newline on Linux (012) styler.ColourTo( cur - 1, SCE_OPAL_COMMENT_LINE ); styler.StartSegment( cur ); return true; } } } } inline bool HandlePar( Sci_PositionU & cur, Accessor & styler ) { styler.ColourTo( cur, SCE_OPAL_PAR ); cur++; styler.StartSegment( cur ); return true; } inline bool HandleSpace( Sci_PositionU & cur, Sci_PositionU one_too_much, Accessor & styler ) { char ch; cur++; for( ; ; ) { if( cur >= one_too_much ) { styler.ColourTo( cur - 1, SCE_OPAL_SPACE ); return false; } ch = styler.SafeGetCharAt( cur ); switch( ch ) { case ' ': case '\t': case '\015': case '\012': cur++; break; default: styler.ColourTo( cur - 1, SCE_OPAL_SPACE ); styler.StartSegment( cur ); return true; } } } inline bool HandleInteger( Sci_PositionU & cur, Sci_PositionU one_too_much, Accessor & styler ) { char ch; for( ; ; ) { cur++; if( cur >= one_too_much ) { styler.ColourTo( cur - 1, SCE_OPAL_INTEGER ); return false; // STOP } ch = styler.SafeGetCharAt( cur ); if( !( IsASCII( ch ) && isdigit( ch ) ) ) { styler.ColourTo( cur - 1, SCE_OPAL_INTEGER ); styler.StartSegment( cur ); return true; } } } inline bool HandleWord( Sci_PositionU & cur, Sci_PositionU one_too_much, Accessor & styler, WordList * keywordlists[] ) { char ch; const Sci_PositionU beg = cur; cur++; for( ; ; ) { ch = styler.SafeGetCharAt( cur ); if( ( ch != '_' ) && ( ch != '-' ) && !( IsASCII( ch ) && ( islower( ch ) || isupper( ch ) || isdigit( ch ) ) ) ) break; cur++; if( cur >= one_too_much ) { break; } } const Sci_Position ide_len = cur - beg + 1; char * ide = new char[ ide_len ]; getRange( beg, cur, styler, ide, ide_len ); WordList & keywords = *keywordlists[ 0 ]; WordList & classwords = *keywordlists[ 1 ]; if( keywords.InList( ide ) ) // Keyword { delete [] ide; styler.ColourTo( cur - 1, SCE_OPAL_KEYWORD ); if( cur >= one_too_much ) { return false; // STOP } else { styler.StartSegment( cur ); return true; } } else if( classwords.InList( ide ) ) // Sort { delete [] ide; styler.ColourTo( cur - 1, SCE_OPAL_SORT ); if( cur >= one_too_much ) { return false; // STOP } else { styler.StartSegment( cur ); return true; } } else if( !strcmp( ide, "true" ) || !strcmp( ide, "false" ) ) // Bool const { delete [] ide; styler.ColourTo( cur - 1, SCE_OPAL_BOOL_CONST ); if( cur >= one_too_much ) { return false; // STOP } else { styler.StartSegment( cur ); return true; } } else // Unknown keyword { delete [] ide; styler.ColourTo( cur - 1, SCE_OPAL_DEFAULT ); if( cur >= one_too_much ) { return false; // STOP } else { styler.StartSegment( cur ); return true; } } } inline bool HandleSkip( Sci_PositionU & cur, Sci_PositionU one_too_much, Accessor & styler ) { cur++; styler.ColourTo( cur - 1, SCE_OPAL_DEFAULT ); if( cur >= one_too_much ) { return false; // STOP } else { styler.StartSegment( cur ); return true; } } static void ColouriseOpalDoc( Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor & styler ) { styler.StartAt( startPos ); styler.StartSegment( startPos ); Sci_PositionU & cur = startPos; const Sci_PositionU one_too_much = startPos + length; int state = initStyle; for( ; ; ) { switch( state ) { case SCE_OPAL_KEYWORD: case SCE_OPAL_SORT: if( !HandleWord( cur, one_too_much, styler, keywordlists ) ) return; state = SCE_OPAL_DEFAULT; break; case SCE_OPAL_INTEGER: if( !HandleInteger( cur, one_too_much, styler ) ) return; state = SCE_OPAL_DEFAULT; break; case SCE_OPAL_COMMENT_BLOCK: if( !HandleCommentBlock( cur, one_too_much, styler, false ) ) return; state = SCE_OPAL_DEFAULT; break; case SCE_OPAL_COMMENT_LINE: if( !HandleCommentLine( cur, one_too_much, styler, false ) ) return; state = SCE_OPAL_DEFAULT; break; case SCE_OPAL_STRING: if( !HandleString( cur, one_too_much, styler ) ) return; state = SCE_OPAL_DEFAULT; break; default: // SCE_OPAL_DEFAULT: { char ch = styler.SafeGetCharAt( cur ); switch( ch ) { // String case '"': if( !HandleString( cur, one_too_much, styler ) ) return; break; // Comment block case '/': if( !HandleCommentBlock( cur, one_too_much, styler, true ) ) return; break; // Comment line case '-': if( !HandleCommentLine( cur, one_too_much, styler, true ) ) return; break; // Par case '(': case ')': case '[': case ']': case '{': case '}': if( !HandlePar( cur, styler ) ) return; break; // Whitespace case ' ': case '\t': case '\015': case '\012': if( !HandleSpace( cur, one_too_much, styler ) ) return; break; default: { // Integer if( IsASCII( ch ) && isdigit( ch ) ) { if( !HandleInteger( cur, one_too_much, styler ) ) return; } // Keyword else if( IsASCII( ch ) && ( islower( ch ) || isupper( ch ) ) ) { if( !HandleWord( cur, one_too_much, styler, keywordlists ) ) return; } // Skip else { if( !HandleSkip( cur, one_too_much, styler ) ) return; } } } break; } } } } static const char * const opalWordListDesc[] = { "Keywords", "Sorts", 0 }; LexerModule lmOpal(SCLEX_OPAL, ColouriseOpalDoc, "opal", NULL, opalWordListDesc); lexilla/lexers/LexTACL.cxx0000664000175000017500000002570114647367374014426 0ustar neilneil// Scintilla source code edit control /** @file LexTACL.cxx ** Lexer for TACL ** Based on LexPascal.cxx ** Written by Laurent le Tynevez ** Updated by Simon Steele September 2002 ** Updated by Mathias Rauen May 2003 (Delphi adjustments) ** Updated by Rod Falck, Aug 2006 Converted to TACL **/ #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; inline bool isTACLoperator(char ch) { return ch == '\'' || isoperator(ch); } inline bool isTACLwordchar(char ch) { return ch == '#' || ch == '^' || ch == '|' || ch == '_' || iswordchar(ch); } inline bool isTACLwordstart(char ch) { return ch == '#' || ch == '|' || ch == '_' || iswordstart(ch); } static void getRange(Sci_PositionU start, Sci_PositionU end, Accessor &styler, char *s, Sci_PositionU len) { Sci_PositionU i = 0; while ((i < end - start + 1) && (i < len-1)) { s[i] = static_cast(tolower(styler[start + i])); i++; } s[i] = '\0'; } static bool IsStreamCommentStyle(int style) { return style == SCE_C_COMMENT || style == SCE_C_COMMENTDOC || style == SCE_C_COMMENTDOCKEYWORD || style == SCE_C_COMMENTDOCKEYWORDERROR; } static void ColourTo(Accessor &styler, Sci_PositionU end, unsigned int attr, bool bInAsm) { if ((bInAsm) && (attr == SCE_C_OPERATOR || attr == SCE_C_NUMBER || attr == SCE_C_DEFAULT || attr == SCE_C_WORD || attr == SCE_C_IDENTIFIER)) { styler.ColourTo(end, SCE_C_REGEX); } else styler.ColourTo(end, attr); } // returns 1 if the item starts a class definition, and -1 if the word is "end", and 2 if the word is "asm" static int classifyWordTACL(Sci_PositionU start, Sci_PositionU end, /*WordList &keywords*/WordList *keywordlists[], Accessor &styler, bool bInAsm) { int ret = 0; WordList& keywords = *keywordlists[0]; WordList& builtins = *keywordlists[1]; WordList& commands = *keywordlists[2]; char s[100]; getRange(start, end, styler, s, sizeof(s)); char chAttr = SCE_C_IDENTIFIER; if (isdigit(s[0]) || (s[0] == '.')) { chAttr = SCE_C_NUMBER; } else { if (s[0] == '#' || keywords.InList(s)) { chAttr = SCE_C_WORD; if (strcmp(s, "asm") == 0) { ret = 2; } else if (strcmp(s, "end") == 0) { ret = -1; } } else if (s[0] == '|' || builtins.InList(s)) { chAttr = SCE_C_WORD2; } else if (commands.InList(s)) { chAttr = SCE_C_UUID; } else if (strcmp(s, "comment") == 0) { chAttr = SCE_C_COMMENTLINE; ret = 3; } } ColourTo(styler, end, chAttr, (bInAsm && ret != -1)); return ret; } static int classifyFoldPointTACL(const char* s) { int lev = 0; if (s[0] == '[') lev=1; else if (s[0] == ']') lev=-1; return lev; } static void ColouriseTACLDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { styler.StartAt(startPos); int state = initStyle; if (state == SCE_C_CHARACTER) // Does not leak onto next line state = SCE_C_DEFAULT; char chPrev = ' '; char chNext = styler[startPos]; Sci_PositionU lengthDoc = startPos + length; bool bInClassDefinition; Sci_Position currentLine = styler.GetLine(startPos); if (currentLine > 0) { styler.SetLineState(currentLine, styler.GetLineState(currentLine-1)); bInClassDefinition = (styler.GetLineState(currentLine) == 1); } else { styler.SetLineState(currentLine, 0); bInClassDefinition = false; } bool bInAsm = (state == SCE_C_REGEX); if (bInAsm) state = SCE_C_DEFAULT; styler.StartSegment(startPos); int visibleChars = 0; Sci_PositionU i; for (i = startPos; i < lengthDoc; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); if ((ch == '\r' && chNext != '\n') || (ch == '\n')) { // Trigger on CR only (Mac style) or either on LF from CR+LF (Dos/Win) or on LF alone (Unix) // Avoid triggering two times on Dos/Win // End of line if (state == SCE_C_CHARACTER) { ColourTo(styler, i, state, bInAsm); state = SCE_C_DEFAULT; } visibleChars = 0; currentLine++; styler.SetLineState(currentLine, (bInClassDefinition ? 1 : 0)); } if (styler.IsLeadByte(ch)) { chNext = styler.SafeGetCharAt(i + 2); chPrev = ' '; i += 1; continue; } if (state == SCE_C_DEFAULT) { if (isTACLwordstart(ch)) { ColourTo(styler, i-1, state, bInAsm); state = SCE_C_IDENTIFIER; } else if (ch == '{') { ColourTo(styler, i-1, state, bInAsm); state = SCE_C_COMMENT; } else if (ch == '{' && chNext == '*') { ColourTo(styler, i-1, state, bInAsm); state = SCE_C_COMMENTDOC; } else if (ch == '=' && chNext == '=') { ColourTo(styler, i-1, state, bInAsm); state = SCE_C_COMMENTLINE; } else if (ch == '"') { ColourTo(styler, i-1, state, bInAsm); state = SCE_C_STRING; } else if (ch == '?' && visibleChars == 0) { ColourTo(styler, i-1, state, bInAsm); state = SCE_C_PREPROCESSOR; } else if (isTACLoperator(ch)) { ColourTo(styler, i-1, state, bInAsm); ColourTo(styler, i, SCE_C_OPERATOR, bInAsm); } } else if (state == SCE_C_IDENTIFIER) { if (!isTACLwordchar(ch)) { int lStateChange = classifyWordTACL(styler.GetStartSegment(), i - 1, keywordlists, styler, bInAsm); if(lStateChange == 1) { styler.SetLineState(currentLine, 1); bInClassDefinition = true; } else if(lStateChange == 2) { bInAsm = true; } else if(lStateChange == -1) { styler.SetLineState(currentLine, 0); bInClassDefinition = false; bInAsm = false; } if (lStateChange == 3) { state = SCE_C_COMMENTLINE; } else { state = SCE_C_DEFAULT; chNext = styler.SafeGetCharAt(i + 1); if (ch == '{') { state = SCE_C_COMMENT; } else if (ch == '{' && chNext == '*') { ColourTo(styler, i-1, state, bInAsm); state = SCE_C_COMMENTDOC; } else if (ch == '=' && chNext == '=') { state = SCE_C_COMMENTLINE; } else if (ch == '"') { state = SCE_C_STRING; } else if (isTACLoperator(ch)) { ColourTo(styler, i, SCE_C_OPERATOR, bInAsm); } } } } else { if (state == SCE_C_PREPROCESSOR) { if ((ch == '\r' || ch == '\n') && !(chPrev == '\\' || chPrev == '\r')) { ColourTo(styler, i-1, state, bInAsm); state = SCE_C_DEFAULT; } } else if (state == SCE_C_COMMENT) { if (ch == '}' || (ch == '\r' || ch == '\n') ) { ColourTo(styler, i, state, bInAsm); state = SCE_C_DEFAULT; } } else if (state == SCE_C_COMMENTDOC) { if (ch == '}' || (ch == '\r' || ch == '\n')) { if (((i > styler.GetStartSegment() + 2) || ( (initStyle == SCE_C_COMMENTDOC) && (styler.GetStartSegment() == static_cast(startPos))))) { ColourTo(styler, i, state, bInAsm); state = SCE_C_DEFAULT; } } } else if (state == SCE_C_COMMENTLINE) { if (ch == '\r' || ch == '\n') { ColourTo(styler, i-1, state, bInAsm); state = SCE_C_DEFAULT; } } else if (state == SCE_C_STRING) { if (ch == '"' || ch == '\r' || ch == '\n') { ColourTo(styler, i, state, bInAsm); state = SCE_C_DEFAULT; } } } if (!isspacechar(ch)) visibleChars++; chPrev = ch; } // Process to end of document if (state == SCE_C_IDENTIFIER) { classifyWordTACL(styler.GetStartSegment(), i - 1, keywordlists, styler, bInAsm); } else ColourTo(styler, lengthDoc - 1, state, bInAsm); } static void FoldTACLDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *[], Accessor &styler) { bool foldComment = styler.GetPropertyInt("fold.comment") != 0; bool foldPreprocessor = styler.GetPropertyInt("fold.preprocessor") != 0; bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelPrev = styler.LevelAt(lineCurrent) & SC_FOLDLEVELNUMBERMASK; int levelCurrent = levelPrev; char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); int style = initStyle; bool section = false; Sci_Position lastStart = 0; for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); int stylePrev = style; style = styleNext; styleNext = styler.StyleAt(i + 1); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (stylePrev == SCE_C_DEFAULT && (style == SCE_C_WORD || style == SCE_C_PREPROCESSOR)) { // Store last word start point. lastStart = i; } if (stylePrev == SCE_C_WORD || stylePrev == SCE_C_PREPROCESSOR) { if(isTACLwordchar(ch) && !isTACLwordchar(chNext)) { char s[100]; getRange(lastStart, i, styler, s, sizeof(s)); if (stylePrev == SCE_C_PREPROCESSOR && strcmp(s, "?section") == 0) { section = true; levelCurrent = 1; levelPrev = 0; } else if (stylePrev == SCE_C_WORD) levelCurrent += classifyFoldPointTACL(s); } } if (style == SCE_C_OPERATOR) { if (ch == '[') { levelCurrent++; } else if (ch == ']') { levelCurrent--; } } if (foldComment && (style == SCE_C_COMMENTLINE)) { if ((ch == '/') && (chNext == '/')) { char chNext2 = styler.SafeGetCharAt(i + 2); if (chNext2 == '{') { levelCurrent++; } else if (chNext2 == '}') { levelCurrent--; } } } if (foldPreprocessor && (style == SCE_C_PREPROCESSOR)) { if (ch == '{' && chNext == '$') { Sci_PositionU j=i+2; // skip {$ while ((j levelPrev || section) && (visibleChars > 0)) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelPrev = levelCurrent; visibleChars = 0; section = false; } if (!isspacechar(ch)) visibleChars++; } // Fill in the real level of the next line, keeping the current flags as they will be filled in later int flagsNext = styler.LevelAt(lineCurrent) & ~SC_FOLDLEVELNUMBERMASK; styler.SetLevel(lineCurrent, levelPrev | flagsNext); } static const char * const TACLWordListDesc[] = { "Builtins", "Labels", "Commands", 0 }; LexerModule lmTACL(SCLEX_TACL, ColouriseTACLDoc, "TACL", FoldTACLDoc, TACLWordListDesc); lexilla/lexers/LexBullant.cxx0000664000175000017500000001456214647367374015307 0ustar neilneil// SciTE - Scintilla based Text Editor // LexBullant.cxx - lexer for Bullant #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static int classifyWordBullant(Sci_PositionU start, Sci_PositionU end, WordList &keywords, Accessor &styler) { char s[100]; s[0] = '\0'; for (Sci_PositionU i = 0; i < end - start + 1 && i < 30; i++) { s[i] = static_cast(tolower(styler[start + i])); s[i + 1] = '\0'; } int lev= 0; char chAttr = SCE_C_IDENTIFIER; if (isdigit(s[0]) || (s[0] == '.')){ chAttr = SCE_C_NUMBER; } else { if (keywords.InList(s)) { chAttr = SCE_C_WORD; if (strcmp(s, "end") == 0) lev = -1; else if (strcmp(s, "method") == 0 || strcmp(s, "case") == 0 || strcmp(s, "class") == 0 || strcmp(s, "debug") == 0 || strcmp(s, "test") == 0 || strcmp(s, "if") == 0 || strcmp(s, "lock") == 0 || strcmp(s, "transaction") == 0 || strcmp(s, "trap") == 0 || strcmp(s, "until") == 0 || strcmp(s, "while") == 0) lev = 1; } } styler.ColourTo(end, chAttr); return lev; } static void ColouriseBullantDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { WordList &keywords = *keywordlists[0]; styler.StartAt(startPos); bool fold = styler.GetPropertyInt("fold") != 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelPrev = styler.LevelAt(lineCurrent) & SC_FOLDLEVELNUMBERMASK; int levelCurrent = levelPrev; int state = initStyle; if (state == SCE_C_STRINGEOL) // Does not leak onto next line state = SCE_C_DEFAULT; char chPrev = ' '; char chNext = styler[startPos]; Sci_PositionU lengthDoc = startPos + length; int visibleChars = 0; styler.StartSegment(startPos); int endFoundThisLine = 0; for (Sci_PositionU i = startPos; i < lengthDoc; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); if ((ch == '\r' && chNext != '\n') || (ch == '\n')) { // Trigger on CR only (Mac style) or either on LF from CR+LF (Dos/Win) or on LF alone (Unix) // Avoid triggering two times on Dos/Win // End of line endFoundThisLine = 0; if (state == SCE_C_STRINGEOL) { styler.ColourTo(i, state); state = SCE_C_DEFAULT; } if (fold) { int lev = levelPrev; if (visibleChars == 0) lev |= SC_FOLDLEVELWHITEFLAG; if ((levelCurrent > levelPrev) && (visibleChars > 0)) lev |= SC_FOLDLEVELHEADERFLAG; styler.SetLevel(lineCurrent, lev); lineCurrent++; levelPrev = levelCurrent; } visibleChars = 0; /* int indentBlock = GetLineIndentation(lineCurrent); if (blockChange==1){ lineCurrent++; int pos=SetLineIndentation(lineCurrent, indentBlock + indentSize); } else if (blockChange==-1) { indentBlock -= indentSize; if (indentBlock < 0) indentBlock = 0; SetLineIndentation(lineCurrent, indentBlock); lineCurrent++; } blockChange=0; */ } if (!(IsASCII(ch) && isspace(ch))) visibleChars++; if (styler.IsLeadByte(ch)) { chNext = styler.SafeGetCharAt(i + 2); chPrev = ' '; i += 1; continue; } if (state == SCE_C_DEFAULT) { if (iswordstart(ch)) { styler.ColourTo(i-1, state); state = SCE_C_IDENTIFIER; } else if (ch == '@' && chNext == 'o') { if ((styler.SafeGetCharAt(i+2) =='f') && (styler.SafeGetCharAt(i+3) == 'f')) { styler.ColourTo(i-1, state); state = SCE_C_COMMENT; } } else if (ch == '#') { styler.ColourTo(i-1, state); state = SCE_C_COMMENTLINE; } else if (ch == '\"') { styler.ColourTo(i-1, state); state = SCE_C_STRING; } else if (ch == '\'') { styler.ColourTo(i-1, state); state = SCE_C_CHARACTER; } else if (isoperator(ch)) { styler.ColourTo(i-1, state); styler.ColourTo(i, SCE_C_OPERATOR); } } else if (state == SCE_C_IDENTIFIER) { if (!iswordchar(ch)) { int levelChange = classifyWordBullant(styler.GetStartSegment(), i - 1, keywords, styler); state = SCE_C_DEFAULT; chNext = styler.SafeGetCharAt(i + 1); if (ch == '#') { state = SCE_C_COMMENTLINE; } else if (ch == '\"') { state = SCE_C_STRING; } else if (ch == '\'') { state = SCE_C_CHARACTER; } else if (isoperator(ch)) { styler.ColourTo(i, SCE_C_OPERATOR); } if (endFoundThisLine == 0) levelCurrent+=levelChange; if (levelChange == -1) endFoundThisLine=1; } } else if (state == SCE_C_COMMENT) { if (ch == '@' && chNext == 'o') { if (styler.SafeGetCharAt(i+2) == 'n') { styler.ColourTo(i+2, state); state = SCE_C_DEFAULT; i+=2; } } } else if (state == SCE_C_COMMENTLINE) { if (ch == '\r' || ch == '\n') { endFoundThisLine = 0; styler.ColourTo(i-1, state); state = SCE_C_DEFAULT; } } else if (state == SCE_C_STRING) { if (ch == '\\') { if (chNext == '\"' || chNext == '\'' || chNext == '\\') { i++; ch = chNext; chNext = styler.SafeGetCharAt(i + 1); } } else if (ch == '\"') { styler.ColourTo(i, state); state = SCE_C_DEFAULT; } else if (chNext == '\r' || chNext == '\n') { endFoundThisLine = 0; styler.ColourTo(i-1, SCE_C_STRINGEOL); state = SCE_C_STRINGEOL; } } else if (state == SCE_C_CHARACTER) { if ((ch == '\r' || ch == '\n') && (chPrev != '\\')) { endFoundThisLine = 0; styler.ColourTo(i-1, SCE_C_STRINGEOL); state = SCE_C_STRINGEOL; } else if (ch == '\\') { if (chNext == '\"' || chNext == '\'' || chNext == '\\') { i++; ch = chNext; chNext = styler.SafeGetCharAt(i + 1); } } else if (ch == '\'') { styler.ColourTo(i, state); state = SCE_C_DEFAULT; } } chPrev = ch; } styler.ColourTo(lengthDoc - 1, state); // Fill in the real level of the next line, keeping the current flags as they will be filled in later if (fold) { int flagsNext = styler.LevelAt(lineCurrent) & ~SC_FOLDLEVELNUMBERMASK; //styler.SetLevel(lineCurrent, levelCurrent | flagsNext); styler.SetLevel(lineCurrent, levelPrev | flagsNext); } } static const char * const bullantWordListDesc[] = { "Keywords", 0 }; LexerModule lmBullant(SCLEX_BULLANT, ColouriseBullantDoc, "bullant", 0, bullantWordListDesc); lexilla/lexers/LexSTTXT.cxx0000664000175000017500000002545214647367374014634 0ustar neilneil// Scintilla source code edit control /** @file LexSTTXT.cxx ** Lexer for Structured Text language. ** Written by Pavel Bulochkin **/ // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static void ClassifySTTXTWord(WordList *keywordlists[], StyleContext &sc) { char s[256] = { 0 }; sc.GetCurrentLowered(s, sizeof(s)); if ((*keywordlists[0]).InList(s)) { sc.ChangeState(SCE_STTXT_KEYWORD); } else if ((*keywordlists[1]).InList(s)) { sc.ChangeState(SCE_STTXT_TYPE); } else if ((*keywordlists[2]).InList(s)) { sc.ChangeState(SCE_STTXT_FUNCTION); } else if ((*keywordlists[3]).InList(s)) { sc.ChangeState(SCE_STTXT_FB); } else if ((*keywordlists[4]).InList(s)) { sc.ChangeState(SCE_STTXT_VARS); } else if ((*keywordlists[5]).InList(s)) { sc.ChangeState(SCE_STTXT_PRAGMAS); } sc.SetState(SCE_STTXT_DEFAULT); } static void ColouriseSTTXTDoc (Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { StyleContext sc(startPos, length, initStyle, styler); CharacterSet setWord(CharacterSet::setAlphaNum, "_", 0x80, true); CharacterSet setWordStart(CharacterSet::setAlpha, "_", 0x80, true); CharacterSet setNumber(CharacterSet::setDigits, "_.eE"); CharacterSet setHexNumber(CharacterSet::setDigits, "_abcdefABCDEF"); CharacterSet setOperator(CharacterSet::setNone,",.+-*/:;<=>[]()%&"); CharacterSet setDataTime(CharacterSet::setDigits,"_.-:dmshDMSH"); for ( ; sc.More() ; sc.Forward()) { if(sc.atLineStart && sc.state != SCE_STTXT_COMMENT) sc.SetState(SCE_STTXT_DEFAULT); switch(sc.state) { case SCE_STTXT_NUMBER: { if(!setNumber.Contains(sc.ch)) sc.SetState(SCE_STTXT_DEFAULT); break; } case SCE_STTXT_HEXNUMBER: { if (setHexNumber.Contains(sc.ch)) continue; else if(setDataTime.Contains(sc.ch)) sc.ChangeState(SCE_STTXT_DATETIME); else if(setWord.Contains(sc.ch)) sc.ChangeState(SCE_STTXT_DEFAULT); else sc.SetState(SCE_STTXT_DEFAULT); break; } case SCE_STTXT_DATETIME: { if (setDataTime.Contains(sc.ch)) continue; else if(setWord.Contains(sc.ch)) sc.ChangeState(SCE_STTXT_DEFAULT); else sc.SetState(SCE_STTXT_DEFAULT); break; } case SCE_STTXT_OPERATOR: { sc.SetState(SCE_STTXT_DEFAULT); break; } case SCE_STTXT_PRAGMA: { if (sc.ch == '}') sc.ForwardSetState(SCE_STTXT_DEFAULT); break; } case SCE_STTXT_COMMENTLINE: { if (sc.atLineStart) sc.SetState(SCE_STTXT_DEFAULT); break; } case SCE_STTXT_COMMENT: { if(sc.Match('*',')')) { sc.Forward(); sc.ForwardSetState(SCE_STTXT_DEFAULT); } break; } case SCE_STTXT_STRING1: { if(sc.atLineEnd) sc.SetState(SCE_STTXT_STRINGEOL); else if(sc.ch == '\'' && sc.chPrev != '$') sc.ForwardSetState(SCE_STTXT_DEFAULT); break; } case SCE_STTXT_STRING2: { if (sc.atLineEnd) sc.SetState(SCE_STTXT_STRINGEOL); else if(sc.ch == '\"' && sc.chPrev != '$') sc.ForwardSetState(SCE_STTXT_DEFAULT); break; } case SCE_STTXT_STRINGEOL: { if(sc.atLineStart) sc.SetState(SCE_STTXT_DEFAULT); break; } case SCE_STTXT_CHARACTER: { if(setHexNumber.Contains(sc.ch)) sc.SetState(SCE_STTXT_HEXNUMBER); else if(setDataTime.Contains(sc.ch)) sc.SetState(SCE_STTXT_DATETIME); else sc.SetState(SCE_STTXT_DEFAULT); break; } case SCE_STTXT_IDENTIFIER: { if(!setWord.Contains(sc.ch)) ClassifySTTXTWord(keywordlists, sc); break; } } if(sc.state == SCE_STTXT_DEFAULT) { if(IsADigit(sc.ch)) sc.SetState(SCE_STTXT_NUMBER); else if (setWordStart.Contains(sc.ch)) sc.SetState(SCE_STTXT_IDENTIFIER); else if (sc.Match('/', '/')) sc.SetState(SCE_STTXT_COMMENTLINE); else if(sc.Match('(', '*')) sc.SetState(SCE_STTXT_COMMENT); else if (sc.ch == '{') sc.SetState(SCE_STTXT_PRAGMA); else if (sc.ch == '\'') sc.SetState(SCE_STTXT_STRING1); else if (sc.ch == '\"') sc.SetState(SCE_STTXT_STRING2); else if(sc.ch == '#') sc.SetState(SCE_STTXT_CHARACTER); else if (setOperator.Contains(sc.ch)) sc.SetState(SCE_STTXT_OPERATOR); } } if (sc.state == SCE_STTXT_IDENTIFIER && setWord.Contains(sc.chPrev)) ClassifySTTXTWord(keywordlists, sc); sc.Complete(); } static const char * const STTXTWordListDesc[] = { "Keywords", "Types", "Functions", "FB", "Local_Var", "Local_Pragma", 0 }; static bool IsCommentLine(Sci_Position line, Accessor &styler, bool type) { Sci_Position pos = styler.LineStart(line); Sci_Position eolPos = styler.LineStart(line + 1) - 1; for (Sci_Position i = pos; i < eolPos; i++) { char ch = styler[i]; char chNext = styler.SafeGetCharAt(i + 1); int style = styler.StyleAt(i); if(type) { if (ch == '/' && chNext == '/' && style == SCE_STTXT_COMMENTLINE) return true; } else if (ch == '(' && chNext == '*' && style == SCE_STTXT_COMMENT) break; if (!IsASpaceOrTab(ch)) return false; } for (Sci_Position i = eolPos-2; i>pos; i--) { char ch = styler[i]; char chPrev = styler.SafeGetCharAt(i-1); int style = styler.StyleAt(i); if(ch == ')' && chPrev == '*' && style == SCE_STTXT_COMMENT) return true; if(!IsASpaceOrTab(ch)) return false; } return false; } static bool IsPragmaLine(Sci_Position line, Accessor &styler) { Sci_Position pos = styler.LineStart(line); Sci_Position eolPos = styler.LineStart(line+1) - 1; for (Sci_Position i = pos ; i < eolPos ; i++) { char ch = styler[i]; int style = styler.StyleAt(i); if(ch == '{' && style == SCE_STTXT_PRAGMA) return true; else if (!IsASpaceOrTab(ch)) return false; } return false; } static void GetRangeUpper(Sci_PositionU start,Sci_PositionU end,Accessor &styler,char *s,Sci_PositionU len) { Sci_PositionU i = 0; while ((i < end - start + 1) && (i < len-1)) { s[i] = static_cast(toupper(styler[start + i])); i++; } s[i] = '\0'; } static void ClassifySTTXTWordFoldPoint(int &levelCurrent,Sci_PositionU lastStart, Sci_PositionU currentPos, Accessor &styler) { char s[256]; GetRangeUpper(lastStart, currentPos, styler, s, sizeof(s)); // See Table C.2 - Keywords if (!strcmp(s, "ACTION") || !strcmp(s, "CASE") || !strcmp(s, "CONFIGURATION") || !strcmp(s, "FOR") || !strcmp(s, "FUNCTION") || !strcmp(s, "FUNCTION_BLOCK") || !strcmp(s, "IF") || !strcmp(s, "INITIAL_STEP") || !strcmp(s, "REPEAT") || !strcmp(s, "RESOURCE") || !strcmp(s, "STEP") || !strcmp(s, "STRUCT") || !strcmp(s, "TRANSITION") || !strcmp(s, "TYPE") || !strcmp(s, "VAR") || !strcmp(s, "VAR_INPUT") || !strcmp(s, "VAR_OUTPUT") || !strcmp(s, "VAR_IN_OUT") || !strcmp(s, "VAR_TEMP") || !strcmp(s, "VAR_EXTERNAL") || !strcmp(s, "VAR_ACCESS") || !strcmp(s, "VAR_CONFIG") || !strcmp(s, "VAR_GLOBAL") || !strcmp(s, "WHILE")) { levelCurrent++; } else if (!strcmp(s, "END_ACTION") || !strcmp(s, "END_CASE") || !strcmp(s, "END_CONFIGURATION") || !strcmp(s, "END_FOR") || !strcmp(s, "END_FUNCTION") || !strcmp(s, "END_FUNCTION_BLOCK") || !strcmp(s, "END_IF") || !strcmp(s, "END_REPEAT") || !strcmp(s, "END_RESOURCE") || !strcmp(s, "END_STEP") || !strcmp(s, "END_STRUCT") || !strcmp(s, "END_TRANSITION") || !strcmp(s, "END_TYPE") || !strcmp(s, "END_VAR") || !strcmp(s, "END_WHILE")) { levelCurrent--; if (levelCurrent < SC_FOLDLEVELBASE) { levelCurrent = SC_FOLDLEVELBASE; } } } static void FoldSTTXTDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *[],Accessor &styler) { bool foldComment = styler.GetPropertyInt("fold.comment") != 0; bool foldPreprocessor = styler.GetPropertyInt("fold.preprocessor") != 0; bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelPrev = styler.LevelAt(lineCurrent) & SC_FOLDLEVELNUMBERMASK; int levelCurrent = levelPrev; char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); int style = initStyle; Sci_Position lastStart = 0; CharacterSet setWord(CharacterSet::setAlphaNum, "_", 0x80, true); for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); int stylePrev = style; style = styleNext; styleNext = styler.StyleAt(i + 1); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (foldComment && style == SCE_STTXT_COMMENT) { if(stylePrev != SCE_STTXT_COMMENT) levelCurrent++; else if(styleNext != SCE_STTXT_COMMENT && !atEOL) levelCurrent--; } if ( foldComment && atEOL && ( IsCommentLine(lineCurrent, styler,false) || IsCommentLine(lineCurrent,styler,true))) { if(!IsCommentLine(lineCurrent-1, styler,true) && IsCommentLine(lineCurrent+1, styler,true)) levelCurrent++; if (IsCommentLine(lineCurrent-1, styler,true) && !IsCommentLine(lineCurrent+1, styler,true)) levelCurrent--; if (!IsCommentLine(lineCurrent-1, styler,false) && IsCommentLine(lineCurrent+1, styler,false)) levelCurrent++; if (IsCommentLine(lineCurrent-1, styler,false) && !IsCommentLine(lineCurrent+1, styler,false)) levelCurrent--; } if(foldPreprocessor && atEOL && IsPragmaLine(lineCurrent, styler)) { if(!IsPragmaLine(lineCurrent-1, styler) && IsPragmaLine(lineCurrent+1, styler )) levelCurrent++; else if(IsPragmaLine(lineCurrent-1, styler) && !IsPragmaLine(lineCurrent+1, styler)) levelCurrent--; } if (stylePrev != SCE_STTXT_KEYWORD && style == SCE_STTXT_KEYWORD) { lastStart = i; } if(stylePrev == SCE_STTXT_KEYWORD) { if(setWord.Contains(ch) && !setWord.Contains(chNext)) ClassifySTTXTWordFoldPoint(levelCurrent,lastStart, i, styler); } if (!IsASpace(ch)) { visibleChars++; } if (atEOL) { int lev = levelPrev; if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if ((levelCurrent > levelPrev) && (visibleChars > 0)) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) styler.SetLevel(lineCurrent, lev); lineCurrent++; levelPrev = levelCurrent; visibleChars = 0; } // If we didn't reach the EOL in previous loop, store line level and whitespace information. // The rest will be filled in later... int lev = levelPrev; if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; styler.SetLevel(lineCurrent, lev); } } LexerModule lmSTTXT(SCLEX_STTXT, ColouriseSTTXTDoc, "fcST", FoldSTTXTDoc, STTXTWordListDesc); lexilla/lexers/LexPLM.cxx0000664000175000017500000001304514647367374014331 0ustar neilneil// Copyright (c) 1990-2007, Scientific Toolworks, Inc. // @file LexPLM.cxx // Author: Jason Haslam // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static void GetRange(Sci_PositionU start, Sci_PositionU end, Accessor &styler, char *s, Sci_PositionU len) { Sci_PositionU i = 0; while ((i < end - start + 1) && (i < len-1)) { s[i] = static_cast(tolower(styler[start + i])); i++; } s[i] = '\0'; } static void ColourisePlmDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { Sci_PositionU endPos = startPos + length; int state = initStyle; styler.StartAt(startPos); styler.StartSegment(startPos); for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = styler.SafeGetCharAt(i); char chNext = styler.SafeGetCharAt(i + 1); if (state == SCE_PLM_DEFAULT) { if (ch == '/' && chNext == '*') { styler.ColourTo(i - 1, state); state = SCE_PLM_COMMENT; } else if (ch == '\'') { styler.ColourTo(i - 1, state); state = SCE_PLM_STRING; } else if (isdigit(ch)) { styler.ColourTo(i - 1, state); state = SCE_PLM_NUMBER; } else if (isalpha(ch)) { styler.ColourTo(i - 1, state); state = SCE_PLM_IDENTIFIER; } else if (ch == '+' || ch == '-' || ch == '*' || ch == '/' || ch == '=' || ch == '<' || ch == '>' || ch == ':') { styler.ColourTo(i - 1, state); state = SCE_PLM_OPERATOR; } else if (ch == '$') { styler.ColourTo(i - 1, state); state = SCE_PLM_CONTROL; } } else if (state == SCE_PLM_COMMENT) { if (ch == '*' && chNext == '/') { i++; styler.ColourTo(i, state); state = SCE_PLM_DEFAULT; } } else if (state == SCE_PLM_STRING) { if (ch == '\'') { if (chNext == '\'') { i++; } else { styler.ColourTo(i, state); state = SCE_PLM_DEFAULT; } } } else if (state == SCE_PLM_NUMBER) { if (!isdigit(ch) && !isalpha(ch) && ch != '$') { i--; styler.ColourTo(i, state); state = SCE_PLM_DEFAULT; } } else if (state == SCE_PLM_IDENTIFIER) { if (!isdigit(ch) && !isalpha(ch) && ch != '$') { // Get the entire identifier. char word[1024]; Sci_Position segmentStart = styler.GetStartSegment(); GetRange(segmentStart, i - 1, styler, word, sizeof(word)); i--; if (keywordlists[0]->InList(word)) styler.ColourTo(i, SCE_PLM_KEYWORD); else styler.ColourTo(i, state); state = SCE_PLM_DEFAULT; } } else if (state == SCE_PLM_OPERATOR) { if (ch != '=' && ch != '>') { i--; styler.ColourTo(i, state); state = SCE_PLM_DEFAULT; } } else if (state == SCE_PLM_CONTROL) { if (ch == '\r' || ch == '\n') { styler.ColourTo(i - 1, state); state = SCE_PLM_DEFAULT; } } } styler.ColourTo(endPos - 1, state); } static void FoldPlmDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *[], Accessor &styler) { bool foldComment = styler.GetPropertyInt("fold.comment") != 0; bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelPrev = styler.LevelAt(lineCurrent) & SC_FOLDLEVELNUMBERMASK; int levelCurrent = levelPrev; char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); int style = initStyle; Sci_Position startKeyword = 0; for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); int stylePrev = style; style = styleNext; styleNext = styler.StyleAt(i + 1); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (stylePrev != SCE_PLM_KEYWORD && style == SCE_PLM_KEYWORD) startKeyword = i; if (style == SCE_PLM_KEYWORD && styleNext != SCE_PLM_KEYWORD) { char word[1024]; GetRange(startKeyword, i, styler, word, sizeof(word)); if (strcmp(word, "procedure") == 0 || strcmp(word, "do") == 0) levelCurrent++; else if (strcmp(word, "end") == 0) levelCurrent--; } if (foldComment) { if (stylePrev != SCE_PLM_COMMENT && style == SCE_PLM_COMMENT) levelCurrent++; else if (stylePrev == SCE_PLM_COMMENT && style != SCE_PLM_COMMENT) levelCurrent--; } if (atEOL) { int lev = levelPrev; if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if ((levelCurrent > levelPrev) && (visibleChars > 0)) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelPrev = levelCurrent; visibleChars = 0; } if (!isspacechar(ch)) visibleChars++; } int flagsNext = styler.LevelAt(lineCurrent) & ~SC_FOLDLEVELNUMBERMASK; styler.SetLevel(lineCurrent, levelPrev | flagsNext); } static const char *const plmWordListDesc[] = { "Keywords", 0 }; LexerModule lmPLM(SCLEX_PLM, ColourisePlmDoc, "PL/M", FoldPlmDoc, plmWordListDesc); lexilla/lexers/LexErlang.cxx0000664000175000017500000004036014647367374015111 0ustar neilneil// Scintilla source code edit control // Encoding: UTF-8 // Copyright 1998-2001 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. /** @file LexErlang.cxx ** Lexer for Erlang. ** Enhanced by Etienne 'Lenain' Girondel (lenaing@gmail.com) ** Originally wrote by Peter-Henry Mander, ** based on Matlab lexer by José Fonseca. **/ #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static int is_radix(int radix, int ch) { int digit; if (36 < radix || 2 > radix) return 0; if (isdigit(ch)) { digit = ch - '0'; } else if (isalnum(ch)) { digit = toupper(ch) - 'A' + 10; } else { return 0; } return (digit < radix); } typedef enum { STATE_NULL, COMMENT, COMMENT_FUNCTION, COMMENT_MODULE, COMMENT_DOC, COMMENT_DOC_MACRO, ATOM_UNQUOTED, ATOM_QUOTED, NODE_NAME_UNQUOTED, NODE_NAME_QUOTED, MACRO_START, MACRO_UNQUOTED, MACRO_QUOTED, RECORD_START, RECORD_UNQUOTED, RECORD_QUOTED, NUMERAL_START, NUMERAL_BASE_VALUE, NUMERAL_FLOAT, NUMERAL_EXPONENT, PREPROCESSOR } atom_parse_state_t; static inline bool IsAWordChar(const int ch) { return (ch < 0x80) && (ch != ' ') && (isalnum(ch) || ch == '_'); } static void ColouriseErlangDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { StyleContext sc(startPos, length, initStyle, styler); WordList &reservedWords = *keywordlists[0]; WordList &erlangBIFs = *keywordlists[1]; WordList &erlangPreproc = *keywordlists[2]; WordList &erlangModulesAtt = *keywordlists[3]; WordList &erlangDoc = *keywordlists[4]; WordList &erlangDocMacro = *keywordlists[5]; int radix_digits = 0; int exponent_digits = 0; atom_parse_state_t parse_state = STATE_NULL; atom_parse_state_t old_parse_state = STATE_NULL; bool to_late_to_comment = false; char cur[100]; int old_style = SCE_ERLANG_DEFAULT; styler.StartAt(startPos); for (; sc.More(); sc.Forward()) { int style = SCE_ERLANG_DEFAULT; if (STATE_NULL != parse_state) { switch (parse_state) { case STATE_NULL : sc.SetState(SCE_ERLANG_DEFAULT); break; /* COMMENTS ------------------------------------------------------*/ case COMMENT : { if (sc.ch != '%') { to_late_to_comment = true; } else if (!to_late_to_comment && sc.ch == '%') { // Switch to comment level 2 (Function) sc.ChangeState(SCE_ERLANG_COMMENT_FUNCTION); old_style = SCE_ERLANG_COMMENT_FUNCTION; parse_state = COMMENT_FUNCTION; sc.Forward(); } } // V--- Falling through! // Falls through. case COMMENT_FUNCTION : { if (sc.ch != '%') { to_late_to_comment = true; } else if (!to_late_to_comment && sc.ch == '%') { // Switch to comment level 3 (Module) sc.ChangeState(SCE_ERLANG_COMMENT_MODULE); old_style = SCE_ERLANG_COMMENT_MODULE; parse_state = COMMENT_MODULE; sc.Forward(); } } // V--- Falling through! // Falls through. case COMMENT_MODULE : { if (parse_state != COMMENT) { // Search for comment documentation if (sc.chNext == '@') { old_parse_state = parse_state; parse_state = ('{' == sc.ch) ? COMMENT_DOC_MACRO : COMMENT_DOC; sc.ForwardSetState(sc.state); } } // All comments types fall here. if (sc.MatchLineEnd()) { to_late_to_comment = false; sc.SetState(SCE_ERLANG_DEFAULT); parse_state = STATE_NULL; } } break; case COMMENT_DOC : // V--- Falling through! case COMMENT_DOC_MACRO : { if (!isalnum(sc.ch)) { // Try to match documentation comment sc.GetCurrent(cur, sizeof(cur)); if (parse_state == COMMENT_DOC_MACRO && erlangDocMacro.InList(cur)) { sc.ChangeState(SCE_ERLANG_COMMENT_DOC_MACRO); while (sc.ch != '}' && !sc.atLineEnd) sc.Forward(); } else if (erlangDoc.InList(cur)) { sc.ChangeState(SCE_ERLANG_COMMENT_DOC); } else { sc.ChangeState(old_style); } // Switch back to old state sc.SetState(old_style); parse_state = old_parse_state; } if (sc.MatchLineEnd()) { to_late_to_comment = false; sc.ChangeState(old_style); sc.SetState(SCE_ERLANG_DEFAULT); parse_state = STATE_NULL; } } break; /* -------------------------------------------------------------- */ /* Atoms ---------------------------------------------------------*/ case ATOM_UNQUOTED : { if ('@' == sc.ch){ parse_state = NODE_NAME_UNQUOTED; } else if (sc.ch == ':') { // Searching for module name if (sc.chNext == ' ') { // error sc.ChangeState(SCE_ERLANG_UNKNOWN); parse_state = STATE_NULL; } else { sc.Forward(); if (isalnum(sc.ch) || (sc.ch == '\'')) { sc.GetCurrent(cur, sizeof(cur)); sc.ChangeState(SCE_ERLANG_MODULES); sc.SetState(SCE_ERLANG_MODULES); } if (sc.ch == '\'') { parse_state = ATOM_QUOTED; } } } else if (!IsAWordChar(sc.ch)) { sc.GetCurrent(cur, sizeof(cur)); if (reservedWords.InList(cur)) { style = SCE_ERLANG_KEYWORD; } else if (erlangBIFs.InList(cur) && strcmp(cur,"erlang:")){ style = SCE_ERLANG_BIFS; } else if (sc.ch == '(' || '/' == sc.ch){ style = SCE_ERLANG_FUNCTION_NAME; } else { style = SCE_ERLANG_ATOM; } sc.ChangeState(style); sc.SetState(SCE_ERLANG_DEFAULT); parse_state = STATE_NULL; } } break; case ATOM_QUOTED : { if ( '@' == sc.ch ){ parse_state = NODE_NAME_QUOTED; } else if ('\'' == sc.ch && '\\' != sc.chPrev) { sc.ChangeState(SCE_ERLANG_ATOM_QUOTED); sc.ForwardSetState(SCE_ERLANG_DEFAULT); parse_state = STATE_NULL; } } break; /* -------------------------------------------------------------- */ /* Node names ----------------------------------------------------*/ case NODE_NAME_UNQUOTED : { if ('@' == sc.ch) { sc.SetState(SCE_ERLANG_DEFAULT); parse_state = STATE_NULL; } else if (!IsAWordChar(sc.ch)) { sc.ChangeState(SCE_ERLANG_NODE_NAME); sc.SetState(SCE_ERLANG_DEFAULT); parse_state = STATE_NULL; } } break; case NODE_NAME_QUOTED : { if ('@' == sc.ch) { sc.SetState(SCE_ERLANG_DEFAULT); parse_state = STATE_NULL; } else if ('\'' == sc.ch && '\\' != sc.chPrev) { sc.ChangeState(SCE_ERLANG_NODE_NAME_QUOTED); sc.ForwardSetState(SCE_ERLANG_DEFAULT); parse_state = STATE_NULL; } } break; /* -------------------------------------------------------------- */ /* Records -------------------------------------------------------*/ case RECORD_START : { if ('\'' == sc.ch) { parse_state = RECORD_QUOTED; } else if (isalpha(sc.ch) && islower(sc.ch)) { parse_state = RECORD_UNQUOTED; } else { // error sc.SetState(SCE_ERLANG_DEFAULT); parse_state = STATE_NULL; } } break; case RECORD_UNQUOTED : { if (!IsAWordChar(sc.ch)) { sc.ChangeState(SCE_ERLANG_RECORD); sc.SetState(SCE_ERLANG_DEFAULT); parse_state = STATE_NULL; } } break; case RECORD_QUOTED : { if ('\'' == sc.ch && '\\' != sc.chPrev) { sc.ChangeState(SCE_ERLANG_RECORD_QUOTED); sc.ForwardSetState(SCE_ERLANG_DEFAULT); parse_state = STATE_NULL; } } break; /* -------------------------------------------------------------- */ /* Macros --------------------------------------------------------*/ case MACRO_START : { if ('\'' == sc.ch) { parse_state = MACRO_QUOTED; } else if (isalpha(sc.ch)) { parse_state = MACRO_UNQUOTED; } else { // error sc.SetState(SCE_ERLANG_DEFAULT); parse_state = STATE_NULL; } } break; case MACRO_UNQUOTED : { if (!IsAWordChar(sc.ch)) { sc.ChangeState(SCE_ERLANG_MACRO); sc.SetState(SCE_ERLANG_DEFAULT); parse_state = STATE_NULL; } } break; case MACRO_QUOTED : { if ('\'' == sc.ch && '\\' != sc.chPrev) { sc.ChangeState(SCE_ERLANG_MACRO_QUOTED); sc.ForwardSetState(SCE_ERLANG_DEFAULT); parse_state = STATE_NULL; } } break; /* -------------------------------------------------------------- */ /* Numerics ------------------------------------------------------*/ /* Simple integer */ case NUMERAL_START : { if (isdigit(sc.ch)) { radix_digits *= 10; radix_digits += sc.ch - '0'; // Assuming ASCII here! } else if ('#' == sc.ch) { if (2 > radix_digits || 36 < radix_digits) { sc.SetState(SCE_ERLANG_DEFAULT); parse_state = STATE_NULL; } else { parse_state = NUMERAL_BASE_VALUE; } } else if ('.' == sc.ch && isdigit(sc.chNext)) { radix_digits = 0; parse_state = NUMERAL_FLOAT; } else if ('e' == sc.ch || 'E' == sc.ch) { exponent_digits = 0; parse_state = NUMERAL_EXPONENT; } else { radix_digits = 0; sc.ChangeState(SCE_ERLANG_NUMBER); sc.SetState(SCE_ERLANG_DEFAULT); parse_state = STATE_NULL; } } break; /* Integer in other base than 10 (x#yyy) */ case NUMERAL_BASE_VALUE : { if (!is_radix(radix_digits,sc.ch)) { radix_digits = 0; if (!isalnum(sc.ch)) sc.ChangeState(SCE_ERLANG_NUMBER); sc.SetState(SCE_ERLANG_DEFAULT); parse_state = STATE_NULL; } } break; /* Float (x.yyy) */ case NUMERAL_FLOAT : { if ('e' == sc.ch || 'E' == sc.ch) { exponent_digits = 0; parse_state = NUMERAL_EXPONENT; } else if (!isdigit(sc.ch)) { sc.ChangeState(SCE_ERLANG_NUMBER); sc.SetState(SCE_ERLANG_DEFAULT); parse_state = STATE_NULL; } } break; /* Exponent, either integer or float (xEyy, x.yyEzzz) */ case NUMERAL_EXPONENT : { if (('-' == sc.ch || '+' == sc.ch) && (isdigit(sc.chNext))) { sc.Forward(); } else if (!isdigit(sc.ch)) { if (0 < exponent_digits) sc.ChangeState(SCE_ERLANG_NUMBER); sc.SetState(SCE_ERLANG_DEFAULT); parse_state = STATE_NULL; } else { ++exponent_digits; } } break; /* -------------------------------------------------------------- */ /* Preprocessor --------------------------------------------------*/ case PREPROCESSOR : { if (!IsAWordChar(sc.ch)) { sc.GetCurrent(cur, sizeof(cur)); if (erlangPreproc.InList(cur)) { style = SCE_ERLANG_PREPROC; } else if (erlangModulesAtt.InList(cur)) { style = SCE_ERLANG_MODULES_ATT; } sc.ChangeState(style); sc.SetState(SCE_ERLANG_DEFAULT); parse_state = STATE_NULL; } } break; } } /* End of : STATE_NULL != parse_state */ else { switch (sc.state) { case SCE_ERLANG_VARIABLE : { if (!IsAWordChar(sc.ch)) sc.SetState(SCE_ERLANG_DEFAULT); } break; case SCE_ERLANG_STRING : { if (sc.ch == '\"' && sc.chPrev != '\\') sc.ForwardSetState(SCE_ERLANG_DEFAULT); } break; case SCE_ERLANG_COMMENT : { if (sc.atLineEnd) sc.SetState(SCE_ERLANG_DEFAULT); } break; case SCE_ERLANG_CHARACTER : { if (sc.chPrev == '\\') { sc.ForwardSetState(SCE_ERLANG_DEFAULT); } else if (sc.ch != '\\') { sc.ForwardSetState(SCE_ERLANG_DEFAULT); } } break; case SCE_ERLANG_OPERATOR : { if (sc.chPrev == '.') { if (sc.ch == '*' || sc.ch == '/' || sc.ch == '\\' || sc.ch == '^') { sc.ForwardSetState(SCE_ERLANG_DEFAULT); } else if (sc.ch == '\'') { sc.ForwardSetState(SCE_ERLANG_DEFAULT); } else { sc.SetState(SCE_ERLANG_DEFAULT); } } else { sc.SetState(SCE_ERLANG_DEFAULT); } } break; } } if (sc.state == SCE_ERLANG_DEFAULT) { bool no_new_state = false; switch (sc.ch) { case '\"' : sc.SetState(SCE_ERLANG_STRING); break; case '$' : sc.SetState(SCE_ERLANG_CHARACTER); break; case '%' : { parse_state = COMMENT; sc.SetState(SCE_ERLANG_COMMENT); } break; case '#' : { parse_state = RECORD_START; sc.SetState(SCE_ERLANG_UNKNOWN); } break; case '?' : { parse_state = MACRO_START; sc.SetState(SCE_ERLANG_UNKNOWN); } break; case '\'' : { parse_state = ATOM_QUOTED; sc.SetState(SCE_ERLANG_UNKNOWN); } break; case '+' : case '-' : { if (IsADigit(sc.chNext)) { parse_state = NUMERAL_START; radix_digits = 0; sc.SetState(SCE_ERLANG_UNKNOWN); } else if (sc.ch != '+') { parse_state = PREPROCESSOR; sc.SetState(SCE_ERLANG_UNKNOWN); } } break; default : no_new_state = true; } if (no_new_state) { if (isdigit(sc.ch)) { parse_state = NUMERAL_START; radix_digits = sc.ch - '0'; sc.SetState(SCE_ERLANG_UNKNOWN); } else if (isupper(sc.ch) || '_' == sc.ch) { sc.SetState(SCE_ERLANG_VARIABLE); } else if (isalpha(sc.ch)) { parse_state = ATOM_UNQUOTED; sc.SetState(SCE_ERLANG_UNKNOWN); } else if (isoperator(static_cast(sc.ch)) || sc.ch == '\\') { sc.SetState(SCE_ERLANG_OPERATOR); } } } } sc.Complete(); } static int ClassifyErlangFoldPoint( Accessor &styler, int styleNext, Sci_Position keyword_start ) { int lev = 0; if (styler.Match(keyword_start,"case") || ( styler.Match(keyword_start,"fun") && (SCE_ERLANG_FUNCTION_NAME != styleNext) ) || styler.Match(keyword_start,"if") || styler.Match(keyword_start,"query") || styler.Match(keyword_start,"receive") ) { ++lev; } else if (styler.Match(keyword_start,"end")) { --lev; } return lev; } static void FoldErlangDoc( Sci_PositionU startPos, Sci_Position length, int initStyle, WordList** /*keywordlists*/, Accessor &styler ) { Sci_PositionU endPos = startPos + length; Sci_Position currentLine = styler.GetLine(startPos); int lev; int previousLevel = styler.LevelAt(currentLine) & SC_FOLDLEVELNUMBERMASK; int currentLevel = previousLevel; int styleNext = styler.StyleAt(startPos); int style = initStyle; int stylePrev; Sci_Position keyword_start = 0; char ch; char chNext = styler.SafeGetCharAt(startPos); bool atEOL; for (Sci_PositionU i = startPos; i < endPos; i++) { ch = chNext; chNext = styler.SafeGetCharAt(i + 1); // Get styles stylePrev = style; style = styleNext; styleNext = styler.StyleAt(i + 1); atEOL = ((ch == '\r') && (chNext != '\n')) || (ch == '\n'); if (stylePrev != SCE_ERLANG_KEYWORD && style == SCE_ERLANG_KEYWORD) { keyword_start = i; } // Fold on keywords if (stylePrev == SCE_ERLANG_KEYWORD && style != SCE_ERLANG_KEYWORD && style != SCE_ERLANG_ATOM ) { currentLevel += ClassifyErlangFoldPoint(styler, styleNext, keyword_start); } // Fold on comments if (style == SCE_ERLANG_COMMENT || style == SCE_ERLANG_COMMENT_MODULE || style == SCE_ERLANG_COMMENT_FUNCTION) { if (ch == '%' && chNext == '{') { currentLevel++; } else if (ch == '%' && chNext == '}') { currentLevel--; } } // Fold on braces if (style == SCE_ERLANG_OPERATOR) { if (ch == '{' || ch == '(' || ch == '[') { currentLevel++; } else if (ch == '}' || ch == ')' || ch == ']') { currentLevel--; } } if (atEOL) { lev = previousLevel; if (currentLevel > previousLevel) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(currentLine)) styler.SetLevel(currentLine, lev); currentLine++; previousLevel = currentLevel; } } // Fill in the real level of the next line, keeping the current flags as they will be filled in later styler.SetLevel(currentLine, previousLevel | (styler.LevelAt(currentLine) & ~SC_FOLDLEVELNUMBERMASK)); } static const char * const erlangWordListDesc[] = { "Erlang Reserved words", "Erlang BIFs", "Erlang Preprocessor", "Erlang Module Attributes", "Erlang Documentation", "Erlang Documentation Macro", 0 }; LexerModule lmErlang( SCLEX_ERLANG, ColouriseErlangDoc, "erlang", FoldErlangDoc, erlangWordListDesc); lexilla/lexers/LexAda.cxx0000664000175000017500000002673114647367374014374 0ustar neilneil// Scintilla source code edit control /** @file LexAda.cxx ** Lexer for Ada 95 **/ // Copyright 2002 by Sergey Koshcheyev // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; /* * Interface */ static void ColouriseDocument( Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler); static const char * const adaWordListDesc[] = { "Keywords", 0 }; LexerModule lmAda(SCLEX_ADA, ColouriseDocument, "ada", NULL, adaWordListDesc); /* * Implementation */ // Functions that have apostropheStartsAttribute as a parameter set it according to whether // an apostrophe encountered after processing the current token will start an attribute or // a character literal. static void ColouriseCharacter(StyleContext& sc, bool& apostropheStartsAttribute); static void ColouriseComment(StyleContext& sc, bool& apostropheStartsAttribute); static void ColouriseContext(StyleContext& sc, char chEnd, int stateEOL); static void ColouriseDelimiter(StyleContext& sc, bool& apostropheStartsAttribute); static void ColouriseLabel(StyleContext& sc, WordList& keywords, bool& apostropheStartsAttribute); static void ColouriseNumber(StyleContext& sc, bool& apostropheStartsAttribute); static void ColouriseString(StyleContext& sc, bool& apostropheStartsAttribute); static void ColouriseWhiteSpace(StyleContext& sc, bool& apostropheStartsAttribute); static void ColouriseWord(StyleContext& sc, WordList& keywords, bool& apostropheStartsAttribute); static inline bool IsDelimiterCharacter(int ch); static inline bool IsSeparatorOrDelimiterCharacter(int ch); static bool IsValidIdentifier(const std::string& identifier); static bool IsValidNumber(const std::string& number); static inline bool IsWordStartCharacter(int ch); static inline bool IsWordCharacter(int ch); static void ColouriseCharacter(StyleContext& sc, bool& apostropheStartsAttribute) { apostropheStartsAttribute = true; sc.SetState(SCE_ADA_CHARACTER); // Skip the apostrophe and one more character (so that '' is shown as non-terminated and ''' // is handled correctly) sc.Forward(); sc.Forward(); ColouriseContext(sc, '\'', SCE_ADA_CHARACTEREOL); } static void ColouriseContext(StyleContext& sc, char chEnd, int stateEOL) { while (!sc.atLineEnd && !sc.Match(chEnd)) { sc.Forward(); } if (!sc.atLineEnd) { sc.ForwardSetState(SCE_ADA_DEFAULT); } else { sc.ChangeState(stateEOL); } } static void ColouriseComment(StyleContext& sc, bool& /*apostropheStartsAttribute*/) { // Apostrophe meaning is not changed, but the parameter is present for uniformity sc.SetState(SCE_ADA_COMMENTLINE); while (!sc.atLineEnd) { sc.Forward(); } } static void ColouriseDelimiter(StyleContext& sc, bool& apostropheStartsAttribute) { apostropheStartsAttribute = sc.Match (')'); sc.SetState(SCE_ADA_DELIMITER); sc.ForwardSetState(SCE_ADA_DEFAULT); } static void ColouriseLabel(StyleContext& sc, WordList& keywords, bool& apostropheStartsAttribute) { apostropheStartsAttribute = false; sc.SetState(SCE_ADA_LABEL); // Skip "<<" sc.Forward(); sc.Forward(); std::string identifier; while (!sc.atLineEnd && !IsSeparatorOrDelimiterCharacter(sc.ch)) { identifier += static_cast(tolower(sc.ch)); sc.Forward(); } // Skip ">>" if (sc.Match('>', '>')) { sc.Forward(); sc.Forward(); } else { sc.ChangeState(SCE_ADA_ILLEGAL); } // If the name is an invalid identifier or a keyword, then make it invalid label if (!IsValidIdentifier(identifier) || keywords.InList(identifier.c_str())) { sc.ChangeState(SCE_ADA_ILLEGAL); } sc.SetState(SCE_ADA_DEFAULT); } static void ColouriseNumber(StyleContext& sc, bool& apostropheStartsAttribute) { apostropheStartsAttribute = true; std::string number; sc.SetState(SCE_ADA_NUMBER); // Get all characters up to a delimiter or a separator, including points, but excluding // double points (ranges). while (!IsSeparatorOrDelimiterCharacter(sc.ch) || (sc.ch == '.' && sc.chNext != '.')) { number += static_cast(sc.ch); sc.Forward(); } // Special case: exponent with sign if ((sc.chPrev == 'e' || sc.chPrev == 'E') && (sc.ch == '+' || sc.ch == '-')) { number += static_cast(sc.ch); sc.Forward (); while (!IsSeparatorOrDelimiterCharacter(sc.ch)) { number += static_cast(sc.ch); sc.Forward(); } } if (!IsValidNumber(number)) { sc.ChangeState(SCE_ADA_ILLEGAL); } sc.SetState(SCE_ADA_DEFAULT); } static void ColouriseString(StyleContext& sc, bool& apostropheStartsAttribute) { apostropheStartsAttribute = true; sc.SetState(SCE_ADA_STRING); sc.Forward(); ColouriseContext(sc, '"', SCE_ADA_STRINGEOL); } static void ColouriseWhiteSpace(StyleContext& sc, bool& /*apostropheStartsAttribute*/) { // Apostrophe meaning is not changed, but the parameter is present for uniformity sc.SetState(SCE_ADA_DEFAULT); sc.ForwardSetState(SCE_ADA_DEFAULT); } static void ColouriseWord(StyleContext& sc, WordList& keywords, bool& apostropheStartsAttribute) { apostropheStartsAttribute = true; sc.SetState(SCE_ADA_IDENTIFIER); std::string word; while (!sc.atLineEnd && !IsSeparatorOrDelimiterCharacter(sc.ch)) { word += static_cast(tolower(sc.ch)); sc.Forward(); } if (!IsValidIdentifier(word)) { sc.ChangeState(SCE_ADA_ILLEGAL); } else if (keywords.InList(word.c_str())) { sc.ChangeState(SCE_ADA_WORD); if (word != "all") { apostropheStartsAttribute = false; } } sc.SetState(SCE_ADA_DEFAULT); } // // ColouriseDocument // static void ColouriseDocument( Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { WordList &keywords = *keywordlists[0]; StyleContext sc(startPos, length, initStyle, styler); Sci_Position lineCurrent = styler.GetLine(startPos); bool apostropheStartsAttribute = (styler.GetLineState(lineCurrent) & 1) != 0; while (sc.More()) { if (sc.atLineEnd) { // Go to the next line sc.Forward(); lineCurrent++; // Remember the line state for future incremental lexing styler.SetLineState(lineCurrent, apostropheStartsAttribute); // Don't continue any styles on the next line sc.SetState(SCE_ADA_DEFAULT); } // Comments if (sc.Match('-', '-')) { ColouriseComment(sc, apostropheStartsAttribute); // Strings } else if (sc.Match('"')) { ColouriseString(sc, apostropheStartsAttribute); // Characters } else if (sc.Match('\'') && !apostropheStartsAttribute) { ColouriseCharacter(sc, apostropheStartsAttribute); // Labels } else if (sc.Match('<', '<')) { ColouriseLabel(sc, keywords, apostropheStartsAttribute); // Whitespace } else if (IsASpace(sc.ch)) { ColouriseWhiteSpace(sc, apostropheStartsAttribute); // Delimiters } else if (IsDelimiterCharacter(sc.ch)) { ColouriseDelimiter(sc, apostropheStartsAttribute); // Numbers } else if (IsADigit(sc.ch) || sc.ch == '#') { ColouriseNumber(sc, apostropheStartsAttribute); // Keywords or identifiers } else { ColouriseWord(sc, keywords, apostropheStartsAttribute); } } sc.Complete(); } static inline bool IsDelimiterCharacter(int ch) { switch (ch) { case '&': case '\'': case '(': case ')': case '*': case '+': case ',': case '-': case '.': case '/': case ':': case ';': case '<': case '=': case '>': case '|': return true; default: return false; } } static inline bool IsSeparatorOrDelimiterCharacter(int ch) { return IsASpace(ch) || IsDelimiterCharacter(ch); } static bool IsValidIdentifier(const std::string& identifier) { // First character can't be '_', so initialize the flag to true bool lastWasUnderscore = true; size_t length = identifier.length(); // Zero-length identifiers are not valid (these can occur inside labels) if (length == 0) { return false; } // Check for valid character at the start if (!IsWordStartCharacter(identifier[0])) { return false; } // Check for only valid characters and no double underscores for (size_t i = 0; i < length; i++) { if (!IsWordCharacter(identifier[i]) || (identifier[i] == '_' && lastWasUnderscore)) { return false; } lastWasUnderscore = identifier[i] == '_'; } // Check for underscore at the end if (lastWasUnderscore == true) { return false; } // All checks passed return true; } static bool IsValidNumber(const std::string& number) { size_t hashPos = number.find("#"); bool seenDot = false; size_t i = 0; size_t length = number.length(); if (length == 0) return false; // Just in case // Decimal number if (hashPos == std::string::npos) { bool canBeSpecial = false; for (; i < length; i++) { if (number[i] == '_') { if (!canBeSpecial) { return false; } canBeSpecial = false; } else if (number[i] == '.') { if (!canBeSpecial || seenDot) { return false; } canBeSpecial = false; seenDot = true; } else if (IsADigit(number[i])) { canBeSpecial = true; } else { break; } } if (!canBeSpecial) return false; } else { // Based number bool canBeSpecial = false; int base = 0; // Parse base for (; i < length; i++) { int ch = number[i]; if (ch == '_') { if (!canBeSpecial) return false; canBeSpecial = false; } else if (IsADigit(ch)) { base = base * 10 + (ch - '0'); if (base > 16) return false; canBeSpecial = true; } else if (ch == '#' && canBeSpecial) { break; } else { return false; } } if (base < 2) return false; if (i == length) return false; i++; // Skip over '#' // Parse number canBeSpecial = false; for (; i < length; i++) { int ch = tolower(number[i]); if (ch == '_') { if (!canBeSpecial) { return false; } canBeSpecial = false; } else if (ch == '.') { if (!canBeSpecial || seenDot) { return false; } canBeSpecial = false; seenDot = true; } else if (IsADigit(ch)) { if (ch - '0' >= base) { return false; } canBeSpecial = true; } else if (ch >= 'a' && ch <= 'f') { if (ch - 'a' + 10 >= base) { return false; } canBeSpecial = true; } else if (ch == '#' && canBeSpecial) { break; } else { return false; } } if (i == length) { return false; } i++; } // Exponent (optional) if (i < length) { if (number[i] != 'e' && number[i] != 'E') return false; i++; // Move past 'E' if (i == length) { return false; } if (number[i] == '+') i++; else if (number[i] == '-') { if (seenDot) { i++; } else { return false; // Integer literals should not have negative exponents } } if (i == length) { return false; } bool canBeSpecial = false; for (; i < length; i++) { if (number[i] == '_') { if (!canBeSpecial) { return false; } canBeSpecial = false; } else if (IsADigit(number[i])) { canBeSpecial = true; } else { return false; } } if (!canBeSpecial) return false; } // if i == length, number was parsed successfully. return i == length; } static inline bool IsWordCharacter(int ch) { return IsWordStartCharacter(ch) || IsADigit(ch); } static inline bool IsWordStartCharacter(int ch) { return (IsASCII(ch) && isalpha(ch)) || ch == '_'; } lexilla/lexers/LexSpice.cxx0000664000175000017500000001373214647367374014747 0ustar neilneil// Scintilla source code edit control /** @file LexSpice.cxx ** Lexer for Spice **/ // Copyright 2006 by Fabien Proriol // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; /* * Interface */ static void ColouriseDocument( Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler); static const char * const spiceWordListDesc[] = { "Keywords", // SPICE command "Keywords2", // SPICE functions "Keywords3", // SPICE params 0 }; LexerModule lmSpice(SCLEX_SPICE, ColouriseDocument, "spice", NULL, spiceWordListDesc); /* * Implementation */ static void ColouriseComment(StyleContext& sc, bool& apostropheStartsAttribute); static void ColouriseDelimiter(StyleContext& sc, bool& apostropheStartsAttribute); static void ColouriseNumber(StyleContext& sc, bool& apostropheStartsAttribute); static void ColouriseWhiteSpace(StyleContext& sc, bool& apostropheStartsAttribute); static void ColouriseWord(StyleContext& sc, WordList& keywords, WordList& keywords2, WordList& keywords3, bool& apostropheStartsAttribute); static inline bool IsDelimiterCharacter(int ch); static inline bool IsSeparatorOrDelimiterCharacter(int ch); static void ColouriseComment(StyleContext& sc, bool&) { sc.SetState(SCE_SPICE_COMMENTLINE); while (!sc.atLineEnd) { sc.Forward(); } } static void ColouriseDelimiter(StyleContext& sc, bool& apostropheStartsAttribute) { apostropheStartsAttribute = sc.Match (')'); sc.SetState(SCE_SPICE_DELIMITER); sc.ForwardSetState(SCE_SPICE_DEFAULT); } static void ColouriseNumber(StyleContext& sc, bool& apostropheStartsAttribute) { apostropheStartsAttribute = true; std::string number; sc.SetState(SCE_SPICE_NUMBER); // Get all characters up to a delimiter or a separator, including points, but excluding // double points (ranges). while (!IsSeparatorOrDelimiterCharacter(sc.ch) || (sc.ch == '.' && sc.chNext != '.')) { number += static_cast(sc.ch); sc.Forward(); } // Special case: exponent with sign if ((sc.chPrev == 'e' || sc.chPrev == 'E') && (sc.ch == '+' || sc.ch == '-')) { number += static_cast(sc.ch); sc.Forward (); while (!IsSeparatorOrDelimiterCharacter(sc.ch)) { number += static_cast(sc.ch); sc.Forward(); } } sc.SetState(SCE_SPICE_DEFAULT); } static void ColouriseWhiteSpace(StyleContext& sc, bool& ) { sc.SetState(SCE_SPICE_DEFAULT); sc.ForwardSetState(SCE_SPICE_DEFAULT); } static void ColouriseWord(StyleContext& sc, WordList& keywords, WordList& keywords2, WordList& keywords3, bool& apostropheStartsAttribute) { apostropheStartsAttribute = true; sc.SetState(SCE_SPICE_IDENTIFIER); std::string word; while (!sc.atLineEnd && !IsSeparatorOrDelimiterCharacter(sc.ch)) { word += static_cast(tolower(sc.ch)); sc.Forward(); } if (keywords.InList(word.c_str())) { sc.ChangeState(SCE_SPICE_KEYWORD); if (word != "all") { apostropheStartsAttribute = false; } } else if (keywords2.InList(word.c_str())) { sc.ChangeState(SCE_SPICE_KEYWORD2); if (word != "all") { apostropheStartsAttribute = false; } } else if (keywords3.InList(word.c_str())) { sc.ChangeState(SCE_SPICE_KEYWORD3); if (word != "all") { apostropheStartsAttribute = false; } } sc.SetState(SCE_SPICE_DEFAULT); } // // ColouriseDocument // static void ColouriseDocument( Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { WordList &keywords = *keywordlists[0]; WordList &keywords2 = *keywordlists[1]; WordList &keywords3 = *keywordlists[2]; StyleContext sc(startPos, length, initStyle, styler); Sci_Position lineCurrent = styler.GetLine(startPos); bool apostropheStartsAttribute = (styler.GetLineState(lineCurrent) & 1) != 0; while (sc.More()) { if (sc.atLineEnd) { // Go to the next line sc.Forward(); lineCurrent++; // Remember the line state for future incremental lexing styler.SetLineState(lineCurrent, apostropheStartsAttribute); // Don't continue any styles on the next line sc.SetState(SCE_SPICE_DEFAULT); } // Comments if ((sc.Match('*') && sc.atLineStart) || sc.Match('*','~')) { ColouriseComment(sc, apostropheStartsAttribute); // Whitespace } else if (IsASpace(sc.ch)) { ColouriseWhiteSpace(sc, apostropheStartsAttribute); // Delimiters } else if (IsDelimiterCharacter(sc.ch)) { ColouriseDelimiter(sc, apostropheStartsAttribute); // Numbers } else if (IsADigit(sc.ch) || sc.ch == '#') { ColouriseNumber(sc, apostropheStartsAttribute); // Keywords or identifiers } else { ColouriseWord(sc, keywords, keywords2, keywords3, apostropheStartsAttribute); } } sc.Complete(); } static inline bool IsDelimiterCharacter(int ch) { switch (ch) { case '&': case '\'': case '(': case ')': case '*': case '+': case ',': case '-': case '.': case '/': case ':': case ';': case '<': case '=': case '>': case '|': return true; default: return false; } } static inline bool IsSeparatorOrDelimiterCharacter(int ch) { return IsASpace(ch) || IsDelimiterCharacter(ch); } lexilla/lexers/LexRust.cxx0000664000175000017500000006225114647367374014641 0ustar neilneil/** @file LexRust.cxx ** Lexer for Rust. ** ** Copyright (c) 2013 by SiegeLord ** Converted to lexer object and added further folding features/properties by "Udo Lechner" **/ // Copyright 1998-2005 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "PropSetSimple.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" #include "OptionSet.h" #include "DefaultLexer.h" using namespace Scintilla; using namespace Lexilla; static const int NUM_RUST_KEYWORD_LISTS = 7; static const int MAX_RUST_IDENT_CHARS = 1023; static bool IsStreamCommentStyle(int style) { return style == SCE_RUST_COMMENTBLOCK || style == SCE_RUST_COMMENTBLOCKDOC; } // Options used for LexerRust struct OptionsRust { bool fold; bool foldSyntaxBased; bool foldComment; bool foldCommentMultiline; bool foldCommentExplicit; std::string foldExplicitStart; std::string foldExplicitEnd; bool foldExplicitAnywhere; bool foldCompact; int foldAtElseInt; // This variable is not used bool foldAtElse; OptionsRust() { fold = false; foldSyntaxBased = true; foldComment = false; foldCommentMultiline = true; foldCommentExplicit = true; foldExplicitStart = ""; foldExplicitEnd = ""; foldExplicitAnywhere = false; foldCompact = true; foldAtElseInt = -1; foldAtElse = false; } }; static const char * const rustWordLists[NUM_RUST_KEYWORD_LISTS + 1] = { "Primary keywords and identifiers", "Built in types", "Other keywords", "Keywords 4", "Keywords 5", "Keywords 6", "Keywords 7", 0, }; struct OptionSetRust : public OptionSet { OptionSetRust() { DefineProperty("fold", &OptionsRust::fold); DefineProperty("fold.comment", &OptionsRust::foldComment); DefineProperty("fold.compact", &OptionsRust::foldCompact); DefineProperty("fold.at.else", &OptionsRust::foldAtElse); DefineProperty("fold.rust.syntax.based", &OptionsRust::foldSyntaxBased, "Set this property to 0 to disable syntax based folding."); DefineProperty("fold.rust.comment.multiline", &OptionsRust::foldCommentMultiline, "Set this property to 0 to disable folding multi-line comments when fold.comment=1."); DefineProperty("fold.rust.comment.explicit", &OptionsRust::foldCommentExplicit, "Set this property to 0 to disable folding explicit fold points when fold.comment=1."); DefineProperty("fold.rust.explicit.start", &OptionsRust::foldExplicitStart, "The string to use for explicit fold start points, replacing the standard //{."); DefineProperty("fold.rust.explicit.end", &OptionsRust::foldExplicitEnd, "The string to use for explicit fold end points, replacing the standard //}."); DefineProperty("fold.rust.explicit.anywhere", &OptionsRust::foldExplicitAnywhere, "Set this property to 1 to enable explicit fold points anywhere, not just in line comments."); DefineProperty("lexer.rust.fold.at.else", &OptionsRust::foldAtElseInt, "This option enables Rust folding on a \"} else {\" line of an if statement."); DefineWordListSets(rustWordLists); } }; class LexerRust : public DefaultLexer { WordList keywords[NUM_RUST_KEYWORD_LISTS]; OptionsRust options; OptionSetRust osRust; public: LexerRust() : DefaultLexer("rust", SCLEX_RUST) { } virtual ~LexerRust() { } void SCI_METHOD Release() override { delete this; } int SCI_METHOD Version() const override { return lvRelease5; } const char * SCI_METHOD PropertyNames() override { return osRust.PropertyNames(); } int SCI_METHOD PropertyType(const char *name) override { return osRust.PropertyType(name); } const char * SCI_METHOD DescribeProperty(const char *name) override { return osRust.DescribeProperty(name); } Sci_Position SCI_METHOD PropertySet(const char *key, const char *val) override; const char * SCI_METHOD PropertyGet(const char *key) override { return osRust.PropertyGet(key); } const char * SCI_METHOD DescribeWordListSets() override { return osRust.DescribeWordListSets(); } Sci_Position SCI_METHOD WordListSet(int n, const char *wl) override; void SCI_METHOD Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void SCI_METHOD Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void * SCI_METHOD PrivateCall(int, void *) override { return 0; } static ILexer5 *LexerFactoryRust() { return new LexerRust(); } }; Sci_Position SCI_METHOD LexerRust::PropertySet(const char *key, const char *val) { if (osRust.PropertySet(&options, key, val)) { return 0; } return -1; } Sci_Position SCI_METHOD LexerRust::WordListSet(int n, const char *wl) { Sci_Position firstModification = -1; if (n < NUM_RUST_KEYWORD_LISTS) { WordList *wordListN = &keywords[n]; if (wordListN->Set(wl)) { firstModification = 0; } } return firstModification; } static bool IsWhitespace(int c) { return c == ' ' || c == '\t' || c == '\r' || c == '\n'; } /* This isn't quite right for Unicode identifiers */ static bool IsIdentifierStart(int ch) { return (IsASCII(ch) && (isalpha(ch) || ch == '_')) || !IsASCII(ch); } /* This isn't quite right for Unicode identifiers */ static bool IsIdentifierContinue(int ch) { return (IsASCII(ch) && (isalnum(ch) || ch == '_')) || !IsASCII(ch); } static void ScanWhitespace(Accessor& styler, Sci_Position& pos, Sci_Position max) { while (IsWhitespace(styler.SafeGetCharAt(pos, '\0')) && pos < max) { if (pos == styler.LineEnd(styler.GetLine(pos))) styler.SetLineState(styler.GetLine(pos), 0); pos++; } styler.ColourTo(pos-1, SCE_RUST_DEFAULT); } static void GrabString(char* s, Accessor& styler, Sci_Position start, Sci_Position len) { for (Sci_Position ii = 0; ii < len; ii++) s[ii] = styler[ii + start]; s[len] = '\0'; } static void ScanRawIdentifier(Accessor& styler, Sci_Position& pos) { Sci_Position start = pos; while (IsIdentifierContinue(styler.SafeGetCharAt(pos, '\0'))) pos++; char s[MAX_RUST_IDENT_CHARS + 1]; Sci_Position len = pos - start; len = len > MAX_RUST_IDENT_CHARS ? MAX_RUST_IDENT_CHARS : len; GrabString(s, styler, start, len); // restricted values https://doc.rust-lang.org/reference/identifiers.html#raw-identifiers if (strcmp(s, "crate") != 0 && strcmp(s, "self") != 0 && strcmp(s, "super") != 0 && strcmp(s, "Self") != 0) { styler.ColourTo(pos - 1, SCE_RUST_IDENTIFIER); } else { styler.ColourTo(pos - 1, SCE_RUST_LEXERROR); } } static void ScanIdentifier(Accessor& styler, Sci_Position& pos, WordList *keywords) { Sci_Position start = pos; while (IsIdentifierContinue(styler.SafeGetCharAt(pos, '\0'))) pos++; if (styler.SafeGetCharAt(pos, '\0') == '!') { pos++; styler.ColourTo(pos - 1, SCE_RUST_MACRO); } else { char s[MAX_RUST_IDENT_CHARS + 1]; Sci_Position len = pos - start; len = len > MAX_RUST_IDENT_CHARS ? MAX_RUST_IDENT_CHARS : len; GrabString(s, styler, start, len); bool keyword = false; for (int ii = 0; ii < NUM_RUST_KEYWORD_LISTS; ii++) { if (keywords[ii].InList(s)) { styler.ColourTo(pos - 1, SCE_RUST_WORD + ii); keyword = true; break; } } if (!keyword) { styler.ColourTo(pos - 1, SCE_RUST_IDENTIFIER); } } } /* Scans a sequence of digits, returning true if it found any. */ static bool ScanDigits(Accessor& styler, Sci_Position& pos, int base) { Sci_Position old_pos = pos; for (;;) { int c = styler.SafeGetCharAt(pos, '\0'); if (IsADigit(c, base) || c == '_') pos++; else break; } return old_pos != pos; } /* Scans an integer and floating point literals. */ static void ScanNumber(Accessor& styler, Sci_Position& pos) { int base = 10; int c = styler.SafeGetCharAt(pos, '\0'); int n = styler.SafeGetCharAt(pos + 1, '\0'); bool error = false; /* Scan the prefix, thus determining the base. * 10 is default if there's no prefix. */ if (c == '0' && n == 'x') { pos += 2; base = 16; } else if (c == '0' && n == 'b') { pos += 2; base = 2; } else if (c == '0' && n == 'o') { pos += 2; base = 8; } /* Scan initial digits. The literal is malformed if there are none. */ error |= !ScanDigits(styler, pos, base); /* See if there's an integer suffix. We mimic the Rust's lexer * and munch it even if there was an error above. */ c = styler.SafeGetCharAt(pos, '\0'); if (c == 'u' || c == 'i') { pos++; c = styler.SafeGetCharAt(pos, '\0'); n = styler.SafeGetCharAt(pos + 1, '\0'); if (c == '8') { pos++; } else if (c == '1' && n == '6') { pos += 2; } else if (c == '3' && n == '2') { pos += 2; } else if (c == '6' && n == '4') { pos += 2; } else if (styler.Match(pos, "128")) { pos += 3; } else if (styler.Match(pos, "size")) { pos += 4; } else { error = true; } /* See if it's a floating point literal. These literals have to be base 10. */ } else if (!error) { /* If there's a period, it's a floating point literal unless it's * followed by an identifier (meaning this is a method call, e.g. * `1.foo()`) or another period, in which case it's a range (e.g. 1..2) */ n = styler.SafeGetCharAt(pos + 1, '\0'); if (c == '.' && !(IsIdentifierStart(n) || n == '.')) { error |= base != 10; pos++; /* It's ok to have no digits after the period. */ ScanDigits(styler, pos, 10); } /* Look for the exponentiation. */ c = styler.SafeGetCharAt(pos, '\0'); if (c == 'e' || c == 'E') { error |= base != 10; pos++; c = styler.SafeGetCharAt(pos, '\0'); if (c == '-' || c == '+') pos++; /* It is invalid to have no digits in the exponent. */ error |= !ScanDigits(styler, pos, 10); } /* Scan the floating point suffix. */ c = styler.SafeGetCharAt(pos, '\0'); if (c == 'f') { error |= base != 10; pos++; c = styler.SafeGetCharAt(pos, '\0'); n = styler.SafeGetCharAt(pos + 1, '\0'); if (c == '3' && n == '2') { pos += 2; } else if (c == '6' && n == '4') { pos += 2; } else { error = true; } } } if (error) styler.ColourTo(pos - 1, SCE_RUST_LEXERROR); else styler.ColourTo(pos - 1, SCE_RUST_NUMBER); } static bool IsOneCharOperator(int c) { return c == ';' || c == ',' || c == '(' || c == ')' || c == '{' || c == '}' || c == '[' || c == ']' || c == '@' || c == '#' || c == '~' || c == '+' || c == '*' || c == '/' || c == '^' || c == '%' || c == '.' || c == ':' || c == '!' || c == '<' || c == '>' || c == '=' || c == '-' || c == '&' || c == '|' || c == '$' || c == '?'; } static bool IsTwoCharOperator(int c, int n) { return (c == '.' && n == '.') || (c == ':' && n == ':') || (c == '!' && n == '=') || (c == '<' && n == '<') || (c == '<' && n == '=') || (c == '>' && n == '>') || (c == '>' && n == '=') || (c == '=' && n == '=') || (c == '=' && n == '>') || (c == '-' && n == '>') || (c == '&' && n == '&') || (c == '|' && n == '|') || (c == '-' && n == '=') || (c == '&' && n == '=') || (c == '|' && n == '=') || (c == '+' && n == '=') || (c == '*' && n == '=') || (c == '/' && n == '=') || (c == '^' && n == '=') || (c == '%' && n == '='); } static bool IsThreeCharOperator(int c, int n, int n2) { return (c == '<' && n == '<' && n2 == '=') || (c == '>' && n == '>' && n2 == '='); } static bool IsValidCharacterEscape(int c) { return c == 'n' || c == 'r' || c == 't' || c == '\\' || c == '\'' || c == '"' || c == '0'; } static bool IsValidStringEscape(int c) { return IsValidCharacterEscape(c) || c == '\n' || c == '\r'; } static bool ScanNumericEscape(Accessor &styler, Sci_Position& pos, Sci_Position num_digits, bool stop_asap) { for (;;) { int c = styler.SafeGetCharAt(pos, '\0'); if (!IsADigit(c, 16)) break; num_digits--; pos++; if (num_digits == 0 && stop_asap) return true; } if (num_digits == 0) { return true; } else { return false; } } /* This is overly permissive for character literals in order to accept UTF-8 encoded * character literals. */ static void ScanCharacterLiteralOrLifetime(Accessor &styler, Sci_Position& pos, bool ascii_only) { pos++; int c = styler.SafeGetCharAt(pos, '\0'); int n = styler.SafeGetCharAt(pos + 1, '\0'); bool done = false; bool valid_lifetime = !ascii_only && IsIdentifierStart(c); bool valid_char = true; bool first = true; while (!done) { switch (c) { case '\\': done = true; if (IsValidCharacterEscape(n)) { pos += 2; } else if (n == 'x') { pos += 2; valid_char = ScanNumericEscape(styler, pos, 2, false); } else if (n == 'u' && !ascii_only) { pos += 2; if (styler.SafeGetCharAt(pos, '\0') != '{') { // old-style valid_char = ScanNumericEscape(styler, pos, 4, false); } else { int n_digits = 0; while (IsADigit(styler.SafeGetCharAt(++pos, '\0'), 16) && n_digits++ < 6) { } if (n_digits > 0 && styler.SafeGetCharAt(pos, '\0') == '}') pos++; else valid_char = false; } } else if (n == 'U' && !ascii_only) { pos += 2; valid_char = ScanNumericEscape(styler, pos, 8, false); } else { valid_char = false; } break; case '\'': valid_char = !first; done = true; break; case '\t': case '\n': case '\r': case '\0': valid_char = false; done = true; break; default: if (ascii_only && !IsASCII((char)c)) { done = true; valid_char = false; } else if (!IsIdentifierContinue(c) && !first) { done = true; } else { pos++; } break; } c = styler.SafeGetCharAt(pos, '\0'); n = styler.SafeGetCharAt(pos + 1, '\0'); first = false; } if (styler.SafeGetCharAt(pos, '\0') == '\'') { valid_lifetime = false; } else { valid_char = false; } if (valid_lifetime) { styler.ColourTo(pos - 1, SCE_RUST_LIFETIME); } else if (valid_char) { pos++; styler.ColourTo(pos - 1, ascii_only ? SCE_RUST_BYTECHARACTER : SCE_RUST_CHARACTER); } else { styler.ColourTo(pos - 1, SCE_RUST_LEXERROR); } } enum CommentState { UnknownComment, DocComment, NotDocComment }; /* * The rule for block-doc comments is as follows: /xxN and /x! (where x is an asterisk, N is a non-asterisk) start doc comments. * Otherwise it's a regular comment. */ static void ResumeBlockComment(Accessor &styler, Sci_Position& pos, Sci_Position max, CommentState state, int level) { int c = styler.SafeGetCharAt(pos, '\0'); bool maybe_doc_comment = false; if (c == '*') { int n = styler.SafeGetCharAt(pos + 1, '\0'); if (n != '*' && n != '/') { maybe_doc_comment = true; } } else if (c == '!') { maybe_doc_comment = true; } for (;;) { int n = styler.SafeGetCharAt(pos + 1, '\0'); if (pos == styler.LineEnd(styler.GetLine(pos))) styler.SetLineState(styler.GetLine(pos), level); if (c == '*') { pos++; if (n == '/') { pos++; level--; if (level == 0) { styler.SetLineState(styler.GetLine(pos), 0); if (state == DocComment || (state == UnknownComment && maybe_doc_comment)) styler.ColourTo(pos - 1, SCE_RUST_COMMENTBLOCKDOC); else styler.ColourTo(pos - 1, SCE_RUST_COMMENTBLOCK); break; } } } else if (c == '/') { pos++; if (n == '*') { pos++; level++; } } else if (pos < max) { pos++; } if (pos >= max) { if (state == DocComment || (state == UnknownComment && maybe_doc_comment)) styler.ColourTo(pos - 1, SCE_RUST_COMMENTBLOCKDOC); else styler.ColourTo(pos - 1, SCE_RUST_COMMENTBLOCK); break; } c = styler.SafeGetCharAt(pos, '\0'); } } /* * The rule for line-doc comments is as follows... ///N and //! (where N is a non slash) start doc comments. * Otherwise it's a normal line comment. */ static void ResumeLineComment(Accessor &styler, Sci_Position& pos, Sci_Position max, CommentState state) { bool maybe_doc_comment = false; int c = styler.SafeGetCharAt(pos, '\0'); if (c == '/') { if (pos < max) { pos++; c = styler.SafeGetCharAt(pos, '\0'); if (c != '/') { maybe_doc_comment = true; } } } else if (c == '!') { maybe_doc_comment = true; } pos = styler.LineEnd(styler.GetLine(pos)); styler.SetLineState(styler.GetLine(pos), SCE_RUST_DEFAULT); if (state == DocComment || (state == UnknownComment && maybe_doc_comment)) styler.ColourTo(pos - 1, SCE_RUST_COMMENTLINEDOC); else styler.ColourTo(pos - 1, SCE_RUST_COMMENTLINE); } static void ScanComments(Accessor &styler, Sci_Position& pos, Sci_Position max) { pos++; int c = styler.SafeGetCharAt(pos, '\0'); pos++; if (c == '/') ResumeLineComment(styler, pos, max, UnknownComment); else if (c == '*') ResumeBlockComment(styler, pos, max, UnknownComment, 1); } static void ResumeString(Accessor &styler, Sci_Position& pos, Sci_Position max, bool ascii_only) { int c = styler.SafeGetCharAt(pos, '\0'); bool error = false; while (c != '"' && !error) { if (pos >= max) { error = true; break; } if (pos == styler.LineEnd(styler.GetLine(pos))) styler.SetLineState(styler.GetLine(pos), 0); if (c == '\\') { int n = styler.SafeGetCharAt(pos + 1, '\0'); if (IsValidStringEscape(n)) { pos += 2; } else if (n == 'x') { pos += 2; error = !ScanNumericEscape(styler, pos, 2, true); } else if (n == 'u' && !ascii_only) { pos += 2; if (styler.SafeGetCharAt(pos, '\0') != '{') { // old-style error = !ScanNumericEscape(styler, pos, 4, true); } else { int n_digits = 0; while (IsADigit(styler.SafeGetCharAt(++pos, '\0'), 16) && n_digits++ < 6) { } if (n_digits > 0 && styler.SafeGetCharAt(pos, '\0') == '}') pos++; else error = true; } } else if (n == 'U' && !ascii_only) { pos += 2; error = !ScanNumericEscape(styler, pos, 8, true); } else { pos += 1; error = true; } } else { if (ascii_only && !IsASCII((char)c)) error = true; else pos++; } c = styler.SafeGetCharAt(pos, '\0'); } if (!error) pos++; styler.ColourTo(pos - 1, ascii_only ? SCE_RUST_BYTESTRING : SCE_RUST_STRING); } static void ResumeRawString(Accessor &styler, Sci_Position& pos, Sci_Position max, int num_hashes, bool ascii_only) { for (;;) { if (pos == styler.LineEnd(styler.GetLine(pos))) styler.SetLineState(styler.GetLine(pos), num_hashes); int c = styler.SafeGetCharAt(pos, '\0'); if (c == '"') { pos++; int trailing_num_hashes = 0; while (styler.SafeGetCharAt(pos, '\0') == '#' && trailing_num_hashes < num_hashes) { trailing_num_hashes++; pos++; } if (trailing_num_hashes == num_hashes) { styler.SetLineState(styler.GetLine(pos), 0); break; } } else if (pos >= max) { break; } else { if (ascii_only && !IsASCII((char)c)) break; pos++; } } styler.ColourTo(pos - 1, ascii_only ? SCE_RUST_BYTESTRINGR : SCE_RUST_STRINGR); } static void ScanRawString(Accessor &styler, Sci_Position& pos, Sci_Position max, bool ascii_only) { pos++; int num_hashes = 0; while (styler.SafeGetCharAt(pos, '\0') == '#') { num_hashes++; pos++; } if (styler.SafeGetCharAt(pos, '\0') != '"') { styler.ColourTo(pos - 1, SCE_RUST_LEXERROR); } else { pos++; ResumeRawString(styler, pos, max, num_hashes, ascii_only); } } void SCI_METHOD LexerRust::Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { PropSetSimple props; Accessor styler(pAccess, &props); Sci_Position pos = startPos; Sci_Position max = pos + length; styler.StartAt(pos); styler.StartSegment(pos); if (initStyle == SCE_RUST_COMMENTBLOCK || initStyle == SCE_RUST_COMMENTBLOCKDOC) { ResumeBlockComment(styler, pos, max, initStyle == SCE_RUST_COMMENTBLOCKDOC ? DocComment : NotDocComment, styler.GetLineState(styler.GetLine(pos) - 1)); } else if (initStyle == SCE_RUST_COMMENTLINE || initStyle == SCE_RUST_COMMENTLINEDOC) { ResumeLineComment(styler, pos, max, initStyle == SCE_RUST_COMMENTLINEDOC ? DocComment : NotDocComment); } else if (initStyle == SCE_RUST_STRING) { ResumeString(styler, pos, max, false); } else if (initStyle == SCE_RUST_BYTESTRING) { ResumeString(styler, pos, max, true); } else if (initStyle == SCE_RUST_STRINGR) { ResumeRawString(styler, pos, max, styler.GetLineState(styler.GetLine(pos) - 1), false); } else if (initStyle == SCE_RUST_BYTESTRINGR) { ResumeRawString(styler, pos, max, styler.GetLineState(styler.GetLine(pos) - 1), true); } while (pos < max) { int c = styler.SafeGetCharAt(pos, '\0'); int n = styler.SafeGetCharAt(pos + 1, '\0'); int n2 = styler.SafeGetCharAt(pos + 2, '\0'); if (pos == 0 && c == '#' && n == '!' && n2 != '[') { pos += 2; ResumeLineComment(styler, pos, max, NotDocComment); } else if (IsWhitespace(c)) { ScanWhitespace(styler, pos, max); } else if (c == '/' && (n == '/' || n == '*')) { ScanComments(styler, pos, max); } else if (c == 'r' && (n == '#' && IsIdentifierStart(n2))) { pos += 2; ScanRawIdentifier(styler, pos); } else if (c == 'r' && (n == '#' || n == '"')) { ScanRawString(styler, pos, max, false); } else if (c == 'b' && n == 'r' && (n2 == '#' || n2 == '"')) { pos++; ScanRawString(styler, pos, max, true); } else if (c == 'b' && n == '"') { pos += 2; ResumeString(styler, pos, max, true); } else if (c == 'b' && n == '\'') { pos++; ScanCharacterLiteralOrLifetime(styler, pos, true); } else if (IsIdentifierStart(c)) { ScanIdentifier(styler, pos, keywords); } else if (IsADigit(c)) { ScanNumber(styler, pos); } else if (IsThreeCharOperator(c, n, n2)) { pos += 3; styler.ColourTo(pos - 1, SCE_RUST_OPERATOR); } else if (IsTwoCharOperator(c, n)) { pos += 2; styler.ColourTo(pos - 1, SCE_RUST_OPERATOR); } else if (IsOneCharOperator(c)) { pos++; styler.ColourTo(pos - 1, SCE_RUST_OPERATOR); } else if (c == '\'') { ScanCharacterLiteralOrLifetime(styler, pos, false); } else if (c == '"') { pos++; ResumeString(styler, pos, max, false); } else { pos++; styler.ColourTo(pos - 1, SCE_RUST_LEXERROR); } } styler.ColourTo(pos - 1, SCE_RUST_DEFAULT); styler.Flush(); } void SCI_METHOD LexerRust::Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { if (!options.fold) return; LexAccessor styler(pAccess); Sci_PositionU endPos = startPos + length; int visibleChars = 0; bool inLineComment = false; Sci_Position lineCurrent = styler.GetLine(startPos); int levelCurrent = SC_FOLDLEVELBASE; if (lineCurrent > 0) levelCurrent = styler.LevelAt(lineCurrent-1) >> 16; Sci_PositionU lineStartNext = styler.LineStart(lineCurrent+1); int levelMinCurrent = levelCurrent; int levelNext = levelCurrent; char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); int style = initStyle; const bool userDefinedFoldMarkers = !options.foldExplicitStart.empty() && !options.foldExplicitEnd.empty(); for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); int stylePrev = style; style = styleNext; styleNext = styler.StyleAt(i + 1); bool atEOL = i == (lineStartNext-1); if ((style == SCE_RUST_COMMENTLINE) || (style == SCE_RUST_COMMENTLINEDOC)) inLineComment = true; if (options.foldComment && options.foldCommentMultiline && IsStreamCommentStyle(style) && !inLineComment) { if (!IsStreamCommentStyle(stylePrev)) { levelNext++; } else if (!IsStreamCommentStyle(styleNext) && !atEOL) { // Comments don't end at end of line and the next character may be unstyled. levelNext--; } } if (options.foldComment && options.foldCommentExplicit && ((style == SCE_RUST_COMMENTLINE) || options.foldExplicitAnywhere)) { if (userDefinedFoldMarkers) { if (styler.Match(i, options.foldExplicitStart.c_str())) { levelNext++; } else if (styler.Match(i, options.foldExplicitEnd.c_str())) { levelNext--; } } else { if ((ch == '/') && (chNext == '/')) { char chNext2 = styler.SafeGetCharAt(i + 2); if (chNext2 == '{') { levelNext++; } else if (chNext2 == '}') { levelNext--; } } } } if (options.foldSyntaxBased && (style == SCE_RUST_OPERATOR)) { if (ch == '{') { // Measure the minimum before a '{' to allow // folding on "} else {" if (levelMinCurrent > levelNext) { levelMinCurrent = levelNext; } levelNext++; } else if (ch == '}') { levelNext--; } } if (!IsASpace(ch)) visibleChars++; if (atEOL || (i == endPos-1)) { int levelUse = levelCurrent; if (options.foldSyntaxBased && options.foldAtElse) { levelUse = levelMinCurrent; } int lev = levelUse | levelNext << 16; if (visibleChars == 0 && options.foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if (levelUse < levelNext) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; lineStartNext = styler.LineStart(lineCurrent+1); levelCurrent = levelNext; levelMinCurrent = levelCurrent; if (atEOL && (i == static_cast(styler.Length()-1))) { // There is an empty line at end of file so give it same level and empty styler.SetLevel(lineCurrent, (levelCurrent | levelCurrent << 16) | SC_FOLDLEVELWHITEFLAG); } visibleChars = 0; inLineComment = false; } } } LexerModule lmRust(SCLEX_RUST, LexerRust::LexerFactoryRust, "rust", rustWordLists); lexilla/lexers/LexVisualProlog.cxx0000664000175000017500000006367514647367374016345 0ustar neilneil// Scintilla source code edit control /** @file LexVisualProlog.cxx ** Lexer for Visual Prolog. **/ // Author Thomas Linder Puls, PDC A/S, http://www.visual-prolog.com // Based on Lexer for C++, C, Java, and JavaScript. // Copyright 1998-2005 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. // The line state contains: // In SCE_VISUALPROLOG_STRING: The closing quote and information about verbatim string. // and a stack of nesting kinds: comment, embedded (syntax) and (syntax) place holder #include #include #include #include #include #include #ifdef _MSC_VER #pragma warning(disable: 4786) #endif #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "CharacterCategory.h" #include "LexerModule.h" #include "OptionSet.h" #include "DefaultLexer.h" using namespace Scintilla; using namespace Lexilla; namespace { // Options used for LexerVisualProlog struct OptionsVisualProlog { bool verbatimStrings; bool backQuotedStrings; OptionsVisualProlog() { verbatimStrings = true; backQuotedStrings = false; } }; static const char* const visualPrologWordLists[] = { "Major keywords (class, predicates, ...)", "Minor keywords (if, then, try, ...)", "Directive keywords without the '#' (include, requires, ...)", "Documentation keywords without the '@' (short, detail, ...)", 0, }; struct OptionSetVisualProlog : public OptionSet { OptionSetVisualProlog() { DefineProperty("lexer.visualprolog.verbatim.strings", &OptionsVisualProlog::verbatimStrings, "Set to 0 to disable highlighting verbatim strings using '@'."); DefineProperty("lexer.visualprolog.backquoted.strings", &OptionsVisualProlog::backQuotedStrings, "Set to 1 to enable using back quotes (``) to delimit strings."); DefineWordListSets(visualPrologWordLists); } }; LexicalClass lexicalClasses[] = { SCE_VISUALPROLOG_DEFAULT, "SCE_VISUALPROLOG_DEFAULT", "default", "Default style", SCE_VISUALPROLOG_KEY_MAJOR, "SCE_VISUALPROLOG_KEY_MAJOR", "keyword major", "Major keyword", SCE_VISUALPROLOG_KEY_MINOR, "SCE_VISUALPROLOG_KEY_MINOR", "keyword minor", "Minor keyword", SCE_VISUALPROLOG_KEY_DIRECTIVE, "SCE_VISUALPROLOG_KEY_DIRECTIVE", "keyword preprocessor", "Directove keyword", SCE_VISUALPROLOG_COMMENT_BLOCK, "SCE_VISUALPROLOG_COMMENT_BLOCK", "comment", "Multiline comment /* */", SCE_VISUALPROLOG_COMMENT_LINE, "SCE_VISUALPROLOG_COMMENT_LINE", "comment line", "Line comment % ...", SCE_VISUALPROLOG_COMMENT_KEY, "SCE_VISUALPROLOG_COMMENT_KEY", "comment documentation keyword", "Doc keyword in comment % @short ...", SCE_VISUALPROLOG_COMMENT_KEY_ERROR, "SCE_VISUALPROLOG_COMMENT_KEY_ERROR", "comment", "A non recognized doc keyword % @qqq ...", SCE_VISUALPROLOG_IDENTIFIER, "SCE_VISUALPROLOG_IDENTIFIER", "identifier", "Identifier (black)", SCE_VISUALPROLOG_VARIABLE, "SCE_VISUALPROLOG_VARIABLE", "variable identifier", "Variable (green)", SCE_VISUALPROLOG_ANONYMOUS, "SCE_VISUALPROLOG_ANONYMOUS", "variable anonymous identifier", "Anonymous Variable _XXX (dimmed green)", SCE_VISUALPROLOG_NUMBER, "SCE_VISUALPROLOG_NUMBER", "numeric", "Number", SCE_VISUALPROLOG_OPERATOR, "SCE_VISUALPROLOG_OPERATOR", "operator", "Operator", SCE_VISUALPROLOG_STRING, "SCE_VISUALPROLOG_STRING", "literal string", "String literal", SCE_VISUALPROLOG_STRING_QUOTE, "SCE_VISUALPROLOG_STRING_QUOTE", "literal string quote", "Quotes surrounding string literals", SCE_VISUALPROLOG_STRING_ESCAPE, "SCE_VISUALPROLOG_STRING_ESCAPE", "literal string escapesequence", "Escape sequence in string literal", SCE_VISUALPROLOG_STRING_ESCAPE_ERROR, "SCE_VISUALPROLOG_STRING_ESCAPE_ERROR", "error literal string escapesequence", "Error in escape sequence in string literal", SCE_VISUALPROLOG_STRING_EOL, "SCE_VISUALPROLOG_STRING_EOL", "literal string multiline raw escapesequence", "Verbatim/multiline string literal EOL", SCE_VISUALPROLOG_EMBEDDED, "SCE_VISUALPROLOG_EMBEDDED", "literal string embedded", "Embedded syntax [| ... |]", SCE_VISUALPROLOG_PLACEHOLDER, "SCE_VISUALPROLOG_PLACEHOLDER", "operator embedded", "Syntax place holder {| ... |}:ident in embedded syntax" }; LexicalClass getLexicalClass(int style) { for (auto lc : lexicalClasses) { if (style == lc.value) { return lc; } } return {style, "", "unused", ""}; } class LexerVisualProlog : public DefaultLexer { WordList majorKeywords; WordList minorKeywords; WordList directiveKeywords; WordList docKeywords; OptionsVisualProlog options; OptionSetVisualProlog osVisualProlog; public: LexerVisualProlog() : DefaultLexer("visualprolog", SCLEX_VISUALPROLOG) { } virtual ~LexerVisualProlog() { } void SCI_METHOD Release() override { delete this; } int SCI_METHOD Version() const override { return lvRelease5; } const char* SCI_METHOD PropertyNames() override { return osVisualProlog.PropertyNames(); } int SCI_METHOD PropertyType(const char* name) override { return osVisualProlog.PropertyType(name); } const char* SCI_METHOD DescribeProperty(const char* name) override { return osVisualProlog.DescribeProperty(name); } Sci_Position SCI_METHOD PropertySet(const char* key, const char* val) override; const char* SCI_METHOD PropertyGet(const char* key) override { return osVisualProlog.PropertyGet(key); } const char* SCI_METHOD DescribeWordListSets() override { return osVisualProlog.DescribeWordListSets(); } Sci_Position SCI_METHOD WordListSet(int n, const char* wl) override; void SCI_METHOD Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument* pAccess) override; void SCI_METHOD Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument* pAccess) override; void* SCI_METHOD PrivateCall(int, void*) override { return 0; } int SCI_METHOD NamedStyles() override { int namedStyles = 0; for (auto lc : lexicalClasses) { if (namedStyles < lc.value) { namedStyles = lc.value; } } return namedStyles; } const char* SCI_METHOD NameOfStyle(int style) override { return getLexicalClass(style).name; } const char* SCI_METHOD TagsOfStyle(int style) override { return getLexicalClass(style).tags; } const char* SCI_METHOD DescriptionOfStyle(int style) override { return getLexicalClass(style).description; } static ILexer5* LexerFactoryVisualProlog() { return new LexerVisualProlog(); } }; Sci_Position SCI_METHOD LexerVisualProlog::PropertySet(const char* key, const char* val) { if (osVisualProlog.PropertySet(&options, key, val)) { return 0; } return -1; } Sci_Position SCI_METHOD LexerVisualProlog::WordListSet(int n, const char* wl) { WordList* wordListN = 0; switch (n) { case 0: wordListN = &majorKeywords; break; case 1: wordListN = &minorKeywords; break; case 2: wordListN = &directiveKeywords; break; case 3: wordListN = &docKeywords; break; } Sci_Position firstModification = -1; if (wordListN) { WordList wlNew; wlNew.Set(wl); if (*wordListN != wlNew) { wordListN->Set(wl); firstModification = 0; } } return firstModification; } static bool isLowerLetter(int ch) { return ccLl == CategoriseCharacter(ch); } static bool isUpperLetter(int ch) { return ccLu == CategoriseCharacter(ch); } static bool isAlphaNum(int ch) { CharacterCategory cc = CategoriseCharacter(ch); return (ccLu == cc || ccLl == cc || ccLt == cc || ccLm == cc || ccLo == cc || ccNd == cc || ccNl == cc || ccNo == cc); } static bool isStringVerbatimOpenClose(int ch) { CharacterCategory cc = CategoriseCharacter(ch); return (ccPc <= cc && cc <= ccSo); } static bool isIdChar(int ch) { return ('_') == ch || isAlphaNum(ch); } // Look ahead to see which colour "end" should have (takes colour after the following keyword) static void endLookAhead(char s[], LexAccessor& styler, Sci_Position start) { char ch = styler.SafeGetCharAt(start, '\n'); while (' ' == ch) { start++; ch = styler.SafeGetCharAt(start, '\n'); } Sci_Position i = 0; while (i < 100 && isLowerLetter(ch)) { s[i] = ch; i++; ch = styler.SafeGetCharAt(start + i, '\n'); } s[i] = '\0'; } class lineState { public: bool verbatim = false; int closingQuote = 0; int kindStack = 0; bool isOpenStringVerbatim(int next) { if (next > 0x7FFF) { return false; } switch (next) { case L'<': closingQuote = L'>'; return true; case L'>': closingQuote = L'<'; return true; case L'(': closingQuote = L')'; return true; case L')': closingQuote = L'('; return true; case L'[': closingQuote = L']'; return true; case L']': closingQuote = L'['; return true; case L'{': closingQuote = L'}'; return true; case L'}': closingQuote = L'{'; return true; case L'_': case L'.': case L',': case L';': return false; default: if (isStringVerbatimOpenClose(next)) { closingQuote = next; return true; } else { return false; } } } enum kind { none = 0, comment = 1, embedded = 2, placeholder = 3 }; void setState(int state) { verbatim = state >> 31; closingQuote = state >> 16 & 0x7FFF; kindStack = state & 0xFFFF; } int getState() { return verbatim << 31 | closingQuote << 16 | (kindStack & 0xFFFF); } void enter(kind k) { kindStack = kindStack << 2 | k; } void leave(kind k) { if (k == currentKind()) { kindStack = kindStack >> 2; } } kind currentKind() { return static_cast(kindStack & 0x3); } kind stateKind2(int ks) { if (0 == ks) { return none; } else { kind k1 = stateKind2(ks >> 2); kind k2 = static_cast(ks & 0x3); if (embedded == k1 && k2 == comment) { return embedded; } else { return k2; } } } kind stateKind() { return stateKind2(kindStack); } }; void SCI_METHOD LexerVisualProlog::Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument* pAccess) { LexAccessor styler(pAccess); CharacterSet setDoxygen(CharacterSet::setAlpha, ""); CharacterSet setNumber(CharacterSet::setNone, "0123456789abcdefABCDEFxoXO_"); StyleContext sc(startPos, length, initStyle, styler, 0x7f); int styleBeforeDocKeyword = SCE_VISUALPROLOG_DEFAULT; lineState ls; if (sc.currentLine >= 1) { ls.setState(styler.GetLineState(sc.currentLine - 1)); } bool newState = false; for (; sc.More(); sc.Forward()) { Sci_Position currentLineEntry = sc.currentLine; if (newState) { newState = false; int state; switch (ls.stateKind()) { case lineState::comment: state = SCE_VISUALPROLOG_COMMENT_BLOCK; break; case lineState::embedded: state = SCE_VISUALPROLOG_EMBEDDED; break; case lineState::placeholder: state = SCE_VISUALPROLOG_PLACEHOLDER; break; default: state = SCE_VISUALPROLOG_DEFAULT; break; } sc.SetState(state); } // Determine if the current state should terminate. switch (sc.state) { case SCE_VISUALPROLOG_OPERATOR: sc.SetState(SCE_VISUALPROLOG_DEFAULT); break; case SCE_VISUALPROLOG_NUMBER: // We accept almost anything because of hex, '.' and number suffixes if (!(setNumber.Contains(sc.ch)) || (sc.Match('.') && IsADigit(sc.chNext))) { sc.SetState(SCE_VISUALPROLOG_DEFAULT); } break; case SCE_VISUALPROLOG_IDENTIFIER: if (!isIdChar(sc.ch)) { char s[1000]; sc.GetCurrent(s, sizeof(s)); if (0 == strcmp(s, "end")) { endLookAhead(s, styler, sc.currentPos); } if (majorKeywords.InList(s)) { sc.ChangeState(SCE_VISUALPROLOG_KEY_MAJOR); } else if (minorKeywords.InList(s)) { sc.ChangeState(SCE_VISUALPROLOG_KEY_MINOR); } sc.SetState(SCE_VISUALPROLOG_DEFAULT); } break; case SCE_VISUALPROLOG_VARIABLE: case SCE_VISUALPROLOG_ANONYMOUS: if (!isIdChar(sc.ch)) { sc.SetState(SCE_VISUALPROLOG_DEFAULT); } break; case SCE_VISUALPROLOG_KEY_DIRECTIVE: if (!isLowerLetter(sc.ch)) { char s[1000]; sc.GetCurrent(s, sizeof(s)); if (!directiveKeywords.InList(s + 1)) { sc.ChangeState(SCE_VISUALPROLOG_IDENTIFIER); } sc.SetState(SCE_VISUALPROLOG_DEFAULT); } break; case SCE_VISUALPROLOG_COMMENT_LINE: if (sc.MatchLineEnd()) { int nextState = (lineState::comment == ls.currentKind()) ? SCE_VISUALPROLOG_COMMENT_BLOCK : SCE_VISUALPROLOG_DEFAULT; sc.SetState(nextState); } else if (sc.Match('@')) { styleBeforeDocKeyword = SCE_VISUALPROLOG_COMMENT_LINE; sc.SetState(SCE_VISUALPROLOG_COMMENT_KEY_ERROR); } break; case SCE_VISUALPROLOG_COMMENT_BLOCK: if (sc.Match('*', '/')) { sc.Forward(); ls.leave(lineState::comment); newState = true; } else if (sc.Match('/', '*')) { sc.Forward(); ls.enter(lineState::comment); } else if (sc.Match('@')) { styleBeforeDocKeyword = SCE_VISUALPROLOG_COMMENT_BLOCK; sc.SetState(SCE_VISUALPROLOG_COMMENT_KEY_ERROR); } break; case SCE_VISUALPROLOG_COMMENT_KEY_ERROR: if (!setDoxygen.Contains(sc.ch) || sc.MatchLineEnd()) { char s[1000]; sc.GetCurrent(s, sizeof(s)); if (docKeywords.InList(s + 1)) { sc.ChangeState(SCE_VISUALPROLOG_COMMENT_KEY); } if (SCE_VISUALPROLOG_COMMENT_LINE == styleBeforeDocKeyword && sc.MatchLineEnd()) { // end line comment int nextState = (lineState::comment == ls.currentKind()) ? SCE_VISUALPROLOG_COMMENT_BLOCK : SCE_VISUALPROLOG_DEFAULT; sc.SetState(nextState); } else { sc.SetState(styleBeforeDocKeyword); if (SCE_VISUALPROLOG_COMMENT_BLOCK == styleBeforeDocKeyword && sc.Match('*', '/')) { // we have consumed the '*' if it comes immediately after the docKeyword sc.Forward(); ls.leave(lineState::comment); newState = true; } } } break; case SCE_VISUALPROLOG_STRING_ESCAPE_ERROR: if (sc.atLineStart) { sc.SetState(SCE_VISUALPROLOG_DEFAULT); break; } [[fallthrough]]; case SCE_VISUALPROLOG_STRING_ESCAPE: case SCE_VISUALPROLOG_STRING_QUOTE: case SCE_VISUALPROLOG_STRING_EOL: // return to SCE_VISUALPROLOG_STRING and treat as such (fallthrough) sc.SetState(SCE_VISUALPROLOG_STRING); [[fallthrough]]; case SCE_VISUALPROLOG_STRING: if (sc.MatchLineEnd() | sc.atLineEnd) { if (ls.verbatim) { sc.SetState(SCE_VISUALPROLOG_STRING_EOL); } else { ls.closingQuote = 0; sc.SetState(SCE_VISUALPROLOG_STRING_ESCAPE_ERROR); } } else if (sc.Match(ls.closingQuote)) { if (ls.verbatim && ls.closingQuote == sc.chNext) { sc.SetState(SCE_VISUALPROLOG_STRING_ESCAPE); sc.Forward(); } else { ls.closingQuote = 0; sc.SetState(SCE_VISUALPROLOG_STRING_QUOTE); sc.ForwardSetState(SCE_VISUALPROLOG_DEFAULT); } } else if (!ls.verbatim && sc.Match('\\')) { sc.SetState(SCE_VISUALPROLOG_STRING_ESCAPE_ERROR); sc.Forward(); if (sc.MatchLineEnd()) { sc.ForwardSetState(SCE_VISUALPROLOG_DEFAULT); } else { if (sc.Match('"') || sc.Match('\'') || sc.Match('\\') || sc.Match('n') || sc.Match('l') || sc.Match('r') || sc.Match('t')) { sc.ChangeState(SCE_VISUALPROLOG_STRING_ESCAPE); } else if (sc.Match('u')) { if (IsADigit(sc.chNext, 16)) { sc.Forward(); if (IsADigit(sc.chNext, 16)) { sc.Forward(); if (IsADigit(sc.chNext, 16)) { sc.Forward(); if (IsADigit(sc.chNext, 16)) { sc.Forward(); sc.ChangeState(SCE_VISUALPROLOG_STRING_ESCAPE); } } } } } } } break; case SCE_VISUALPROLOG_EMBEDDED: if (sc.Match('|', ']')) { sc.Forward(); ls.leave(lineState::embedded); newState = true; } else if (sc.Match('[', '|')) { sc.Forward(); ls.enter(lineState::embedded); } else if (sc.Match('{', '|') && lineState::comment != ls.currentKind()) { sc.SetState(SCE_VISUALPROLOG_DEFAULT); } else if (sc.Match('/', '*')) { sc.Forward(); ls.enter(lineState::comment); } else if (sc.Match('*', '/')) { sc.Forward(); ls.leave(lineState::comment); newState = true; } break; case SCE_VISUALPROLOG_PLACEHOLDER: if (lineState::embedded == ls.currentKind()) { sc.SetState(SCE_VISUALPROLOG_EMBEDDED); } else { sc.SetState(SCE_VISUALPROLOG_DEFAULT); } break; } if (currentLineEntry != sc.currentLine) { styler.SetLineState(currentLineEntry, ls.getState()); } if (sc.MatchLineEnd() | sc.atLineEnd) { if (sc.More()) { // currentLine can be outside the document styler.SetLineState(sc.currentLine, ls.getState()); } } // Determine if a new state should be entered. if (sc.state == SCE_VISUALPROLOG_DEFAULT) { if (options.verbatimStrings && sc.Match('@') && ls.isOpenStringVerbatim(sc.chNext)) { ls.verbatim = true; sc.SetState(SCE_VISUALPROLOG_STRING_QUOTE); sc.Forward(); } else if (IsADigit(sc.ch) || (sc.Match('.') && IsADigit(sc.chNext))) { sc.SetState(SCE_VISUALPROLOG_NUMBER); } else if (isLowerLetter(sc.ch)) { sc.SetState(SCE_VISUALPROLOG_IDENTIFIER); } else if (isUpperLetter(sc.ch)) { sc.SetState(SCE_VISUALPROLOG_VARIABLE); } else if (sc.Match('_')) { sc.SetState(SCE_VISUALPROLOG_ANONYMOUS); } else if (sc.Match('/', '*')) { sc.SetState(SCE_VISUALPROLOG_COMMENT_BLOCK); ls.enter(lineState::comment); sc.Forward(); } else if (sc.Match('%')) { sc.SetState(SCE_VISUALPROLOG_COMMENT_LINE); } else if (sc.Match('[', '|')) { sc.SetState(SCE_VISUALPROLOG_EMBEDDED); ls.enter(lineState::embedded); sc.Forward(); } else if (sc.Match('{', '|')) { sc.SetState(SCE_VISUALPROLOG_PLACEHOLDER); ls.enter(lineState::placeholder); sc.Forward(); } else if (sc.Match('|', '}')) { sc.SetState(SCE_VISUALPROLOG_PLACEHOLDER); sc.Forward(); if (':' == sc.chNext) { sc.Forward(); for (; isIdChar(sc.chNext); sc.Forward()) { } } ls.leave(lineState::placeholder); newState = true; } else if (sc.Match('\'')) { ls.verbatim = false; ls.closingQuote = '\''; sc.SetState(SCE_VISUALPROLOG_STRING_QUOTE); } else if (sc.Match('"')) { ls.verbatim = false; ls.closingQuote = '"'; sc.SetState(SCE_VISUALPROLOG_STRING_QUOTE); } else if (options.backQuotedStrings && sc.Match('`')) { ls.verbatim = false; ls.closingQuote = '`'; sc.SetState(SCE_VISUALPROLOG_STRING_QUOTE); } else if (sc.Match('#')) { sc.SetState(SCE_VISUALPROLOG_KEY_DIRECTIVE); } else if (isoperator(static_cast(sc.ch)) || sc.Match('\\') || (!options.verbatimStrings && sc.Match('@'))) { sc.SetState(SCE_VISUALPROLOG_OPERATOR); } } } sc.Complete(); styler.Flush(); } // Store both the current line's fold level and the next lines in the // level store to make it easy to pick up with each increment // and to make it possible to fiddle the current level for "} else {". #if defined(__clang__) #if __has_warning("-Wunused-but-set-variable") // Disable warning for visibleChars #pragma clang diagnostic ignored "-Wunused-but-set-variable" #endif #endif void SCI_METHOD LexerVisualProlog::Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument* pAccess) { LexAccessor styler(pAccess); Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position currentLine = styler.GetLine(startPos); int levelCurrent = SC_FOLDLEVELBASE; if (currentLine > 0) levelCurrent = styler.LevelAt(currentLine - 1) >> 16; int levelMinCurrent = levelCurrent; int levelNext = levelCurrent; char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); int style = initStyle; for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); style = styleNext; styleNext = styler.StyleAt(i + 1); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (style == SCE_VISUALPROLOG_OPERATOR) { if (ch == '{') { // Measure the minimum before a '{' to allow // folding on "} else {" if (levelMinCurrent > levelNext) { levelMinCurrent = levelNext; } levelNext++; } else if (ch == '}') { levelNext--; } } if (!IsASpace(ch)) visibleChars++; if (atEOL || (i == endPos - 1)) { int levelUse = levelCurrent; int lev = levelUse | levelNext << 16; if (levelUse < levelNext) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(currentLine)) { styler.SetLevel(currentLine, lev); } currentLine++; levelCurrent = levelNext; levelMinCurrent = levelCurrent; if (atEOL && (i == static_cast(styler.Length() - 1))) { // There is an empty line at end of file so give it same level and empty styler.SetLevel(currentLine, (levelCurrent | levelCurrent << 16) | SC_FOLDLEVELWHITEFLAG); } visibleChars = 0; } } } } LexerModule lmVisualProlog(SCLEX_VISUALPROLOG, LexerVisualProlog::LexerFactoryVisualProlog, "visualprolog", visualPrologWordLists); lexilla/lexers/LexLaTeX.cxx0000664000175000017500000003745114647367374014665 0ustar neilneil// Scintilla source code edit control /** @file LexLaTeX.cxx ** Lexer for LaTeX2e. **/ // Copyright 1998-2001 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. // Modified by G. HU in 2013. Added folding, syntax highting inside math environments, and changed some minor behaviors. #include #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "PropSetSimple.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" #include "DefaultLexer.h" #include "LexerBase.h" using namespace Scintilla; using namespace Lexilla; using namespace std; struct latexFoldSave { latexFoldSave() : structLev(0) { for (int i = 0; i < 8; ++i) openBegins[i] = 0; } latexFoldSave(const latexFoldSave &save) : structLev(save.structLev) { for (int i = 0; i < 8; ++i) openBegins[i] = save.openBegins[i]; } latexFoldSave &operator=(const latexFoldSave &save) { if (this != &save) { structLev = save.structLev; for (int i = 0; i < 8; ++i) openBegins[i] = save.openBegins[i]; } return *this; } int openBegins[8]; Sci_Position structLev; }; class LexerLaTeX : public LexerBase { private: vector modes; void setMode(Sci_Position line, int mode) { if (line >= static_cast(modes.size())) modes.resize(line + 1, 0); modes[line] = mode; } int getMode(Sci_Position line) { if (line >= 0 && line < static_cast(modes.size())) return modes[line]; return 0; } void truncModes(Sci_Position numLines) { if (static_cast(modes.size()) > numLines * 2 + 256) modes.resize(numLines + 128); } vector saves; void setSave(Sci_Position line, const latexFoldSave &save) { if (line >= static_cast(saves.size())) saves.resize(line + 1); saves[line] = save; } void getSave(Sci_Position line, latexFoldSave &save) { if (line >= 0 && line < static_cast(saves.size())) save = saves[line]; else { save.structLev = 0; for (int i = 0; i < 8; ++i) save.openBegins[i] = 0; } } void truncSaves(Sci_Position numLines) { if (static_cast(saves.size()) > numLines * 2 + 256) saves.resize(numLines + 128); } public: static ILexer5 *LexerFactoryLaTeX() { return new LexerLaTeX(); } void SCI_METHOD Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void SCI_METHOD Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; // ILexer5 methods const char * SCI_METHOD GetName() override { return "latex"; } int SCI_METHOD GetIdentifier() override { return SCLEX_LATEX; } }; static bool latexIsSpecial(int ch) { return (ch == '#') || (ch == '$') || (ch == '%') || (ch == '&') || (ch == '_') || (ch == '{') || (ch == '}') || (ch == ' '); } static bool latexIsBlank(int ch) { return (ch == ' ') || (ch == '\t'); } static bool latexIsBlankAndNL(int ch) { return (ch == ' ') || (ch == '\t') || (ch == '\r') || (ch == '\n'); } static bool latexIsLetter(int ch) { return IsASCII(ch) && isalpha(ch); } static bool latexIsTagValid(Sci_Position &i, Sci_Position l, Accessor &styler) { while (i < l) { if (styler.SafeGetCharAt(i) == '{') { while (i < l) { i++; if (styler.SafeGetCharAt(i) == '}') { return true; } else if (!latexIsLetter(styler.SafeGetCharAt(i)) && styler.SafeGetCharAt(i)!='*') { return false; } } } else if (!latexIsBlank(styler.SafeGetCharAt(i))) { return false; } i++; } return false; } static bool latexNextNotBlankIs(Sci_Position i, Accessor &styler, char needle) { char ch; while (i < styler.Length()) { ch = styler.SafeGetCharAt(i); if (!latexIsBlankAndNL(ch) && ch != '*') { if (ch == needle) return true; else return false; } i++; } return false; } static bool latexLastWordIs(Sci_Position start, Accessor &styler, const char *needle) { Sci_PositionU i = 0; Sci_PositionU l = static_cast(strlen(needle)); Sci_Position ini = start-l+1; char s[32]; while (i < l && i < 31) { s[i] = styler.SafeGetCharAt(ini + i); i++; } s[i] = '\0'; return (strcmp(s, needle) == 0); } static bool latexLastWordIsMathEnv(Sci_Position pos, Accessor &styler) { Sci_Position i, j; char s[32]; const char *mathEnvs[] = { "align", "alignat", "flalign", "gather", "multiline", "displaymath", "eqnarray", "equation" }; if (styler.SafeGetCharAt(pos) != '}') return false; for (i = pos - 1; i >= 0; --i) { if (styler.SafeGetCharAt(i) == '{') break; if (pos - i >= 20) return false; } if (i < 0 || i == pos - 1) return false; ++i; for (j = 0; i + j < pos; ++j) s[j] = styler.SafeGetCharAt(i + j); s[j] = '\0'; if (j == 0) return false; if (s[j - 1] == '*') s[--j] = '\0'; for (i = 0; i < static_cast(sizeof(mathEnvs) / sizeof(const char *)); ++i) if (strcmp(s, mathEnvs[i]) == 0) return true; return false; } static inline void latexStateReset(int &mode, int &state) { switch (mode) { case 1: state = SCE_L_MATH; break; case 2: state = SCE_L_MATH2; break; default: state = SCE_L_DEFAULT; break; } } // There are cases not handled correctly, like $abcd\textrm{what is $x+y$}z+w$. // But I think it's already good enough. void SCI_METHOD LexerLaTeX::Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { // startPos is assumed to be the first character of a line Accessor styler(pAccess, &props); styler.StartAt(startPos); int mode = getMode(styler.GetLine(startPos) - 1); int state = initStyle; if (state == SCE_L_ERROR || state == SCE_L_SHORTCMD || state == SCE_L_SPECIAL) // should not happen latexStateReset(mode, state); char chNext = styler.SafeGetCharAt(startPos); char chVerbatimDelim = '\0'; styler.StartSegment(startPos); Sci_Position lengthDoc = startPos + length; for (Sci_Position i = startPos; i < lengthDoc; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); if (styler.IsLeadByte(ch)) { i++; chNext = styler.SafeGetCharAt(i + 1); continue; } if (ch == '\r' || ch == '\n') setMode(styler.GetLine(i), mode); switch (state) { case SCE_L_DEFAULT : switch (ch) { case '\\' : styler.ColourTo(i - 1, state); if (latexIsLetter(chNext)) { state = SCE_L_COMMAND; } else if (latexIsSpecial(chNext)) { styler.ColourTo(i + 1, SCE_L_SPECIAL); i++; chNext = styler.SafeGetCharAt(i + 1); } else if (chNext == '\r' || chNext == '\n') { styler.ColourTo(i, SCE_L_ERROR); } else if (IsASCII(chNext)) { styler.ColourTo(i + 1, SCE_L_SHORTCMD); if (chNext == '(') { mode = 1; state = SCE_L_MATH; } else if (chNext == '[') { mode = 2; state = SCE_L_MATH2; } i++; chNext = styler.SafeGetCharAt(i + 1); } break; case '$' : styler.ColourTo(i - 1, state); if (chNext == '$') { styler.ColourTo(i + 1, SCE_L_SHORTCMD); mode = 2; state = SCE_L_MATH2; i++; chNext = styler.SafeGetCharAt(i + 1); } else { styler.ColourTo(i, SCE_L_SHORTCMD); mode = 1; state = SCE_L_MATH; } break; case '%' : styler.ColourTo(i - 1, state); state = SCE_L_COMMENT; break; } break; // These 3 will never be reached. case SCE_L_ERROR: case SCE_L_SPECIAL: case SCE_L_SHORTCMD: break; case SCE_L_COMMAND : if (!latexIsLetter(chNext)) { styler.ColourTo(i, state); if (latexNextNotBlankIs(i + 1, styler, '[' )) { state = SCE_L_CMDOPT; } else if (latexLastWordIs(i, styler, "\\begin")) { state = SCE_L_TAG; } else if (latexLastWordIs(i, styler, "\\end")) { state = SCE_L_TAG2; } else if (latexLastWordIs(i, styler, "\\verb") && chNext != '*' && chNext != ' ') { chVerbatimDelim = chNext; state = SCE_L_VERBATIM; } else { latexStateReset(mode, state); } } break; case SCE_L_CMDOPT : if (ch == ']') { styler.ColourTo(i, state); latexStateReset(mode, state); } break; case SCE_L_TAG : if (latexIsTagValid(i, lengthDoc, styler)) { styler.ColourTo(i, state); latexStateReset(mode, state); if (latexLastWordIs(i, styler, "{verbatim}")) { state = SCE_L_VERBATIM; } else if (latexLastWordIs(i, styler, "{lstlisting}")) { state = SCE_L_VERBATIM; } else if (latexLastWordIs(i, styler, "{comment}")) { state = SCE_L_COMMENT2; } else if (latexLastWordIs(i, styler, "{math}") && mode == 0) { mode = 1; state = SCE_L_MATH; } else if (latexLastWordIsMathEnv(i, styler) && mode == 0) { mode = 2; state = SCE_L_MATH2; } } else { styler.ColourTo(i, SCE_L_ERROR); latexStateReset(mode, state); ch = styler.SafeGetCharAt(i); if (ch == '\r' || ch == '\n') setMode(styler.GetLine(i), mode); } chNext = styler.SafeGetCharAt(i+1); break; case SCE_L_TAG2 : if (latexIsTagValid(i, lengthDoc, styler)) { styler.ColourTo(i, state); latexStateReset(mode, state); } else { styler.ColourTo(i, SCE_L_ERROR); latexStateReset(mode, state); ch = styler.SafeGetCharAt(i); if (ch == '\r' || ch == '\n') setMode(styler.GetLine(i), mode); } chNext = styler.SafeGetCharAt(i+1); break; case SCE_L_MATH : switch (ch) { case '\\' : styler.ColourTo(i - 1, state); if (latexIsLetter(chNext)) { Sci_Position match = i + 3; if (latexLastWordIs(match, styler, "\\end")) { match++; if (latexIsTagValid(match, lengthDoc, styler)) { if (latexLastWordIs(match, styler, "{math}")) mode = 0; } } state = SCE_L_COMMAND; } else if (latexIsSpecial(chNext)) { styler.ColourTo(i + 1, SCE_L_SPECIAL); i++; chNext = styler.SafeGetCharAt(i + 1); } else if (chNext == '\r' || chNext == '\n') { styler.ColourTo(i, SCE_L_ERROR); } else if (IsASCII(chNext)) { if (chNext == ')') { mode = 0; state = SCE_L_DEFAULT; } styler.ColourTo(i + 1, SCE_L_SHORTCMD); i++; chNext = styler.SafeGetCharAt(i + 1); } break; case '$' : styler.ColourTo(i - 1, state); styler.ColourTo(i, SCE_L_SHORTCMD); mode = 0; state = SCE_L_DEFAULT; break; case '%' : styler.ColourTo(i - 1, state); state = SCE_L_COMMENT; break; } break; case SCE_L_MATH2 : switch (ch) { case '\\' : styler.ColourTo(i - 1, state); if (latexIsLetter(chNext)) { Sci_Position match = i + 3; if (latexLastWordIs(match, styler, "\\end")) { match++; if (latexIsTagValid(match, lengthDoc, styler)) { if (latexLastWordIsMathEnv(match, styler)) mode = 0; } } state = SCE_L_COMMAND; } else if (latexIsSpecial(chNext)) { styler.ColourTo(i + 1, SCE_L_SPECIAL); i++; chNext = styler.SafeGetCharAt(i + 1); } else if (chNext == '\r' || chNext == '\n') { styler.ColourTo(i, SCE_L_ERROR); } else if (IsASCII(chNext)) { if (chNext == ']') { mode = 0; state = SCE_L_DEFAULT; } styler.ColourTo(i + 1, SCE_L_SHORTCMD); i++; chNext = styler.SafeGetCharAt(i + 1); } break; case '$' : styler.ColourTo(i - 1, state); if (chNext == '$') { styler.ColourTo(i + 1, SCE_L_SHORTCMD); i++; chNext = styler.SafeGetCharAt(i + 1); mode = 0; state = SCE_L_DEFAULT; } else { // This may not be an error, e.g. \begin{equation}\text{$a$}\end{equation} styler.ColourTo(i, SCE_L_SHORTCMD); } break; case '%' : styler.ColourTo(i - 1, state); state = SCE_L_COMMENT; break; } break; case SCE_L_COMMENT : if (ch == '\r' || ch == '\n') { styler.ColourTo(i - 1, state); latexStateReset(mode, state); } break; case SCE_L_COMMENT2 : if (ch == '\\') { Sci_Position match = i + 3; if (latexLastWordIs(match, styler, "\\end")) { match++; if (latexIsTagValid(match, lengthDoc, styler)) { if (latexLastWordIs(match, styler, "{comment}")) { styler.ColourTo(i - 1, state); state = SCE_L_COMMAND; } } } } break; case SCE_L_VERBATIM : if (ch == '\\') { Sci_Position match = i + 3; if (latexLastWordIs(match, styler, "\\end")) { match++; if (latexIsTagValid(match, lengthDoc, styler)) { if (latexLastWordIs(match, styler, "{verbatim}")) { styler.ColourTo(i - 1, state); state = SCE_L_COMMAND; } else if (latexLastWordIs(match, styler, "{lstlisting}")) { styler.ColourTo(i - 1, state); state = SCE_L_COMMAND; } } } } else if (chNext == chVerbatimDelim) { styler.ColourTo(i + 1, state); latexStateReset(mode, state); chVerbatimDelim = '\0'; i++; chNext = styler.SafeGetCharAt(i + 1); } else if (chVerbatimDelim != '\0' && (ch == '\n' || ch == '\r')) { styler.ColourTo(i, SCE_L_ERROR); latexStateReset(mode, state); chVerbatimDelim = '\0'; } break; } } if (lengthDoc == styler.Length()) truncModes(styler.GetLine(lengthDoc - 1)); styler.ColourTo(lengthDoc - 1, state); styler.Flush(); } static int latexFoldSaveToInt(const latexFoldSave &save) { int sum = 0; for (int i = 0; i <= save.structLev; ++i) sum += save.openBegins[i]; return ((sum + save.structLev + SC_FOLDLEVELBASE) & SC_FOLDLEVELNUMBERMASK); } // Change folding state while processing a line // Return the level before the first relevant command void SCI_METHOD LexerLaTeX::Fold(Sci_PositionU startPos, Sci_Position length, int, IDocument *pAccess) { const char *structWords[7] = {"part", "chapter", "section", "subsection", "subsubsection", "paragraph", "subparagraph"}; Accessor styler(pAccess, &props); Sci_PositionU endPos = startPos + length; Sci_Position curLine = styler.GetLine(startPos); latexFoldSave save; getSave(curLine - 1, save); do { char ch, buf[16]; Sci_Position i, j; int lev = -1; bool needFold = false; for (i = static_cast(startPos); i < static_cast(endPos); ++i) { ch = styler.SafeGetCharAt(i); if (ch == '\r' || ch == '\n') break; if (ch != '\\' || styler.StyleAt(i) != SCE_L_COMMAND) continue; for (j = 0; j < 15 && i + 1 < static_cast(endPos); ++j, ++i) { buf[j] = styler.SafeGetCharAt(i + 1); if (!latexIsLetter(buf[j])) break; } buf[j] = '\0'; if (strcmp(buf, "begin") == 0) { if (lev < 0) lev = latexFoldSaveToInt(save); ++save.openBegins[save.structLev]; needFold = true; } else if (strcmp(buf, "end") == 0) { while (save.structLev > 0 && save.openBegins[save.structLev] == 0) --save.structLev; if (lev < 0) lev = latexFoldSaveToInt(save); if (save.openBegins[save.structLev] > 0) --save.openBegins[save.structLev]; } else { for (j = 0; j < 7; ++j) if (strcmp(buf, structWords[j]) == 0) break; if (j >= 7) continue; save.structLev = j; // level before the command for (j = save.structLev + 1; j < 8; ++j) { save.openBegins[save.structLev] += save.openBegins[j]; save.openBegins[j] = 0; } if (lev < 0) lev = latexFoldSaveToInt(save); ++save.structLev; // level after the command needFold = true; } } if (lev < 0) lev = latexFoldSaveToInt(save); if (needFold) lev |= SC_FOLDLEVELHEADERFLAG; styler.SetLevel(curLine, lev); setSave(curLine, save); ++curLine; startPos = styler.LineStart(curLine); if (static_cast(startPos) == styler.Length()) { lev = latexFoldSaveToInt(save); styler.SetLevel(curLine, lev); setSave(curLine, save); truncSaves(curLine); } } while (startPos < endPos); styler.Flush(); } static const char *const emptyWordListDesc[] = { 0 }; LexerModule lmLatex(SCLEX_LATEX, LexerLaTeX::LexerFactoryLaTeX, "latex", emptyWordListDesc); lexilla/lexers/LexAsciidoc.cxx0000664000175000017500000003153114647367374015417 0ustar neilneil/****************************************************************** * LexAsciidoc.cxx * * A simple Asciidoc lexer for scintilla. * * Based on the LexMarkdown.cxx by Jon Strait - jstrait@moonloop.net * * The License.txt file describes the conditions under which this * software may be distributed. * *****************************************************************/ #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; namespace { typedef struct { bool start; int len1; int len2; const char *name; } MacroItem; static const MacroItem MacroList[] = { // Directives {true, 5, 2, "ifdef::"}, {true, 6, 2, "ifeval::"}, {true, 6, 2, "ifndef::"}, {true, 5, 2, "endif::"}, // Macros {true, 5, 2, "audio::"}, {true, 7, 2, "include::"}, {true, 5, 2, "image::"}, {true, 5, 2, "video::"}, {false, 8, 1, "asciimath:"}, {false, 3, 1, "btn:"}, {false, 5, 1, "image:"}, {false, 3, 1, "kbd:"}, {false, 9, 1, "latexmath:"}, {false, 4, 1, "link:"}, {false, 6, 1, "mailto:"}, {false, 4, 1, "menu:"}, {false, 4, 1, "pass:"}, {false, 4, 1, "stem:"}, {false, 4, 1, "xref:"}, // Admonitions {true, 7, 1, "CAUTION:"}, {true, 9, 1, "IMPORTANT:"}, {true, 4, 1, "NOTE:"}, {true, 3, 1, "TIP:"}, {true, 7, 1, "WARNING:"}, {false, 0, 0, NULL} }; constexpr bool IsNewline(const int ch) { // sc.GetRelative(i) returns '\0' if out of range return (ch == '\n' || ch == '\r' || ch == '\0'); } } static bool AtTermStart(StyleContext &sc) { return sc.currentPos == 0 || sc.chPrev == 0 || isspacechar(sc.chPrev); } static void ColorizeAsciidocDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList **, Accessor &styler) { bool freezeCursor = false; StyleContext sc(startPos, static_cast(length), initStyle, styler); while (sc.More()) { // Skip past escaped characters if (sc.ch == '\\') { sc.Forward(); continue; } // Skip newline. if (IsNewline(sc.ch)) { // Newline doesn't end blocks if (sc.state != SCE_ASCIIDOC_CODEBK && \ sc.state != SCE_ASCIIDOC_PASSBK && \ sc.state != SCE_ASCIIDOC_COMMENTBK && \ sc.state != SCE_ASCIIDOC_LITERALBK) { sc.SetState(SCE_ASCIIDOC_DEFAULT); } sc.Forward(); continue; } // Conditional state-based actions switch (sc.state) { // Strong case SCE_ASCIIDOC_STRONG1: if (sc.ch == '*' && sc.chPrev != ' ') { sc.Forward(); sc.SetState(SCE_ASCIIDOC_DEFAULT); freezeCursor = true; } break; case SCE_ASCIIDOC_STRONG2: if (sc.Match("**") && sc.chPrev != ' ') { sc.Forward(2); sc.SetState(SCE_ASCIIDOC_DEFAULT); freezeCursor = true; } break; // Emphasis case SCE_ASCIIDOC_EM1: if (sc.ch == '_' && sc.chPrev != ' ') { sc.Forward(); sc.SetState(SCE_ASCIIDOC_DEFAULT); freezeCursor = true; } break; case SCE_ASCIIDOC_EM2: if (sc.Match("__") && sc.chPrev != ' ') { sc.Forward(2); sc.SetState(SCE_ASCIIDOC_DEFAULT); freezeCursor = true; } break; // Link case SCE_ASCIIDOC_LINK: if (sc.ch == ']' && sc.chPrev != '\\') { sc.SetState(SCE_ASCIIDOC_DEFAULT); } break; // Code block case SCE_ASCIIDOC_CODEBK: if (sc.atLineStart && sc.Match("----") && IsNewline(sc.GetRelative(4))) { sc.Forward(4); sc.SetState(SCE_ASCIIDOC_DEFAULT); } break; // Passthrough block case SCE_ASCIIDOC_PASSBK: if (sc.atLineStart && sc.Match("++++") && IsNewline(sc.GetRelative(4))) { sc.Forward(4); sc.SetState(SCE_ASCIIDOC_DEFAULT); } break; // Comment block case SCE_ASCIIDOC_COMMENTBK: if (sc.atLineStart && sc.Match("////") && IsNewline(sc.GetRelative(4))) { sc.Forward(4); sc.SetState(SCE_ASCIIDOC_DEFAULT); } break; // Literal case SCE_ASCIIDOC_LITERAL: if (sc.ch == '+' && sc.chPrev != '\\') { sc.SetState(SCE_ASCIIDOC_DEFAULT); } break; // Literal block case SCE_ASCIIDOC_LITERALBK: if (sc.atLineStart && sc.Match("....") && IsNewline(sc.GetRelative(4))) { sc.Forward(4); sc.SetState(SCE_ASCIIDOC_DEFAULT); } break; // Attribute case SCE_ASCIIDOC_ATTRIB: if (sc.ch == ':' && sc.chPrev != ' ' && sc.chNext == ' ') { sc.Forward(); sc.SetState(SCE_ASCIIDOC_ATTRIBVAL); } break; // Macro case SCE_ASCIIDOC_MACRO: if (sc.ch == ']' && sc.chPrev != '\\') { sc.SetState(SCE_ASCIIDOC_DEFAULT); } break; // Default case SCE_ASCIIDOC_DEFAULT: // Headers if (sc.atLineStart && sc.Match("====== ")) { sc.SetState(SCE_ASCIIDOC_HEADER6); sc.Forward(6); } else if (sc.atLineStart && sc.Match("===== ")) { sc.SetState(SCE_ASCIIDOC_HEADER5); sc.Forward(5); } else if (sc.atLineStart && sc.Match("==== ")) { sc.SetState(SCE_ASCIIDOC_HEADER4); sc.Forward(4); } else if (sc.atLineStart && sc.Match("=== ")) { sc.SetState(SCE_ASCIIDOC_HEADER3); sc.Forward(3); } else if (sc.atLineStart && sc.Match("== ")) { sc.SetState(SCE_ASCIIDOC_HEADER2); sc.Forward(2); } else if (sc.atLineStart && sc.Match("= ")) { sc.SetState(SCE_ASCIIDOC_HEADER1); sc.Forward(1); } // Unordered list item else if (sc.atLineStart && sc.Match("****** ")) { sc.SetState(SCE_ASCIIDOC_ULIST_ITEM); sc.Forward(6); sc.SetState(SCE_ASCIIDOC_DEFAULT); } else if (sc.atLineStart && sc.Match("***** ")) { sc.SetState(SCE_ASCIIDOC_ULIST_ITEM); sc.Forward(5); sc.SetState(SCE_ASCIIDOC_DEFAULT); } else if (sc.atLineStart && sc.Match("**** ")) { sc.SetState(SCE_ASCIIDOC_ULIST_ITEM); sc.Forward(4); sc.SetState(SCE_ASCIIDOC_DEFAULT); } else if (sc.atLineStart && sc.Match("*** ")) { sc.SetState(SCE_ASCIIDOC_ULIST_ITEM); sc.Forward(3); sc.SetState(SCE_ASCIIDOC_DEFAULT); } else if (sc.atLineStart && sc.Match("** ")) { sc.SetState(SCE_ASCIIDOC_ULIST_ITEM); sc.Forward(2); sc.SetState(SCE_ASCIIDOC_DEFAULT); } else if (sc.atLineStart && sc.Match("* ")) { sc.SetState(SCE_ASCIIDOC_ULIST_ITEM); sc.Forward(1); sc.SetState(SCE_ASCIIDOC_DEFAULT); } // Ordered list item else if (sc.atLineStart && sc.Match("...... ")) { sc.SetState(SCE_ASCIIDOC_OLIST_ITEM); sc.Forward(6); sc.SetState(SCE_ASCIIDOC_DEFAULT); } else if (sc.atLineStart && sc.Match("..... ")) { sc.SetState(SCE_ASCIIDOC_OLIST_ITEM); sc.Forward(5); sc.SetState(SCE_ASCIIDOC_DEFAULT); } else if (sc.atLineStart && sc.Match(".... ")) { sc.SetState(SCE_ASCIIDOC_OLIST_ITEM); sc.Forward(4); sc.SetState(SCE_ASCIIDOC_DEFAULT); } else if (sc.atLineStart && sc.Match("... ")) { sc.SetState(SCE_ASCIIDOC_OLIST_ITEM); sc.Forward(3); sc.SetState(SCE_ASCIIDOC_DEFAULT); } else if (sc.atLineStart && sc.Match(".. ")) { sc.SetState(SCE_ASCIIDOC_OLIST_ITEM); sc.Forward(2); sc.SetState(SCE_ASCIIDOC_DEFAULT); } else if (sc.atLineStart && sc.Match(". ")) { sc.SetState(SCE_ASCIIDOC_OLIST_ITEM); sc.Forward(1); sc.SetState(SCE_ASCIIDOC_DEFAULT); } // Blockquote else if (sc.atLineStart && sc.Match("> ")) { sc.SetState(SCE_ASCIIDOC_BLOCKQUOTE); sc.Forward(); } // Link else if (!sc.atLineStart && sc.ch == '[' && sc.chPrev != '\\' && sc.chNext != ' ') { sc.Forward(); sc.SetState(SCE_ASCIIDOC_LINK); freezeCursor = true; } // Code block else if (sc.atLineStart && sc.Match("----") && IsNewline(sc.GetRelative(4))) { sc.SetState(SCE_ASCIIDOC_CODEBK); sc.Forward(4); } // Passthrough block else if (sc.atLineStart && sc.Match("++++") && IsNewline(sc.GetRelative(4))) { sc.SetState(SCE_ASCIIDOC_PASSBK); sc.Forward(4); } // Comment block else if (sc.atLineStart && sc.Match("////") && IsNewline(sc.GetRelative(4))) { sc.SetState(SCE_ASCIIDOC_COMMENTBK); sc.Forward(4); } // Comment else if (sc.atLineStart && sc.Match("//")) { sc.SetState(SCE_ASCIIDOC_COMMENT); sc.Forward(); } // Literal else if (sc.ch == '+' && sc.chPrev != '\\' && sc.chNext != ' ' && AtTermStart(sc)) { sc.Forward(); sc.SetState(SCE_ASCIIDOC_LITERAL); freezeCursor = true; } // Literal block else if (sc.atLineStart && sc.Match("....") && IsNewline(sc.GetRelative(4))) { sc.SetState(SCE_ASCIIDOC_LITERALBK); sc.Forward(4); } // Attribute else if (sc.atLineStart && sc.ch == ':' && sc.chNext != ' ') { sc.SetState(SCE_ASCIIDOC_ATTRIB); } // Strong else if (sc.Match("**") && sc.GetRelative(2) != ' ') { sc.SetState(SCE_ASCIIDOC_STRONG2); sc.Forward(); } else if (sc.ch == '*' && sc.chNext != ' ' && AtTermStart(sc)) { sc.SetState(SCE_ASCIIDOC_STRONG1); } // Emphasis else if (sc.Match("__") && sc.GetRelative(2) != ' ') { sc.SetState(SCE_ASCIIDOC_EM2); sc.Forward(); } else if (sc.ch == '_' && sc.chNext != ' ' && AtTermStart(sc)) { sc.SetState(SCE_ASCIIDOC_EM1); } // Macro else if (sc.atLineStart && sc.ch == '[' && sc.chNext != ' ') { sc.Forward(); sc.SetState(SCE_ASCIIDOC_MACRO); freezeCursor = true; } else { int i = 0; bool found = false; while (!found && MacroList[i].name != NULL) { if (MacroList[i].start) found = sc.atLineStart && sc.Match(MacroList[i].name); else found = sc.Match(MacroList[i].name); if (found) { sc.SetState(SCE_ASCIIDOC_MACRO); sc.Forward(MacroList[i].len1); sc.SetState(SCE_ASCIIDOC_DEFAULT); if (MacroList[i].len2 > 1) sc.Forward(MacroList[i].len2 - 1); } i++; } } break; } // Advance if not holding back the cursor for this iteration. if (!freezeCursor) sc.Forward(); freezeCursor = false; } sc.Complete(); } LexerModule lmAsciidoc(SCLEX_ASCIIDOC, ColorizeAsciidocDoc, "asciidoc"); lexilla/lexers/LexSmalltalk.cxx0000664000175000017500000002147414647367374015632 0ustar neilneil// Scintilla source code edit control /** @file LexSmalltalk.cxx ** Lexer for Smalltalk language. ** Written by Sergey Philippov, sphilippov-at-gmail-dot-com **/ // Copyright 1998-2002 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; /* | lexTable classificationBlock charClasses | charClasses := #(#DecDigit #Letter #Special #Upper #BinSel). lexTable := ByteArray new: 128. classificationBlock := [ :charClass :chars | | flag | flag := 1 bitShift: (charClasses indexOf: charClass) - 1. chars do: [ :char | lexTable at: char codePoint + 1 put: ((lexTable at: char codePoint + 1) bitOr: flag)]]. classificationBlock value: #DecDigit value: '0123456789'; value: #Letter value: '_abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ'; value: #Special value: '()[]{};.^:'; value: #BinSel value: '~@%&*-+=|\/,<>?!'; value: #Upper value: 'ABCDEFGHIJKLMNOPQRSTUVWXYZ'. ((String new: 500) streamContents: [ :stream | stream crLf; nextPutAll: 'static int ClassificationTable[256] = {'. lexTable keysAndValuesDo: [ :index :value | ((index - 1) rem: 16) == 0 ifTrue: [ stream crLf; tab] ifFalse: [ stream space]. stream print: value. index ~= 256 ifTrue: [ stream nextPut: $,]]. stream crLf; nextPutAll: '};'; crLf. charClasses keysAndValuesDo: [ :index :name | stream crLf; nextPutAll: ( ('static inline bool is<1s>(int ch) {return (ch > 0) && (ch %< 0x80) && ((ClassificationTable[ch] & <2p>) != 0);}') expandMacrosWith: name with: (1 bitShift: (index - 1))) ]]) edit */ // autogenerated {{{{ static int ClassificationTable[256] = { 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 16, 0, 0, 0, 16, 16, 0, 4, 4, 16, 16, 16, 16, 4, 16, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 4, 4, 16, 16, 16, 16, 16, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 4, 16, 4, 4, 2, 0, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 4, 16, 4, 16, 0, }; static inline bool isDecDigit(int ch) {return (ch > 0) && (ch < 0x80) && ((ClassificationTable[ch] & 1) != 0);} static inline bool isLetter(int ch) {return (ch > 0) && (ch < 0x80) && ((ClassificationTable[ch] & 2) != 0);} static inline bool isSpecial(int ch) {return (ch > 0) && (ch < 0x80) && ((ClassificationTable[ch] & 4) != 0);} static inline bool isUpper(int ch) {return (ch > 0) && (ch < 0x80) && ((ClassificationTable[ch] & 8) != 0);} static inline bool isBinSel(int ch) {return (ch > 0) && (ch < 0x80) && ((ClassificationTable[ch] & 16) != 0);} // autogenerated }}}} static inline bool isAlphaNumeric(int ch) { return isDecDigit(ch) || isLetter(ch); } static inline bool isDigitOfRadix(int ch, int radix) { if (isDecDigit(ch)) return (ch - '0') < radix; else if (!isUpper(ch)) return false; else return (ch - 'A' + 10) < radix; } static inline void skipComment(StyleContext& sc) { while (sc.More() && sc.ch != '\"') sc.Forward(); } static inline void skipString(StyleContext& sc) { while (sc.More()) { if (sc.ch == '\'') { if (sc.chNext != '\'') return; sc.Forward(); } sc.Forward(); } } static void handleHash(StyleContext& sc) { if (isSpecial(sc.chNext)) { sc.SetState(SCE_ST_SPECIAL); return; } sc.SetState(SCE_ST_SYMBOL); sc.Forward(); if (sc.ch == '\'') { sc.Forward(); skipString(sc); } else { if (isLetter(sc.ch)) { while (isAlphaNumeric(sc.chNext) || sc.chNext == ':') sc.Forward(); } else if (isBinSel(sc.ch)) { while (isBinSel(sc.chNext)) sc.Forward(); } } } static inline void handleSpecial(StyleContext& sc) { if (sc.ch == ':' && sc.chNext == '=') { sc.SetState(SCE_ST_ASSIGN); sc.Forward(); } else { if (sc.ch == '^') sc.SetState(SCE_ST_RETURN); else sc.SetState(SCE_ST_SPECIAL); } } static inline void skipInt(StyleContext& sc, int radix) { while (isDigitOfRadix(sc.chNext, radix)) sc.Forward(); } static void handleNumeric(StyleContext& sc) { char num[256]; int nl; int radix; sc.SetState(SCE_ST_NUMBER); num[0] = static_cast(sc.ch); nl = 1; while (isDecDigit(sc.chNext)) { num[nl++] = static_cast(sc.chNext); sc.Forward(); if (nl+1 == sizeof(num)/sizeof(num[0])) // overrun check break; } if (sc.chNext == 'r') { num[nl] = 0; if (num[0] == '-') radix = atoi(num + 1); else radix = atoi(num); sc.Forward(); if (sc.chNext == '-') sc.Forward(); skipInt(sc, radix); } else radix = 10; if (sc.chNext != '.' || !isDigitOfRadix(sc.GetRelative(2), radix)) return; sc.Forward(); skipInt(sc, radix); if (sc.chNext == 's') { // ScaledDecimal sc.Forward(); while (isDecDigit(sc.chNext)) sc.Forward(); return; } else if (sc.chNext != 'e' && sc.chNext != 'd' && sc.chNext != 'q') return; sc.Forward(); if (sc.chNext == '+' || sc.chNext == '-') sc.Forward(); skipInt(sc, radix); } static inline void handleBinSel(StyleContext& sc) { sc.SetState(SCE_ST_BINARY); while (isBinSel(sc.chNext)) sc.Forward(); } static void handleLetter(StyleContext& sc, WordList* specialSelectorList) { char ident[256]; int il; int state; bool doubleColonPresent; sc.SetState(SCE_ST_DEFAULT); ident[0] = static_cast(sc.ch); il = 1; while (isAlphaNumeric(sc.chNext)) { ident[il++] = static_cast(sc.chNext); sc.Forward(); if (il+2 == sizeof(ident)/sizeof(ident[0])) // overrun check break; } if (sc.chNext == ':') { doubleColonPresent = true; ident[il++] = ':'; sc.Forward(); } else doubleColonPresent = false; ident[il] = 0; if (specialSelectorList->InList(ident)) state = SCE_ST_SPEC_SEL; else if (doubleColonPresent) state = SCE_ST_KWSEND; else if (isUpper(ident[0])) state = SCE_ST_GLOBAL; else { if (!strcmp(ident, "self")) state = SCE_ST_SELF; else if (!strcmp(ident, "super")) state = SCE_ST_SUPER; else if (!strcmp(ident, "nil")) state = SCE_ST_NIL; else if (!strcmp(ident, "true") || !strcmp(ident, "false")) state = SCE_ST_BOOL; else state = SCE_ST_DEFAULT; } sc.ChangeState(state); } static void colorizeSmalltalkDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *wordLists[], Accessor &styler) { StyleContext sc(startPos, length, initStyle, styler); if (initStyle == SCE_ST_COMMENT) { skipComment(sc); if (sc.More()) sc.Forward(); } else if (initStyle == SCE_ST_STRING) { skipString(sc); if (sc.More()) sc.Forward(); } for (; sc.More(); sc.Forward()) { int ch; ch = sc.ch; if (ch == '\"') { sc.SetState(SCE_ST_COMMENT); sc.Forward(); skipComment(sc); } else if (ch == '\'') { sc.SetState(SCE_ST_STRING); sc.Forward(); skipString(sc); } else if (ch == '#') handleHash(sc); else if (ch == '$') { sc.SetState(SCE_ST_CHARACTER); sc.Forward(); } else if (isSpecial(ch)) handleSpecial(sc); else if (isDecDigit(ch)) handleNumeric(sc); else if (isLetter(ch)) handleLetter(sc, wordLists[0]); else if (isBinSel(ch)) { if (ch == '-' && isDecDigit(sc.chNext)) handleNumeric(sc); else handleBinSel(sc); } else sc.SetState(SCE_ST_DEFAULT); } sc.Complete(); } static const char* const smalltalkWordListDesc[] = { "Special selectors", 0 }; LexerModule lmSmalltalk(SCLEX_SMALLTALK, colorizeSmalltalkDoc, "smalltalk", NULL, smalltalkWordListDesc); lexilla/lexers/LexForth.cxx0000664000175000017500000001235614647367374014767 0ustar neilneil// Scintilla source code edit control /** @file LexForth.cxx ** Lexer for FORTH **/ // Copyright 1998-2003 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static inline bool IsAWordStart(int ch) { return (ch < 0x80) && (isalnum(ch) || ch == '_' || ch == '.'); } static inline bool IsANumChar(int ch) { return (ch < 0x80) && (isxdigit(ch) || ch == '.' || ch == 'e' || ch == 'E' ); } static inline bool IsASpaceChar(int ch) { return (ch < 0x80) && isspace(ch); } static void ColouriseForthDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordLists[], Accessor &styler) { WordList &control = *keywordLists[0]; WordList &keyword = *keywordLists[1]; WordList &defword = *keywordLists[2]; WordList &preword1 = *keywordLists[3]; WordList &preword2 = *keywordLists[4]; WordList &strings = *keywordLists[5]; StyleContext sc(startPos, length, initStyle, styler); for (; sc.More(); sc.Forward()) { // Determine if the current state should terminate. if (sc.state == SCE_FORTH_COMMENT) { if (sc.atLineEnd) { sc.SetState(SCE_FORTH_DEFAULT); } }else if (sc.state == SCE_FORTH_COMMENT_ML) { if (sc.ch == ')') { sc.ForwardSetState(SCE_FORTH_DEFAULT); } }else if (sc.state == SCE_FORTH_IDENTIFIER || sc.state == SCE_FORTH_NUMBER) { // handle numbers here too, because what we thought was a number might // turn out to be a keyword e.g. 2DUP if (IsASpaceChar(sc.ch) ) { char s[100]; sc.GetCurrentLowered(s, sizeof(s)); int newState = sc.state == SCE_FORTH_NUMBER ? SCE_FORTH_NUMBER : SCE_FORTH_DEFAULT; if (control.InList(s)) { sc.ChangeState(SCE_FORTH_CONTROL); } else if (keyword.InList(s)) { sc.ChangeState(SCE_FORTH_KEYWORD); } else if (defword.InList(s)) { sc.ChangeState(SCE_FORTH_DEFWORD); } else if (preword1.InList(s)) { sc.ChangeState(SCE_FORTH_PREWORD1); } else if (preword2.InList(s)) { sc.ChangeState(SCE_FORTH_PREWORD2); } else if (strings.InList(s)) { sc.ChangeState(SCE_FORTH_STRING); newState = SCE_FORTH_STRING; } sc.SetState(newState); } if (sc.state == SCE_FORTH_NUMBER) { if (IsASpaceChar(sc.ch)) { sc.SetState(SCE_FORTH_DEFAULT); } else if (!IsANumChar(sc.ch)) { sc.ChangeState(SCE_FORTH_IDENTIFIER); } } }else if (sc.state == SCE_FORTH_STRING) { if (sc.ch == '\"') { sc.ForwardSetState(SCE_FORTH_DEFAULT); } }else if (sc.state == SCE_FORTH_LOCALE) { if (sc.ch == '}') { sc.ForwardSetState(SCE_FORTH_DEFAULT); } }else if (sc.state == SCE_FORTH_DEFWORD) { if (IsASpaceChar(sc.ch)) { sc.SetState(SCE_FORTH_DEFAULT); } } // Determine if a new state should be entered. if (sc.state == SCE_FORTH_DEFAULT) { if (sc.ch == '\\'){ sc.SetState(SCE_FORTH_COMMENT); } else if (sc.ch == '(' && (sc.atLineStart || IsASpaceChar(sc.chPrev)) && (sc.atLineEnd || IsASpaceChar(sc.chNext))) { sc.SetState(SCE_FORTH_COMMENT_ML); } else if ( (sc.ch == '$' && (IsASCII(sc.chNext) && isxdigit(sc.chNext))) ) { // number starting with $ is a hex number sc.SetState(SCE_FORTH_NUMBER); while(sc.More() && IsASCII(sc.chNext) && isxdigit(sc.chNext)) sc.Forward(); } else if ( (sc.ch == '%' && (IsASCII(sc.chNext) && (sc.chNext == '0' || sc.chNext == '1'))) ) { // number starting with % is binary sc.SetState(SCE_FORTH_NUMBER); while(sc.More() && IsASCII(sc.chNext) && (sc.chNext == '0' || sc.chNext == '1')) sc.Forward(); } else if ( IsASCII(sc.ch) && (isxdigit(sc.ch) || ((sc.ch == '.' || sc.ch == '-') && IsASCII(sc.chNext) && isxdigit(sc.chNext)) ) ){ sc.SetState(SCE_FORTH_NUMBER); } else if (IsAWordStart(sc.ch)) { sc.SetState(SCE_FORTH_IDENTIFIER); } else if (sc.ch == '{') { sc.SetState(SCE_FORTH_LOCALE); } else if (sc.ch == ':' && IsASCII(sc.chNext) && isspace(sc.chNext)) { // highlight word definitions e.g. : GCD ( n n -- n ) ..... ; // ^ ^^^ sc.SetState(SCE_FORTH_DEFWORD); while(sc.More() && IsASCII(sc.chNext) && isspace(sc.chNext)) sc.Forward(); } else if (sc.ch == ';' && (sc.atLineStart || IsASpaceChar(sc.chPrev)) && (sc.atLineEnd || IsASpaceChar(sc.chNext)) ) { // mark the ';' that ends a word sc.SetState(SCE_FORTH_DEFWORD); sc.ForwardSetState(SCE_FORTH_DEFAULT); } } } sc.Complete(); } static void FoldForthDoc(Sci_PositionU, Sci_Position, int, WordList *[], Accessor &) { } static const char * const forthWordLists[] = { "control keywords", "keywords", "definition words", "prewords with one argument", "prewords with two arguments", "string definition keywords", 0, }; LexerModule lmForth(SCLEX_FORTH, ColouriseForthDoc, "forth", FoldForthDoc, forthWordLists); lexilla/lexers/LexAVE.cxx0000664000175000017500000001522214647367374014313 0ustar neilneil// SciTE - Scintilla based Text Editor /** @file LexAVE.cxx ** Lexer for Avenue. ** ** Written by Alexey Yutkin . **/ // Copyright 1998-2002 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static inline bool IsAWordChar(const int ch) { return (ch < 0x80) && (isalnum(ch) || ch == '.' || ch == '_'); } static inline bool IsEnumChar(const int ch) { return (ch < 0x80) && (isalnum(ch)|| ch == '_'); } static inline bool IsANumberChar(const int ch) { return (ch < 0x80) && (isalnum(ch) || ch == '.' ); } inline bool IsAWordStart(const int ch) { return (ch < 0x80) && (isalnum(ch) || ch == '_'); } inline bool isAveOperator(char ch) { if (IsASCII(ch) && isalnum(ch)) return false; // '.' left out as it is used to make up numbers if (ch == '*' || ch == '/' || ch == '-' || ch == '+' || ch == '(' || ch == ')' || ch == '=' || ch == '{' || ch == '}' || ch == '[' || ch == ']' || ch == ';' || ch == '<' || ch == '>' || ch == ',' || ch == '.' ) return true; return false; } static void ColouriseAveDoc( Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { WordList &keywords = *keywordlists[0]; WordList &keywords2 = *keywordlists[1]; WordList &keywords3 = *keywordlists[2]; WordList &keywords4 = *keywordlists[3]; WordList &keywords5 = *keywordlists[4]; WordList &keywords6 = *keywordlists[5]; // Do not leak onto next line if (initStyle == SCE_AVE_STRINGEOL) { initStyle = SCE_AVE_DEFAULT; } StyleContext sc(startPos, length, initStyle, styler); for (; sc.More(); sc.Forward()) { if (sc.atLineEnd) { // Update the line state, so it can be seen by next line Sci_Position currentLine = styler.GetLine(sc.currentPos); styler.SetLineState(currentLine, 0); } if (sc.atLineStart && (sc.state == SCE_AVE_STRING)) { // Prevent SCE_AVE_STRINGEOL from leaking back to previous line sc.SetState(SCE_AVE_STRING); } // Determine if the current state should terminate. if (sc.state == SCE_AVE_OPERATOR) { sc.SetState(SCE_AVE_DEFAULT); } else if (sc.state == SCE_AVE_NUMBER) { if (!IsANumberChar(sc.ch)) { sc.SetState(SCE_AVE_DEFAULT); } } else if (sc.state == SCE_AVE_ENUM) { if (!IsEnumChar(sc.ch)) { sc.SetState(SCE_AVE_DEFAULT); } } else if (sc.state == SCE_AVE_IDENTIFIER) { if (!IsAWordChar(sc.ch) || (sc.ch == '.')) { char s[100]; //sc.GetCurrent(s, sizeof(s)); sc.GetCurrentLowered(s, sizeof(s)); if (keywords.InList(s)) { sc.ChangeState(SCE_AVE_WORD); } else if (keywords2.InList(s)) { sc.ChangeState(SCE_AVE_WORD2); } else if (keywords3.InList(s)) { sc.ChangeState(SCE_AVE_WORD3); } else if (keywords4.InList(s)) { sc.ChangeState(SCE_AVE_WORD4); } else if (keywords5.InList(s)) { sc.ChangeState(SCE_AVE_WORD5); } else if (keywords6.InList(s)) { sc.ChangeState(SCE_AVE_WORD6); } sc.SetState(SCE_AVE_DEFAULT); } } else if (sc.state == SCE_AVE_COMMENT) { if (sc.atLineEnd) { sc.SetState(SCE_AVE_DEFAULT); } } else if (sc.state == SCE_AVE_STRING) { if (sc.ch == '\"') { sc.ForwardSetState(SCE_AVE_DEFAULT); } else if (sc.atLineEnd) { sc.ChangeState(SCE_AVE_STRINGEOL); sc.ForwardSetState(SCE_AVE_DEFAULT); } } // Determine if a new state should be entered. if (sc.state == SCE_AVE_DEFAULT) { if (IsADigit(sc.ch) || (sc.ch == '.' && IsADigit(sc.chNext))) { sc.SetState(SCE_AVE_NUMBER); } else if (IsAWordStart(sc.ch)) { sc.SetState(SCE_AVE_IDENTIFIER); } else if (sc.Match('\"')) { sc.SetState(SCE_AVE_STRING); } else if (sc.Match('\'')) { sc.SetState(SCE_AVE_COMMENT); sc.Forward(); } else if (isAveOperator(static_cast(sc.ch))) { sc.SetState(SCE_AVE_OPERATOR); } else if (sc.Match('#')) { sc.SetState(SCE_AVE_ENUM); sc.Forward(); } } } sc.Complete(); } static void FoldAveDoc(Sci_PositionU startPos, Sci_Position length, int /* initStyle */, WordList *[], Accessor &styler) { Sci_PositionU lengthDoc = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelPrev = styler.LevelAt(lineCurrent) & SC_FOLDLEVELNUMBERMASK; int levelCurrent = levelPrev; char chNext = static_cast(tolower(styler[startPos])); bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; int styleNext = styler.StyleAt(startPos); char s[10] = ""; for (Sci_PositionU i = startPos; i < lengthDoc; i++) { char ch = static_cast(tolower(chNext)); chNext = static_cast(tolower(styler.SafeGetCharAt(i + 1))); int style = styleNext; styleNext = styler.StyleAt(i + 1); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (style == SCE_AVE_WORD) { if (ch == 't' || ch == 'f' || ch == 'w' || ch == 'e') { for (unsigned int j = 0; j < 6; j++) { if (!iswordchar(styler[i + j])) { break; } s[j] = static_cast(tolower(styler[i + j])); s[j + 1] = '\0'; } if ((strcmp(s, "then") == 0) || (strcmp(s, "for") == 0) || (strcmp(s, "while") == 0)) { levelCurrent++; } if ((strcmp(s, "end") == 0) || (strcmp(s, "elseif") == 0)) { // Normally "elseif" and "then" will be on the same line and will cancel // each other out. // As implemented, this does not support fold.at.else. levelCurrent--; } } } else if (style == SCE_AVE_OPERATOR) { if (ch == '{' || ch == '(') { levelCurrent++; } else if (ch == '}' || ch == ')') { levelCurrent--; } } if (atEOL) { int lev = levelPrev; if (visibleChars == 0 && foldCompact) { lev |= SC_FOLDLEVELWHITEFLAG; } if ((levelCurrent > levelPrev) && (visibleChars > 0)) { lev |= SC_FOLDLEVELHEADERFLAG; } if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelPrev = levelCurrent; visibleChars = 0; } if (!isspacechar(ch)) { visibleChars++; } } // Fill in the real level of the next line, keeping the current flags as they will be filled in later int flagsNext = styler.LevelAt(lineCurrent) & ~SC_FOLDLEVELNUMBERMASK; styler.SetLevel(lineCurrent, levelPrev | flagsNext); } LexerModule lmAVE(SCLEX_AVE, ColouriseAveDoc, "ave", FoldAveDoc); lexilla/lexers/LexSAS.cxx0000664000175000017500000001724314647367374014333 0ustar neilneil// Scintilla source code edit control /** @file LexSAS.cxx ** Lexer for SAS **/ // Author: Luke Rasmussen (luke.rasmussen@gmail.com) // // The License.txt file describes the conditions under which this software may // be distributed. // // Developed as part of the StatTag project at Northwestern University Feinberg // School of Medicine with funding from Northwestern University Clinical and // Translational Sciences Institute through CTSA grant UL1TR001422. This work // has not been reviewed or endorsed by NCATS or the NIH. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static void ColouriseSASDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { WordList &keywords = *keywordlists[0]; WordList &blockKeywords = *keywordlists[1]; WordList &functionKeywords = *keywordlists[2]; WordList &statements = *keywordlists[3]; CharacterSet setCouldBePostOp(CharacterSet::setNone, "+-"); CharacterSet setMacroStart(CharacterSet::setNone, "%"); CharacterSet setWordStart(CharacterSet::setAlpha, "_", 0x80, true); CharacterSet setWord(CharacterSet::setAlphaNum, "._", 0x80, true); StyleContext sc(startPos, length, initStyle, styler); bool lineHasNonCommentChar = false; for (; sc.More(); sc.Forward()) { if (sc.atLineStart) { lineHasNonCommentChar = false; } // Determine if the current state should terminate. switch (sc.state) { case SCE_SAS_OPERATOR: sc.SetState(SCE_SAS_DEFAULT); break; case SCE_SAS_NUMBER: // We accept almost anything because of hex. and number suffixes if (!setWord.Contains(sc.ch)) { sc.SetState(SCE_SAS_DEFAULT); } break; case SCE_SAS_MACRO: if (!setWord.Contains(sc.ch) || (sc.ch == '.')) { char s[1000]; sc.GetCurrentLowered(s, sizeof(s)); if (keywords.InList(s)) { sc.ChangeState(SCE_SAS_MACRO_KEYWORD); } else if (blockKeywords.InList(s)) { sc.ChangeState(SCE_SAS_BLOCK_KEYWORD); } else if (functionKeywords.InList(s)) { sc.ChangeState(SCE_SAS_MACRO_FUNCTION); } sc.SetState(SCE_SAS_DEFAULT); } break; case SCE_SAS_IDENTIFIER: if (!setWord.Contains(sc.ch) || (sc.ch == '.')) { char s[1000]; sc.GetCurrentLowered(s, sizeof(s)); if (statements.InList(s)) { sc.ChangeState(SCE_SAS_STATEMENT); } else if(blockKeywords.InList(s)) { sc.ChangeState(SCE_SAS_BLOCK_KEYWORD); } sc.SetState(SCE_SAS_DEFAULT); } break; case SCE_SAS_COMMENTBLOCK: if (sc.Match('*', '/')) { sc.Forward(); sc.ForwardSetState(SCE_SAS_DEFAULT); } break; case SCE_SAS_COMMENT: case SCE_SAS_COMMENTLINE: if (sc.Match(';')) { sc.Forward(); sc.SetState(SCE_SAS_DEFAULT); } break; case SCE_SAS_STRING: if (sc.ch == '\"') { sc.ForwardSetState(SCE_SAS_DEFAULT); } break; } // Determine if a new state should be entered. if (sc.state == SCE_SAS_DEFAULT) { if (IsADigit(sc.ch) || (sc.ch == '.' && IsADigit(sc.chNext))) { lineHasNonCommentChar = true; sc.SetState(SCE_SAS_NUMBER); } else if (setWordStart.Contains(sc.ch)) { lineHasNonCommentChar = true; sc.SetState(SCE_SAS_IDENTIFIER); } else if (sc.Match('*') && !lineHasNonCommentChar) { sc.SetState(SCE_SAS_COMMENT); } else if (sc.Match('/', '*')) { sc.SetState(SCE_SAS_COMMENTBLOCK); sc.Forward(); // Eat the * so it isn't used for the end of the comment } else if (sc.Match('/', '/')) { sc.SetState(SCE_SAS_COMMENTLINE); } else if (sc.ch == '\"') { lineHasNonCommentChar = true; sc.SetState(SCE_SAS_STRING); } else if (setMacroStart.Contains(sc.ch)) { lineHasNonCommentChar = true; sc.SetState(SCE_SAS_MACRO); } else if (isoperator(static_cast(sc.ch))) { lineHasNonCommentChar = true; sc.SetState(SCE_SAS_OPERATOR); } } } sc.Complete(); } // Store both the current line's fold level and the next lines in the // level store to make it easy to pick up with each increment // and to make it possible to fiddle the current level for "} else {". static void FoldSASDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; bool foldAtElse = styler.GetPropertyInt("fold.at.else", 0) != 0; Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelCurrent = SC_FOLDLEVELBASE; if (lineCurrent > 0) levelCurrent = styler.LevelAt(lineCurrent - 1) >> 16; int levelMinCurrent = levelCurrent; int levelNext = levelCurrent; char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); int style = styleNext; styleNext = styler.StyleAt(i + 1); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (style == SCE_R_OPERATOR) { if (ch == '{') { // Measure the minimum before a '{' to allow // folding on "} else {" if (levelMinCurrent > levelNext) { levelMinCurrent = levelNext; } levelNext++; } else if (ch == '}') { levelNext--; } } if (atEOL) { int levelUse = levelCurrent; if (foldAtElse) { levelUse = levelMinCurrent; } int lev = levelUse | levelNext << 16; if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if (levelUse < levelNext) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelCurrent = levelNext; levelMinCurrent = levelCurrent; visibleChars = 0; } if (!isspacechar(ch)) visibleChars++; } } static const char * const SASWordLists[] = { "Language Keywords", "Macro Keywords", "Types", 0, }; LexerModule lmSAS(SCLEX_SAS, ColouriseSASDoc, "sas", FoldSASDoc, SASWordLists); lexilla/lexers/LexJulia.cxx0000664000175000017500000012264014647367374014747 0ustar neilneil// Scintilla source code edit control // Encoding: UTF-8 /** @file LexJulia.cxx ** Lexer for Julia. ** Reusing code from LexMatlab, LexPython and LexRust ** ** Written by Bertrand Lacoste ** **/ // Copyright 1998-2001 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "StringCopy.h" #include "PropSetSimple.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "CharacterCategory.h" #include "LexerModule.h" #include "OptionSet.h" #include "DefaultLexer.h" using namespace Scintilla; using namespace Lexilla; static const int MAX_JULIA_IDENT_CHARS = 1023; // Options used for LexerJulia struct OptionsJulia { bool fold; bool foldComment; bool foldCompact; bool foldDocstring; bool foldSyntaxBased; bool highlightTypeannotation; bool highlightLexerror; OptionsJulia() { fold = true; foldComment = true; foldCompact = false; foldDocstring = true; foldSyntaxBased = true; highlightTypeannotation = false; highlightLexerror = false; } }; const char * const juliaWordLists[] = { "Primary keywords and identifiers", "Built in types", "Other keywords", "Built in functions", 0, }; struct OptionSetJulia : public OptionSet { OptionSetJulia() { DefineProperty("fold", &OptionsJulia::fold); DefineProperty("fold.compact", &OptionsJulia::foldCompact); DefineProperty("fold.comment", &OptionsJulia::foldComment); DefineProperty("fold.julia.docstring", &OptionsJulia::foldDocstring, "Fold multiline triple-doublequote strings, usually used to document a function or type above the definition."); DefineProperty("fold.julia.syntax.based", &OptionsJulia::foldSyntaxBased, "Set this property to 0 to disable syntax based folding."); DefineProperty("lexer.julia.highlight.typeannotation", &OptionsJulia::highlightTypeannotation, "This option enables highlighting of the type identifier after `::`."); DefineProperty("lexer.julia.highlight.lexerror", &OptionsJulia::highlightLexerror, "This option enables highlighting of syntax error int character or number definition."); DefineWordListSets(juliaWordLists); } }; LexicalClass juliaLexicalClasses[] = { // Lexer Julia SCLEX_JULIA SCE_JULIA_: 0, "SCE_JULIA_DEFAULT", "default", "White space", 1, "SCE_JULIA_COMMENT", "comment", "Comment", 2, "SCE_JULIA_NUMBER", "literal numeric", "Number", 3, "SCE_JULIA_KEYWORD1", "keyword", "Reserved keywords", 4, "SCE_JULIA_KEYWORD2", "identifier", "Builtin type names", 5, "SCE_JULIA_KEYWORD3", "identifier", "Constants", 6, "SCE_JULIA_CHAR", "literal string character", "Single quoted string", 7, "SCE_JULIA_OPERATOR", "operator", "Operator", 8, "SCE_JULIA_BRACKET", "bracket operator", "Bracket operator", 9, "SCE_JULIA_IDENTIFIER", "identifier", "Identifier", 10, "SCE_JULIA_STRING", "literal string", "Double quoted String", 11, "SCE_JULIA_SYMBOL", "literal string symbol", "Symbol", 12, "SCE_JULIA_MACRO", "macro preprocessor", "Macro", 13, "SCE_JULIA_STRINGINTERP", "literal string interpolated", "String interpolation", 14, "SCE_JULIA_DOCSTRING", "literal string documentation", "Docstring", 15, "SCE_JULIA_STRINGLITERAL", "literal string", "String literal prefix", 16, "SCE_JULIA_COMMAND", "literal string command", "Command", 17, "SCE_JULIA_COMMANDLITERAL", "literal string command", "Command literal prefix", 18, "SCE_JULIA_TYPEANNOT", "identifier type", "Type annotation identifier", 19, "SCE_JULIA_LEXERROR", "lexer error", "Lexing error", 20, "SCE_JULIA_KEYWORD4", "identifier", "Builtin function names", 21, "SCE_JULIA_TYPEOPERATOR", "operator type", "Type annotation operator", }; class LexerJulia : public DefaultLexer { WordList keywords; WordList identifiers2; WordList identifiers3; WordList identifiers4; OptionsJulia options; OptionSetJulia osJulia; public: explicit LexerJulia() : DefaultLexer("julia", SCLEX_JULIA, juliaLexicalClasses, ELEMENTS(juliaLexicalClasses)) { } virtual ~LexerJulia() { } void SCI_METHOD Release() override { delete this; } int SCI_METHOD Version() const override { return lvRelease5; } const char * SCI_METHOD PropertyNames() override { return osJulia.PropertyNames(); } int SCI_METHOD PropertyType(const char *name) override { return osJulia.PropertyType(name); } const char * SCI_METHOD DescribeProperty(const char *name) override { return osJulia.DescribeProperty(name); } Sci_Position SCI_METHOD PropertySet(const char *key, const char *val) override; const char * SCI_METHOD PropertyGet(const char *key) override { return osJulia.PropertyGet(key); } const char * SCI_METHOD DescribeWordListSets() override { return osJulia.DescribeWordListSets(); } Sci_Position SCI_METHOD WordListSet(int n, const char *wl) override; void SCI_METHOD Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void SCI_METHOD Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void * SCI_METHOD PrivateCall(int, void *) override { return 0; } static ILexer5 *LexerFactoryJulia() { return new LexerJulia(); } }; Sci_Position SCI_METHOD LexerJulia::PropertySet(const char *key, const char *val) { if (osJulia.PropertySet(&options, key, val)) { return 0; } return -1; } Sci_Position SCI_METHOD LexerJulia::WordListSet(int n, const char *wl) { WordList *wordListN = nullptr; switch (n) { case 0: wordListN = &keywords; break; case 1: wordListN = &identifiers2; break; case 2: wordListN = &identifiers3; break; case 3: wordListN = &identifiers4; break; } Sci_Position firstModification = -1; if (wordListN) { if (wordListN->Set(wl)) { firstModification = 0; } } return firstModification; } static inline bool IsJuliaOperator(int ch) { if (ch == '%' || ch == '^' || ch == '&' || ch == '*' || ch == '-' || ch == '+' || ch == '=' || ch == '|' || ch == '<' || ch == '>' || ch == '/' || ch == '~' || ch == '\\' ) { return true; } return false; } // The list contains non-ascii unary operators static inline bool IsJuliaUnaryOperator (int ch) { if (ch == 0x00ac || ch == 0x221a || ch == 0x221b || ch == 0x221c || ch == 0x22c6 || ch == 0x00b1 || ch == 0x2213 ) { return true; } return false; } static inline bool IsJuliaParen (int ch) { if (ch == '(' || ch == ')' || ch == '{' || ch == '}' || ch == '[' || ch == ']' ) { return true; } return false; } // Unicode parsing from Julia source code: // https://github.com/JuliaLang/julia/blob/master/src/flisp/julia_extensions.c // keep the same function name to be easy to find again static int is_wc_cat_id_start(uint32_t wc) { const CharacterCategory cat = CategoriseCharacter((int) wc); return (cat == ccLu || cat == ccLl || cat == ccLt || cat == ccLm || cat == ccLo || cat == ccNl || cat == ccSc || // allow currency symbols // other symbols, but not arrows or replacement characters (cat == ccSo && !(wc >= 0x2190 && wc <= 0x21FF) && wc != 0xfffc && wc != 0xfffd && wc != 0x233f && // notslash wc != 0x00a6) || // broken bar // math symbol (category Sm) whitelist (wc >= 0x2140 && wc <= 0x2a1c && ((wc >= 0x2140 && wc <= 0x2144) || // ⅀, ⅁, ⅂, ⅃, ⅄ wc == 0x223f || wc == 0x22be || wc == 0x22bf || // ∿, ⊾, ⊿ wc == 0x22a4 || wc == 0x22a5 || // ⊤ ⊥ (wc >= 0x2200 && wc <= 0x2233 && (wc == 0x2202 || wc == 0x2205 || wc == 0x2206 || // ∂, ∅, ∆ wc == 0x2207 || wc == 0x220e || wc == 0x220f || // ∇, ∎, ∏ wc == 0x2200 || wc == 0x2203 || wc == 0x2204 || // ∀, ∃, ∄ wc == 0x2210 || wc == 0x2211 || // ∐, ∑ wc == 0x221e || wc == 0x221f || // ∞, ∟ wc >= 0x222b)) || // ∫, ∬, ∭, ∮, ∯, ∰, ∱, ∲, ∳ (wc >= 0x22c0 && wc <= 0x22c3) || // N-ary big ops: ⋀, ⋁, ⋂, ⋃ (wc >= 0x25F8 && wc <= 0x25ff) || // ◸, ◹, ◺, ◻, ◼, ◽, ◾, ◿ (wc >= 0x266f && (wc == 0x266f || wc == 0x27d8 || wc == 0x27d9 || // ♯, ⟘, ⟙ (wc >= 0x27c0 && wc <= 0x27c1) || // ⟀, ⟁ (wc >= 0x29b0 && wc <= 0x29b4) || // ⦰, ⦱, ⦲, ⦳, ⦴ (wc >= 0x2a00 && wc <= 0x2a06) || // ⨀, ⨁, ⨂, ⨃, ⨄, ⨅, ⨆ (wc >= 0x2a09 && wc <= 0x2a16) || // ⨉, ⨊, ⨋, ⨌, ⨍, ⨎, ⨏, ⨐, ⨑, ⨒, ⨓, ⨔, ⨕, ⨖ wc == 0x2a1b || wc == 0x2a1c)))) || // ⨛, ⨜ (wc >= 0x1d6c1 && // variants of \nabla and \partial (wc == 0x1d6c1 || wc == 0x1d6db || wc == 0x1d6fb || wc == 0x1d715 || wc == 0x1d735 || wc == 0x1d74f || wc == 0x1d76f || wc == 0x1d789 || wc == 0x1d7a9 || wc == 0x1d7c3)) || // super- and subscript +-=() (wc >= 0x207a && wc <= 0x207e) || (wc >= 0x208a && wc <= 0x208e) || // angle symbols (wc >= 0x2220 && wc <= 0x2222) || // ∠, ∡, ∢ (wc >= 0x299b && wc <= 0x29af) || // ⦛, ⦜, ⦝, ⦞, ⦟, ⦠, ⦡, ⦢, ⦣, ⦤, ⦥, ⦦, ⦧, ⦨, ⦩, ⦪, ⦫, ⦬, ⦭, ⦮, ⦯ // Other_ID_Start wc == 0x2118 || wc == 0x212E || // ℘, ℮ (wc >= 0x309B && wc <= 0x309C) || // katakana-hiragana sound marks // bold-digits and double-struck digits (wc >= 0x1D7CE && wc <= 0x1D7E1)); // 𝟎 through 𝟗 (inclusive), 𝟘 through 𝟡 (inclusive) } static inline bool IsIdentifierFirstCharacter (int ch) { if (IsASCII(ch)) { return (bool) (isalpha(ch) || ch == '_'); } if (ch < 0xA1 || ch > 0x10ffff) { return false; } return is_wc_cat_id_start((uint32_t) ch); } static inline bool IsIdentifierCharacter (int ch) { if (IsASCII(ch)) { return (bool) (isalnum(ch) || ch == '_' || ch == '!'); } if (ch < 0xA1 || ch > 0x10ffff) { return false; } if (is_wc_cat_id_start((uint32_t) ch)) { return true; } const CharacterCategory cat = CategoriseCharacter(ch); if (cat == ccMn || cat == ccMc || cat == ccNd || cat == ccPc || cat == ccSk || cat == ccMe || cat == ccNo || // primes (single, double, triple, their reverses, and quadruple) (ch >= 0x2032 && ch <= 0x2037) || (ch == 0x2057)) { return true; } return false; } // keep the same function name to be easy to find again static const uint32_t opsuffs[] = { 0x00b2, // ² 0x00b3, // ³ 0x00b9, // ¹ 0x02b0, // ʰ 0x02b2, // ʲ 0x02b3, // ʳ 0x02b7, // ʷ 0x02b8, // ʸ 0x02e1, // ˡ 0x02e2, // ˢ 0x02e3, // ˣ 0x1d2c, // ᴬ 0x1d2e, // ᴮ 0x1d30, // ᴰ 0x1d31, // ᴱ 0x1d33, // ᴳ 0x1d34, // ᴴ 0x1d35, // ᴵ 0x1d36, // ᴶ 0x1d37, // ᴷ 0x1d38, // ᴸ 0x1d39, // ᴹ 0x1d3a, // ᴺ 0x1d3c, // ᴼ 0x1d3e, // ᴾ 0x1d3f, // ᴿ 0x1d40, // ᵀ 0x1d41, // ᵁ 0x1d42, // ᵂ 0x1d43, // ᵃ 0x1d47, // ᵇ 0x1d48, // ᵈ 0x1d49, // ᵉ 0x1d4d, // ᵍ 0x1d4f, // ᵏ 0x1d50, // ᵐ 0x1d52, // ᵒ 0x1d56, // ᵖ 0x1d57, // ᵗ 0x1d58, // ᵘ 0x1d5b, // ᵛ 0x1d5d, // ᵝ 0x1d5e, // ᵞ 0x1d5f, // ᵟ 0x1d60, // ᵠ 0x1d61, // ᵡ 0x1d62, // ᵢ 0x1d63, // ᵣ 0x1d64, // ᵤ 0x1d65, // ᵥ 0x1d66, // ᵦ 0x1d67, // ᵧ 0x1d68, // ᵨ 0x1d69, // ᵩ 0x1d6a, // ᵪ 0x1d9c, // ᶜ 0x1da0, // ᶠ 0x1da5, // ᶥ 0x1da6, // ᶦ 0x1dab, // ᶫ 0x1db0, // ᶰ 0x1db8, // ᶸ 0x1dbb, // ᶻ 0x1dbf, // ᶿ 0x2032, // ′ 0x2033, // ″ 0x2034, // ‴ 0x2035, // ‵ 0x2036, // ‶ 0x2037, // ‷ 0x2057, // ⁗ 0x2070, // ⁰ 0x2071, // ⁱ 0x2074, // ⁴ 0x2075, // ⁵ 0x2076, // ⁶ 0x2077, // ⁷ 0x2078, // ⁸ 0x2079, // ⁹ 0x207a, // ⁺ 0x207b, // ⁻ 0x207c, // ⁼ 0x207d, // ⁽ 0x207e, // ⁾ 0x207f, // ⁿ 0x2080, // ₀ 0x2081, // ₁ 0x2082, // ₂ 0x2083, // ₃ 0x2084, // ₄ 0x2085, // ₅ 0x2086, // ₆ 0x2087, // ₇ 0x2088, // ₈ 0x2089, // ₉ 0x208a, // ₊ 0x208b, // ₋ 0x208c, // ₌ 0x208d, // ₍ 0x208e, // ₎ 0x2090, // ₐ 0x2091, // ₑ 0x2092, // ₒ 0x2093, // ₓ 0x2095, // ₕ 0x2096, // ₖ 0x2097, // ₗ 0x2098, // ₘ 0x2099, // ₙ 0x209a, // ₚ 0x209b, // ₛ 0x209c, // ₜ 0x2c7c, // ⱼ 0x2c7d, // ⱽ 0xa71b, // ꜛ 0xa71c, // ꜜ 0xa71d // ꜝ }; static const size_t opsuffs_len = sizeof(opsuffs) / (sizeof(uint32_t)); // keep the same function name to be easy to find again static bool jl_op_suffix_char(uint32_t wc) { if (wc < 0xA1 || wc > 0x10ffff) { return false; } const CharacterCategory cat = CategoriseCharacter((int) wc); if (cat == ccMn || cat == ccMc || cat == ccMe) { return true; } for (size_t i = 0; i < opsuffs_len; ++i) { if (wc == opsuffs[i]) { return true; } } return false; } // keep the same function name to be easy to find again static bool never_id_char(uint32_t wc) { const CharacterCategory cat = CategoriseCharacter((int) wc); return ( // spaces and control characters: (cat >= ccZs && cat <= ccCs) || // ASCII and Latin1 non-connector punctuation (wc < 0xff && cat >= ccPd && cat <= ccPo) || wc == '`' || // mathematical brackets (wc >= 0x27e6 && wc <= 0x27ef) || // angle, corner, and lenticular brackets (wc >= 0x3008 && wc <= 0x3011) || // tortoise shell, square, and more lenticular brackets (wc >= 0x3014 && wc <= 0x301b) || // fullwidth parens (wc == 0xff08 || wc == 0xff09) || // fullwidth square brackets (wc == 0xff3b || wc == 0xff3d)); } static bool IsOperatorFirstCharacter (int ch) { if (IsASCII(ch)) { if (IsJuliaOperator(ch) || ch == '!' || ch == '?' || ch == ':' || ch == ';' || ch == ',' || ch == '.' ) { return true; }else { return false; } } else if (is_wc_cat_id_start((uint32_t) ch)) { return false; } else if (IsJuliaUnaryOperator(ch) || ! never_id_char((uint32_t) ch)) { return true; } return false; } static bool IsOperatorCharacter (int ch) { if (IsOperatorFirstCharacter(ch) || (!IsASCII(ch) && jl_op_suffix_char((uint32_t) ch)) ) { return true; } return false; } static bool CheckBoundsIndexing(char *str) { if (strcmp("begin", str) == 0 || strcmp("end", str) == 0 ) { return true; } return false; } static int CheckKeywordFoldPoint(char *str) { if (strcmp ("if", str) == 0 || strcmp ("for", str) == 0 || strcmp ("while", str) == 0 || strcmp ("try", str) == 0 || strcmp ("do", str) == 0 || strcmp ("begin", str) == 0 || strcmp ("let", str) == 0 || strcmp ("baremodule", str) == 0 || strcmp ("quote", str) == 0 || strcmp ("module", str) == 0 || strcmp ("struct", str) == 0 || strcmp ("type", str) == 0 || strcmp ("macro", str) == 0 || strcmp ("function", str) == 0) { return 1; } if (strcmp("end", str) == 0) { return -1; } return 0; } static bool IsNumberExpon(int ch, int base) { if ((base == 10 && (ch == 'e' || ch == 'E' || ch == 'f')) || (base == 16 && (ch == 'p' || ch == 'P'))) { return true; } return false; } /* Scans a sequence of digits, returning true if it found any. */ static bool ScanDigits(StyleContext& sc, int base, bool allow_sep) { bool found = false; for (;;) { if (IsADigit(sc.chNext, base) || (allow_sep && sc.chNext == '_')) { found = true; sc.Forward(); } else { break; } } return found; } static inline bool ScanNHexas(StyleContext &sc, int max) { int n = 0; bool error = false; sc.Forward(); if (!IsADigit(sc.ch, 16)) { error = true; } else { while (IsADigit(sc.ch, 16) && n < max) { sc.Forward(); n++; } } return error; } static void resumeCharacter(StyleContext &sc, bool lexerror) { bool error = false; // ''' case if (sc.chPrev == '\'' && sc.ch == '\'' && sc.chNext == '\'') { sc.Forward(); sc.ForwardSetState(SCE_JULIA_DEFAULT); return; } else if (lexerror && sc.chPrev == '\'' && sc.ch == '\'') { sc.ChangeState(SCE_JULIA_LEXERROR); sc.ForwardSetState(SCE_JULIA_DEFAULT); // Escape characters } else if (sc.ch == '\\') { sc.Forward(); if (sc.ch == '\'' || sc.ch == '\\' ) { sc.Forward(); } else if (sc.ch == 'n' || sc.ch == 't' || sc.ch == 'a' || sc.ch == 'b' || sc.ch == 'e' || sc.ch == 'f' || sc.ch == 'r' || sc.ch == 'v' ) { sc.Forward(); } else if (sc.ch == 'x') { error |= ScanNHexas(sc, 2); } else if (sc.ch == 'u') { error |= ScanNHexas(sc, 4); } else if (sc.ch == 'U') { error |= ScanNHexas(sc, 8); } else if (IsADigit(sc.ch, 8)) { int n = 1; int max = 3; sc.Forward(); while (IsADigit(sc.ch, 8) && n < max) { sc.Forward(); n++; } } if (lexerror) { if (sc.ch != '\'') { error = true; while (sc.ch != '\'' && sc.ch != '\r' && sc.ch != '\n') { sc.Forward(); } } if (error) { sc.ChangeState(SCE_JULIA_LEXERROR); sc.ForwardSetState(SCE_JULIA_DEFAULT); } } } else if (lexerror) { if (sc.ch < 0x20 || sc.ch > 0x10ffff) { error = true; } else { // single character sc.Forward(); if (sc.ch != '\'') { error = true; while (sc.ch != '\'' && sc.ch != '\r' && sc.ch != '\n') { sc.Forward(); } } } if (error) { sc.ChangeState(SCE_JULIA_LEXERROR); sc.ForwardSetState(SCE_JULIA_DEFAULT); } } // closing quote if (sc.ch == '\'') { if (sc.chNext == '\'') { sc.Forward(); } else { sc.ForwardSetState(SCE_JULIA_DEFAULT); } } } static inline bool IsACharacter(StyleContext &sc) { return (sc.chPrev == '\'' && sc.chNext == '\''); } static void ScanParenInterpolation(StyleContext &sc) { // TODO: no syntax highlighting inside a string interpolation // Level of nested parenthesis int interp_level = 0; // If true, it is inside a string and parenthesis are not counted. bool allow_paren_string = false; // check for end of states for (; sc.More(); sc.Forward()) { // TODO: check corner cases for nested string interpolation // TODO: check corner cases with Command inside interpolation if ( sc.ch == '\"' && sc.chPrev != '\\') { // Toggle the string environment (parenthesis are not counted inside a string) allow_paren_string = !allow_paren_string; } else if ( !allow_paren_string ) { if ( sc.ch == '(' && !IsACharacter(sc) ) { interp_level ++; } else if ( sc.ch == ')' && !IsACharacter(sc) && interp_level > 0 ) { interp_level --; if (interp_level == 0) { // Exit interpolation return; } } } } } /* * Start parsing a number, parse the base. */ static void initNumber (StyleContext &sc, int &base, bool &with_dot) { base = 10; with_dot = false; sc.SetState(SCE_JULIA_NUMBER); if (sc.ch == '0') { if (sc.chNext == 'x') { sc.Forward(); base = 16; if (sc.chNext == '.') { sc.Forward(); with_dot = true; } } else if (sc.chNext == 'o') { sc.Forward(); base = 8; } else if (sc.chNext == 'b') { sc.Forward(); base = 2; } } else if (sc.ch == '.') { with_dot = true; } } /* * Resume parsing a String or Command, bounded by the `quote` character (\" or \`) * The `triple` argument specifies if it is a triple-quote String or Command. * Interpolation is detected (with `$`), and parsed if `allow_interp` is true. */ static void resumeStringLike(StyleContext &sc, int quote, bool triple, bool allow_interp, bool full_highlight) { int stylePrev = sc.state; bool checkcurrent = false; // Escape characters if (sc.ch == '\\') { if (sc.chNext == quote || sc.chNext == '\\' || sc.chNext == '$') { sc.Forward(); } } else if (allow_interp && sc.ch == '$') { // If the interpolation is only of a variable, do not change state if (sc.chNext == '(') { if (full_highlight) { sc.SetState(SCE_JULIA_STRINGINTERP); } else { sc.ForwardSetState(SCE_JULIA_STRINGINTERP); } ScanParenInterpolation(sc); sc.ForwardSetState(stylePrev); checkcurrent = true; } else if (full_highlight && IsIdentifierFirstCharacter(sc.chNext)) { sc.SetState(SCE_JULIA_STRINGINTERP); sc.Forward(); sc.Forward(); for (; sc.More(); sc.Forward()) { if (! IsIdentifierCharacter(sc.ch)) { break; } } sc.SetState(stylePrev); checkcurrent = true; } if (checkcurrent) { // Check that the current character is not a special char, // otherwise it will be skipped resumeStringLike(sc, quote, triple, allow_interp, full_highlight); } } else if (sc.ch == quote) { if (triple) { if (sc.chNext == quote && sc.GetRelativeCharacter(2) == quote) { // Move to the end of the triple quotes Sci_PositionU nextIndex = sc.currentPos + 2; while (nextIndex > sc.currentPos && sc.More()) { sc.Forward(); } sc.ForwardSetState(SCE_JULIA_DEFAULT); } } else { sc.ForwardSetState(SCE_JULIA_DEFAULT); } } } static void resumeCommand(StyleContext &sc, bool triple, bool allow_interp) { return resumeStringLike(sc, '`', triple, allow_interp, true); } static void resumeString(StyleContext &sc, bool triple, bool allow_interp) { return resumeStringLike(sc, '"', triple, allow_interp, true); } static void resumeNumber (StyleContext &sc, int base, bool &with_dot, bool lexerror) { if (IsNumberExpon(sc.ch, base)) { if (IsADigit(sc.chNext) || sc.chNext == '+' || sc.chNext == '-') { sc.Forward(); // Capture all digits ScanDigits(sc, 10, false); sc.Forward(); } sc.SetState(SCE_JULIA_DEFAULT); } else if (sc.ch == '.' && sc.chNext == '.') { // Interval operator `..` sc.SetState(SCE_JULIA_OPERATOR); sc.Forward(); sc.ForwardSetState(SCE_JULIA_DEFAULT); } else if (sc.ch == '.' && !with_dot) { with_dot = true; ScanDigits(sc, base, true); } else if (IsADigit(sc.ch, base) || sc.ch == '_') { ScanDigits(sc, base, true); } else if (IsADigit(sc.ch) && !IsADigit(sc.ch, base)) { if (lexerror) { sc.ChangeState(SCE_JULIA_LEXERROR); } ScanDigits(sc, 10, false); sc.ForwardSetState(SCE_JULIA_DEFAULT); } else { sc.SetState(SCE_JULIA_DEFAULT); } } static void resumeOperator (StyleContext &sc) { if (sc.chNext == ':' && (sc.ch == ':' || sc.ch == '<' || (sc.ch == '>' && (sc.chPrev != '-' && sc.chPrev != '=')))) { // Case `:a=>:b` sc.Forward(); sc.ForwardSetState(SCE_JULIA_DEFAULT); } else if (sc.ch == ':') { // Case `foo(:baz,:baz)` or `:one+:two` // Let the default case switch decide if it is a symbol sc.SetState(SCE_JULIA_DEFAULT); } else if (sc.ch == '\'') { sc.SetState(SCE_JULIA_DEFAULT); } else if ((sc.ch == '.' && sc.chPrev != '.') || IsIdentifierFirstCharacter(sc.ch) || (! (sc.chPrev == '.' && IsOperatorFirstCharacter(sc.ch)) && ! IsOperatorCharacter(sc.ch)) ) { sc.SetState(SCE_JULIA_DEFAULT); } } void SCI_METHOD LexerJulia::Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { PropSetSimple props; Accessor styler(pAccess, &props); Sci_Position pos = startPos; styler.StartAt(pos); styler.StartSegment(pos); // use the line state of each line to store block/multiline states Sci_Position curLine = styler.GetLine(startPos); // Default is false for everything and 0 counters. int lineState = (curLine > 0) ? styler.GetLineState(curLine-1) : 0; bool transpose = (lineState >> 0) & 0x01; // 1 bit to know if ' is allowed to mean transpose bool istripledocstring = (lineState >> 1) & 0x01; // 1 bit to know if we are in a triple doublequotes string bool triple_backtick = (lineState >> 2) & 0x01; // 1 bit to know if we are in a triple backtick command bool israwstring = (lineState >> 3) & 0x01; // 1 bit to know if we are in a raw string int indexing_level = (int)((lineState >> 4) & 0x0F); // 4 bits of bracket nesting counter int list_comprehension = (int)((lineState >> 8) & 0x0F); // 4 bits of parenthesis nesting counter int commentDepth = (int)((lineState >> 12) & 0x0F); // 4 bits of nested comment counter // base for parsing number int base = 10; // number has a float dot ? bool with_dot = false; StyleContext sc(startPos, length, initStyle, styler); for (; sc.More(); sc.Forward()) { //// check for end of states switch (sc.state) { case SCE_JULIA_BRACKET: sc.SetState(SCE_JULIA_DEFAULT); break; case SCE_JULIA_OPERATOR: resumeOperator(sc); break; case SCE_JULIA_TYPEOPERATOR: sc.SetState(SCE_JULIA_DEFAULT); break; case SCE_JULIA_TYPEANNOT: if (! IsIdentifierCharacter(sc.ch)) { sc.SetState(SCE_JULIA_DEFAULT); } break; case SCE_JULIA_IDENTIFIER: // String literal if (sc.ch == '\"') { // If the string literal has a prefix, interpolation is disabled israwstring = true; sc.ChangeState(SCE_JULIA_STRINGLITERAL); sc.SetState(SCE_JULIA_DEFAULT); } else if (sc.ch == '`') { // If the string literal has a prefix, interpolation is disabled israwstring = true; sc.ChangeState(SCE_JULIA_COMMANDLITERAL); sc.SetState(SCE_JULIA_DEFAULT); // Continue if the character is an identifier character } else if (! IsIdentifierCharacter(sc.ch)) { char s[MAX_JULIA_IDENT_CHARS + 1]; sc.GetCurrent(s, sizeof(s)); // Treat the keywords differently if we are indexing or not if ( indexing_level > 0 && CheckBoundsIndexing(s)) { // Inside [], (), `begin` and `end` are numbers not block keywords sc.ChangeState(SCE_JULIA_NUMBER); transpose = false; } else { if (keywords.InList(s)) { sc.ChangeState(SCE_JULIA_KEYWORD1); transpose = false; } else if (identifiers2.InList(s)) { sc.ChangeState(SCE_JULIA_KEYWORD2); transpose = false; } else if (identifiers3.InList(s)) { sc.ChangeState(SCE_JULIA_KEYWORD3); transpose = false; } else if (identifiers4.InList(s)) { sc.ChangeState(SCE_JULIA_KEYWORD4); // These identifiers can be used for variable names also, // so transpose is not forbidden. //transpose = false; } } sc.SetState(SCE_JULIA_DEFAULT); // TODO: recognize begin-end blocks inside list comprehension // b = [(begin n%2; n*2 end) for n in 1:10] // TODO: recognize better comprehension for-if to avoid problem with code-folding // c = [(if isempty(a); missing else first(b) end) for (a, b) in zip(l1, l2)] } break; case SCE_JULIA_NUMBER: resumeNumber(sc, base, with_dot, options.highlightLexerror); break; case SCE_JULIA_CHAR: resumeCharacter(sc, options.highlightLexerror); break; case SCE_JULIA_DOCSTRING: resumeString(sc, true, !israwstring); if (sc.state == SCE_JULIA_DEFAULT && israwstring) { israwstring = false; } break; case SCE_JULIA_STRING: resumeString(sc, false, !israwstring); if (sc.state == SCE_JULIA_DEFAULT && israwstring) { israwstring = false; } break; case SCE_JULIA_COMMAND: resumeCommand(sc, triple_backtick, !israwstring); break; case SCE_JULIA_MACRO: if (IsASpace(sc.ch) || ! IsIdentifierCharacter(sc.ch)) { sc.SetState(SCE_JULIA_DEFAULT); } break; case SCE_JULIA_SYMBOL: if (! IsIdentifierCharacter(sc.ch)) { sc.SetState(SCE_JULIA_DEFAULT); } break; case SCE_JULIA_COMMENT: if( commentDepth > 0 ) { // end or start of a nested a block comment if ( sc.ch == '=' && sc.chNext == '#') { commentDepth --; sc.Forward(); if (commentDepth == 0) { sc.ForwardSetState(SCE_JULIA_DEFAULT); } } else if( sc.ch == '#' && sc.chNext == '=') { commentDepth ++; sc.Forward(); } } else { // single line comment if (sc.atLineEnd || sc.ch == '\r' || sc.ch == '\n') { sc.SetState(SCE_JULIA_DEFAULT); transpose = false; } } break; } // check start of a new state if (sc.state == SCE_JULIA_DEFAULT) { if (sc.ch == '#') { sc.SetState(SCE_JULIA_COMMENT); // increment depth if we are a block comment if(sc.chNext == '=') { commentDepth ++; sc.Forward(); } } else if (sc.ch == '!') { sc.SetState(SCE_JULIA_OPERATOR); transpose = false; } else if (sc.ch == '\'') { if (transpose) { sc.SetState(SCE_JULIA_OPERATOR); } else { sc.SetState(SCE_JULIA_CHAR); } } else if (sc.ch == '\"') { istripledocstring = (sc.chNext == '\"' && sc.GetRelativeCharacter(2) == '\"'); if (istripledocstring) { sc.SetState(SCE_JULIA_DOCSTRING); // Move to the end of the triple quotes Sci_PositionU nextIndex = sc.currentPos + 2; while (nextIndex > sc.currentPos && sc.More()) { sc.Forward(); } } else { sc.SetState(SCE_JULIA_STRING); } } else if (sc.ch == '`') { triple_backtick = (sc.chNext == '`' && sc.GetRelativeCharacter(2) == '`'); sc.SetState(SCE_JULIA_COMMAND); if (triple_backtick) { // Move to the end of the triple backticks Sci_PositionU nextIndex = sc.currentPos + 2; while (nextIndex > sc.currentPos && sc.More()) { sc.Forward(); } } } else if (IsADigit(sc.ch) || (sc.ch == '.' && IsADigit(sc.chNext))) { initNumber(sc, base, with_dot); } else if (IsIdentifierFirstCharacter(sc.ch)) { sc.SetState(SCE_JULIA_IDENTIFIER); transpose = true; } else if (sc.ch == '@') { sc.SetState(SCE_JULIA_MACRO); transpose = false; // Several parsing of operators, should keep the order of `if` blocks } else if ((sc.ch == ':' || sc.ch == '<' || sc.ch == '>') && sc.chNext == ':') { sc.SetState(SCE_JULIA_TYPEOPERATOR); sc.Forward(); // Highlight the next identifier, if option is set if (options.highlightTypeannotation && IsIdentifierFirstCharacter(sc.chNext)) { sc.ForwardSetState(SCE_JULIA_TYPEANNOT); } } else if (sc.ch == ':') { // TODO: improve detection of range // should be solved with begin-end parsing // `push!(arr, s1 :s2)` and `a[begin :end] if (IsIdentifierFirstCharacter(sc.chNext) && ! IsIdentifierCharacter(sc.chPrev) && sc.chPrev != ')' && sc.chPrev != ']' ) { sc.SetState(SCE_JULIA_SYMBOL); } else { sc.SetState(SCE_JULIA_OPERATOR); } } else if (IsJuliaParen(sc.ch)) { if (sc.ch == '[') { list_comprehension ++; indexing_level ++; } else if (sc.ch == ']' && (indexing_level > 0)) { list_comprehension --; indexing_level --; } else if (sc.ch == '(') { list_comprehension ++; } else if (sc.ch == ')' && (list_comprehension > 0)) { list_comprehension --; } if (sc.ch == ')' || sc.ch == ']' || sc.ch == '}') { transpose = true; } else { transpose = false; } sc.SetState(SCE_JULIA_BRACKET); } else if (IsOperatorFirstCharacter(sc.ch)) { transpose = false; sc.SetState(SCE_JULIA_OPERATOR); } else { transpose = false; } } // update the line information (used for line-by-line lexing and folding) if (sc.atLineEnd) { // set the line state to the current state curLine = styler.GetLine(sc.currentPos); lineState = ((transpose ? 1 : 0) << 0) | ((istripledocstring ? 1 : 0) << 1) | ((triple_backtick ? 1 : 0) << 2) | ((israwstring ? 1 : 0) << 3) | ((indexing_level & 0x0F) << 4) | ((list_comprehension & 0x0F) << 8) | ((commentDepth & 0x0F) << 12); styler.SetLineState(curLine, lineState); } } sc.Complete(); } void SCI_METHOD LexerJulia::Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { if (!options.fold) return; LexAccessor styler(pAccess); Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelCurrent = SC_FOLDLEVELBASE; int lineState = 0; if (lineCurrent > 0) { levelCurrent = styler.LevelAt(lineCurrent-1) >> 16; lineState = styler.GetLineState(lineCurrent-1); } // level of nested brackets int indexing_level = (int)((lineState >> 4) & 0x0F); // 4 bits of bracket nesting counter // level of nested parenthesis or brackets int list_comprehension = (int)((lineState >> 8) & 0x0F); // 4 bits of parenthesis nesting counter //int commentDepth = (int)((lineState >> 12) & 0x0F); // 4 bits of nested comment counter Sci_PositionU lineStartNext = styler.LineStart(lineCurrent+1); int levelNext = levelCurrent; char chNext = styler[startPos]; int stylePrev = styler.StyleAt(startPos - 1); int styleNext = styler.StyleAt(startPos); int style = initStyle; char word[100]; int wordlen = 0; for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); style = styleNext; styleNext = styler.StyleAt(i + 1); bool atEOL = i == (lineStartNext-1); // a start/end of comment block if (options.foldComment && style == SCE_JULIA_COMMENT) { // start of block comment if (ch == '#' && chNext == '=') { levelNext ++; } // end of block comment if (ch == '=' && chNext == '#' && levelNext > 0) { levelNext --; } } // Syntax based folding, accounts for list comprehension if (options.foldSyntaxBased) { // list comprehension allow `for`, `if` and `begin` without `end` if (style == SCE_JULIA_BRACKET) { if (ch == '[') { list_comprehension ++; indexing_level ++; levelNext ++; } else if (ch == ']') { list_comprehension --; indexing_level --; levelNext --; } else if (ch == '(') { list_comprehension ++; levelNext ++; } else if (ch == ')') { list_comprehension --; levelNext --; } // check non-negative if (indexing_level < 0) { indexing_level = 0; } if (list_comprehension < 0) { list_comprehension = 0; } } // keyword if (style == SCE_JULIA_KEYWORD1) { word[wordlen++] = static_cast(ch); if (wordlen == 100) { // prevent overflow word[0] = '\0'; wordlen = 1; } if (styleNext != SCE_JULIA_KEYWORD1) { word[wordlen] = '\0'; wordlen = 0; if (list_comprehension <= 0 && indexing_level <= 0) { levelNext += CheckKeywordFoldPoint(word); } } } } // Docstring if (options.foldDocstring) { if (stylePrev != SCE_JULIA_DOCSTRING && style == SCE_JULIA_DOCSTRING) { levelNext ++; } else if (style == SCE_JULIA_DOCSTRING && styleNext != SCE_JULIA_DOCSTRING) { levelNext --; } } // check non-negative level if (levelNext < 0) { levelNext = 0; } if (!IsASpace(ch)) { visibleChars++; } stylePrev = style; if (atEOL || (i == endPos-1)) { int levelUse = levelCurrent; int lev = levelUse | levelNext << 16; if (visibleChars == 0 && options.foldCompact) { lev |= SC_FOLDLEVELWHITEFLAG; } if (levelUse < levelNext) { lev |= SC_FOLDLEVELHEADERFLAG; } if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; lineStartNext = styler.LineStart(lineCurrent+1); levelCurrent = levelNext; if (atEOL && (i == static_cast(styler.Length() - 1))) { // There is an empty line at end of file so give it same level and empty styler.SetLevel(lineCurrent, (levelCurrent | levelCurrent << 16) | SC_FOLDLEVELWHITEFLAG); } visibleChars = 0; } } } LexerModule lmJulia(SCLEX_JULIA, LexerJulia::LexerFactoryJulia, "julia", juliaWordLists); lexilla/lexers/LexVHDL.cxx0000664000175000017500000005102114647367374014432 0ustar neilneil// Scintilla source code edit control /** @file LexVHDL.cxx ** Lexer for VHDL ** Written by Phil Reid, ** Based on: ** - The Verilog Lexer by Avi Yegudin ** - The Fortran Lexer by Chuan-jian Shen ** - The C++ lexer by Neil Hodgson **/ // Copyright 1998-2002 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static void ColouriseVHDLDoc( Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler); /***************************************/ static inline bool IsAWordChar(const int ch) { return (ch < 0x80) && (isalnum(ch) || ch == '.' || ch == '_' ); } /***************************************/ static inline bool IsAWordStart(const int ch) { return (ch < 0x80) && (isalnum(ch) || ch == '_'); } /***************************************/ static inline bool IsABlank(unsigned int ch) { return (ch == ' ') || (ch == 0x09) || (ch == 0x0b) ; } /***************************************/ static void ColouriseVHDLDoc( Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { WordList &Keywords = *keywordlists[0]; WordList &Operators = *keywordlists[1]; WordList &Attributes = *keywordlists[2]; WordList &Functions = *keywordlists[3]; WordList &Packages = *keywordlists[4]; WordList &Types = *keywordlists[5]; WordList &User = *keywordlists[6]; StyleContext sc(startPos, length, initStyle, styler); bool isExtendedId = false; // true when parsing an extended identifier while (sc.More()) { bool advance = true; // Determine if the current state should terminate. if (sc.state == SCE_VHDL_OPERATOR) { sc.SetState(SCE_VHDL_DEFAULT); } else if (sc.state == SCE_VHDL_NUMBER) { if (!IsAWordChar(sc.ch) && (sc.ch != '#')) { sc.SetState(SCE_VHDL_DEFAULT); } } else if (sc.state == SCE_VHDL_IDENTIFIER) { if (!isExtendedId && (!IsAWordChar(sc.ch) || (sc.ch == '.'))) { char s[100]; sc.GetCurrentLowered(s, sizeof(s)); if (Keywords.InList(s)) { sc.ChangeState(SCE_VHDL_KEYWORD); } else if (Operators.InList(s)) { sc.ChangeState(SCE_VHDL_STDOPERATOR); } else if (Attributes.InList(s)) { sc.ChangeState(SCE_VHDL_ATTRIBUTE); } else if (Functions.InList(s)) { sc.ChangeState(SCE_VHDL_STDFUNCTION); } else if (Packages.InList(s)) { sc.ChangeState(SCE_VHDL_STDPACKAGE); } else if (Types.InList(s)) { sc.ChangeState(SCE_VHDL_STDTYPE); } else if (User.InList(s)) { sc.ChangeState(SCE_VHDL_USERWORD); } sc.SetState(SCE_VHDL_DEFAULT); } else if (isExtendedId && ((sc.ch == '\\') || sc.atLineEnd)) { // extended identifiers are terminated by backslash, check for end of line in case we have invalid syntax isExtendedId = false; sc.ForwardSetState(SCE_VHDL_DEFAULT); advance = false; } } else if (sc.state == SCE_VHDL_COMMENT || sc.state == SCE_VHDL_COMMENTLINEBANG) { if (sc.atLineEnd) { sc.SetState(SCE_VHDL_DEFAULT); } } else if (sc.state == SCE_VHDL_STRING) { if (sc.ch == '"') { advance = false; sc.Forward(); if (sc.ch == '"') sc.Forward(); else sc.SetState(SCE_VHDL_DEFAULT); } else if (sc.atLineEnd) { advance = false; sc.ChangeState(SCE_VHDL_STRINGEOL); sc.ForwardSetState(SCE_VHDL_DEFAULT); } } else if (sc.state == SCE_VHDL_BLOCK_COMMENT){ if(sc.ch == '*' && sc.chNext == '/'){ advance = false; sc.Forward(); sc.ForwardSetState(SCE_VHDL_DEFAULT); } } // Determine if a new state should be entered. if (sc.state == SCE_VHDL_DEFAULT) { if (IsADigit(sc.ch) || (sc.ch == '.' && IsADigit(sc.chNext))) { sc.SetState(SCE_VHDL_NUMBER); } else if (IsAWordStart(sc.ch)) { sc.SetState(SCE_VHDL_IDENTIFIER); } else if (sc.Match('-', '-')) { if (sc.Match("--!")) // Nice to have a different comment style sc.SetState(SCE_VHDL_COMMENTLINEBANG); else sc.SetState(SCE_VHDL_COMMENT); } else if (sc.Match('/', '*')){ sc.SetState(SCE_VHDL_BLOCK_COMMENT); } else if (sc.ch == '"') { sc.SetState(SCE_VHDL_STRING); } else if (sc.ch == '\'') { if (sc.GetRelative(2) == '\''){ if (sc.chNext != '(' || sc.GetRelative(4) != '\''){ // Can only be a character literal sc.SetState(SCE_VHDL_STRING); sc.Forward(); sc.Forward(); sc.ForwardSetState(SCE_VHDL_DEFAULT); advance = false; } // else can be a tick or a character literal, need more context, eg.: identifier'('x') } // else can only be a tick } else if (sc.ch == '\\') { isExtendedId = true; sc.SetState(SCE_VHDL_IDENTIFIER); } else if (isoperator(static_cast(sc.ch))) { sc.SetState(SCE_VHDL_OPERATOR); } } if (advance) sc.Forward(); } sc.Complete(); } //============================================================================= static bool IsCommentLine(Sci_Position line, Accessor &styler) { Sci_Position pos = styler.LineStart(line); Sci_Position eol_pos = styler.LineStart(line + 1) - 1; for (Sci_Position i = pos; i < eol_pos; i++) { char ch = styler[i]; char chNext = styler[i+1]; if ((ch == '-') && (chNext == '-')) return true; else if (ch != ' ' && ch != '\t') return false; } return false; } static bool IsCommentBlockStart(Sci_Position line, Accessor &styler) { Sci_Position pos = styler.LineStart(line); Sci_Position eol_pos = styler.LineStart(line + 1) - 1; for (Sci_Position i = pos; i < eol_pos; i++) { char ch = styler[i]; char chNext = styler[i+1]; char style = styler.StyleAt(i); if ((style == SCE_VHDL_BLOCK_COMMENT) && (ch == '/') && (chNext == '*')) return true; } return false; } static bool IsCommentBlockEnd(Sci_Position line, Accessor &styler) { Sci_Position pos = styler.LineStart(line); Sci_Position eol_pos = styler.LineStart(line + 1) - 1; for (Sci_Position i = pos; i < eol_pos; i++) { char ch = styler[i]; char chNext = styler[i+1]; char style = styler.StyleAt(i); if ((style == SCE_VHDL_BLOCK_COMMENT) && (ch == '*') && (chNext == '/')) return true; } return false; } static bool IsCommentStyle(char style) { return style == SCE_VHDL_BLOCK_COMMENT || style == SCE_VHDL_COMMENT || style == SCE_VHDL_COMMENTLINEBANG; } //============================================================================= // Folding the code static void FoldNoBoxVHDLDoc( Sci_PositionU startPos, Sci_Position length, int, Accessor &styler) { // Decided it would be smarter to have the lexer have all keywords included. Therefore I // don't check if the style for the keywords that I use to adjust the levels. char words[] = "architecture begin block case component else elsif end entity for generate loop package process record then " "procedure protected function when units"; WordList keywords; keywords.Set(words); bool foldComment = styler.GetPropertyInt("fold.comment", 1) != 0; bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; bool foldAtElse = styler.GetPropertyInt("fold.at.else", 1) != 0; bool foldAtBegin = styler.GetPropertyInt("fold.at.Begin", 1) != 0; bool foldAtParenthese = styler.GetPropertyInt("fold.at.Parenthese", 1) != 0; //bool foldAtWhen = styler.GetPropertyInt("fold.at.When", 1) != 0; //< fold at when in case statements int visibleChars = 0; Sci_PositionU endPos = startPos + length; Sci_Position lineCurrent = styler.GetLine(startPos); int levelCurrent = SC_FOLDLEVELBASE; if(lineCurrent > 0) levelCurrent = styler.LevelAt(lineCurrent-1) >> 16; //int levelMinCurrent = levelCurrent; int levelMinCurrentElse = levelCurrent; ///< Used for folding at 'else' int levelMinCurrentBegin = levelCurrent; ///< Used for folding at 'begin' int levelNext = levelCurrent; /***************************************/ Sci_Position lastStart = 0; char prevWord[32] = ""; /***************************************/ // Find prev word // The logic for going up or down a level depends on a the previous keyword // This code could be cleaned up. Sci_Position end = 0; Sci_PositionU j; for(j = startPos; j>0; j--) { char ch = styler.SafeGetCharAt(j); char chPrev = styler.SafeGetCharAt(j-1); int style = styler.StyleAt(j); int stylePrev = styler.StyleAt(j-1); if ((!IsCommentStyle(style)) && (stylePrev != SCE_VHDL_STRING)) { if(IsAWordChar(chPrev) && !IsAWordChar(ch)) { end = j-1; } } if ((!IsCommentStyle(style)) && (style != SCE_VHDL_STRING)) { if(!IsAWordChar(chPrev) && IsAWordStart(ch) && (end != 0)) { char s[32]; Sci_PositionU k; for(k=0; (k<31 ) && (k(tolower(styler[j+k])); } s[k] = '\0'; if(keywords.InList(s)) { strcpy(prevWord, s); break; } } } } for(j=j+static_cast(strlen(prevWord)); j(tolower(styler[lastStart+k])); } s[k] = '\0'; if(keywords.InList(s)) { if ( strcmp(s, "architecture") == 0 || strcmp(s, "case") == 0 || strcmp(s, "block") == 0 || strcmp(s, "loop") == 0 || strcmp(s, "package") ==0 || strcmp(s, "process") == 0 || strcmp(s, "protected") == 0 || strcmp(s, "record") == 0 || strcmp(s, "then") == 0 || strcmp(s, "units") == 0) { if (strcmp(prevWord, "end") != 0) { if (levelMinCurrentElse > levelNext) { levelMinCurrentElse = levelNext; } levelNext++; } } else if (strcmp(s, "generate") == 0){ if (strcmp(prevWord, "end") != 0 && strcmp(prevWord, "else") != 0 && // vhdl08 else generate strcmp(prevWord, "case") != 0) // vhdl08 case generate { if (levelMinCurrentElse > levelNext) { levelMinCurrentElse = levelNext; } levelNext++; } } else if ( strcmp(s, "component") == 0 || strcmp(s, "entity") == 0 || strcmp(s, "configuration") == 0 ) { if (strcmp(prevWord, "end") != 0) { // check for instantiated unit by backward searching for the colon. Sci_PositionU pos = lastStart; char chAtPos=0, styleAtPos; do{// skip white spaces if(!pos) break; pos--; styleAtPos = styler.StyleAt(pos); chAtPos = styler.SafeGetCharAt(pos); }while(pos && (chAtPos == ' ' || chAtPos == '\t' || chAtPos == '\n' || chAtPos == '\r' || IsCommentStyle(styleAtPos))); // check for a colon (':') before the instantiated units "entity", "component" or "configuration". Don't fold thereafter. if (chAtPos != ':') { if (levelMinCurrentElse > levelNext) { levelMinCurrentElse = levelNext; } levelNext++; } } } else if ( strcmp(s, "procedure") == 0 || strcmp(s, "function") == 0) { if (strcmp(prevWord, "end") != 0) // check for "end procedure" etc. { // This code checks to see if the procedure / function is a definition within a "package" // rather than the actual code in the body. int BracketLevel = 0; for(Sci_Position pos=i+1; pos levelNext) { levelMinCurrentElse = levelNext; } levelNext++; break; } if((BracketLevel == 0) && (chAtPos == ';')) { break; } } } } else if (strcmp(s, "end") == 0) { levelNext--; } else if(strcmp(s, "elsif") == 0) { // elsif is followed by then or generate so folding occurs correctly levelNext--; } else if (strcmp(s, "else") == 0) { if(strcmp(prevWord, "when") != 0) // ignore a <= x when y else z; { levelMinCurrentElse = levelNext - 1; // VHDL else is all on its own so just dec. the min level } } else if( ((strcmp(s, "begin") == 0) && (strcmp(prevWord, "architecture") == 0)) || ((strcmp(s, "begin") == 0) && (strcmp(prevWord, "function") == 0)) || ((strcmp(s, "begin") == 0) && (strcmp(prevWord, "procedure") == 0)) || ((strcmp(s, "begin") == 0) && (strcmp(prevWord, "generate") == 0))) { levelMinCurrentBegin = levelNext - 1; } //Platform::DebugPrintf("Line[%04d] Prev[%20s] Cur[%20s] Level[%x]\n", lineCurrent+1, prevWord, s, levelCurrent); strcpy(prevWord, s); } } } if (atEOL) { int levelUse = levelCurrent; if (foldAtElse && (levelMinCurrentElse < levelUse)) { levelUse = levelMinCurrentElse; } if (foldAtBegin && (levelMinCurrentBegin < levelUse)) { levelUse = levelMinCurrentBegin; } int lev = levelUse | levelNext << 16; if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if (levelUse < levelNext) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } //Platform::DebugPrintf("Line[%04d] ---------------------------------------------------- Level[%x]\n", lineCurrent+1, levelCurrent); lineCurrent++; levelCurrent = levelNext; //levelMinCurrent = levelCurrent; levelMinCurrentElse = levelCurrent; levelMinCurrentBegin = levelCurrent; visibleChars = 0; } /***************************************/ if (!isspacechar(ch)) visibleChars++; } /***************************************/ // Platform::DebugPrintf("Line[%04d] ---------------------------------------------------- Level[%x]\n", lineCurrent+1, levelCurrent); } //============================================================================= static void FoldVHDLDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *[], Accessor &styler) { FoldNoBoxVHDLDoc(startPos, length, initStyle, styler); } //============================================================================= static const char * const VHDLWordLists[] = { "Keywords", "Operators", "Attributes", "Standard Functions", "Standard Packages", "Standard Types", "User Words", 0, }; LexerModule lmVHDL(SCLEX_VHDL, ColouriseVHDLDoc, "vhdl", FoldVHDLDoc, VHDLWordLists); // Keyword: // access after alias all architecture array assert attribute begin block body buffer bus case component // configuration constant disconnect downto else elsif end entity exit file for function generate generic // group guarded if impure in inertial inout is label library linkage literal loop map new next null of // on open others out package port postponed procedure process pure range record register reject report // return select severity shared signal subtype then to transport type unaffected units until use variable // wait when while with // // Operators: // abs and mod nand nor not or rem rol ror sla sll sra srl xnor xor // // Attributes: // left right low high ascending image value pos val succ pred leftof rightof base range reverse_range // length delayed stable quiet transaction event active last_event last_active last_value driving // driving_value simple_name path_name instance_name // // Std Functions: // now readline read writeline write endfile resolved to_bit to_bitvector to_stdulogic to_stdlogicvector // to_stdulogicvector to_x01 to_x01z to_UX01 rising_edge falling_edge is_x shift_left shift_right rotate_left // rotate_right resize to_integer to_unsigned to_signed std_match to_01 // // Std Packages: // std ieee work standard textio std_logic_1164 std_logic_arith std_logic_misc std_logic_signed // std_logic_textio std_logic_unsigned numeric_bit numeric_std math_complex math_real vital_primitives // vital_timing // // Std Types: // boolean bit character severity_level integer real time delay_length natural positive string bit_vector // file_open_kind file_open_status line text side width std_ulogic std_ulogic_vector std_logic // std_logic_vector X01 X01Z UX01 UX01Z unsigned signed // lexilla/lexers/LexBatch.cxx0000664000175000017500000005611514647367374014727 0ustar neilneil// Scintilla source code edit control /** @file LexBatch.cxx ** Lexer for batch files. **/ // Copyright 1998-2001 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "InList.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; namespace { constexpr bool Is0To9(char ch) noexcept { return (ch >= '0') && (ch <= '9'); } bool IsAlphabetic(int ch) noexcept { return IsASCII(ch) && isalpha(ch); } inline bool AtEOL(Accessor &styler, Sci_PositionU i) { return (styler[i] == '\n') || ((styler[i] == '\r') && (styler.SafeGetCharAt(i + 1) != '\n')); } // Tests for BATCH Operators constexpr bool IsBOperator(char ch) noexcept { return (ch == '=') || (ch == '+') || (ch == '>') || (ch == '<') || (ch == '|') || (ch == '?') || (ch == '*')|| (ch == '&') || (ch == '(') || (ch == ')'); } // Tests for BATCH Separators constexpr bool IsBSeparator(char ch) noexcept { return (ch == '\\') || (ch == '.') || (ch == ';') || (ch == '\"') || (ch == '\'') || (ch == '/'); } // Tests for escape character constexpr bool IsEscaped(const char* wordStr, Sci_PositionU pos) noexcept { bool isQoted=false; while (pos>0){ pos--; if (wordStr[pos]=='^') isQoted=!isQoted; else break; } return isQoted; } constexpr bool IsQuotedBy(std::string_view svBuffer, char quote) noexcept { bool CurrentStatus = false; size_t pQuote = svBuffer.find(quote); while (pQuote != std::string_view::npos) { if (!IsEscaped(svBuffer.data(), pQuote)) { CurrentStatus = !CurrentStatus; } pQuote = svBuffer.find(quote, pQuote + 1); } return CurrentStatus; } // Tests for quote character constexpr bool textQuoted(const char *lineBuffer, Sci_PositionU endPos) noexcept { const std::string_view svBuffer(lineBuffer, endPos); return IsQuotedBy(svBuffer, '\"') || IsQuotedBy(svBuffer, '\''); } void ColouriseBatchDoc( Sci_PositionU startPos, Sci_Position length, int /*initStyle*/, WordList *keywordlists[], Accessor &styler) { // Always backtracks to the start of a line that is not a continuation // of the previous line if (startPos > 0) { Sci_Position ln = styler.GetLine(startPos); // Current line number while (startPos > 0) { ln--; if ((styler.SafeGetCharAt(startPos-3) == '^' && styler.SafeGetCharAt(startPos-2) == '\r' && styler.SafeGetCharAt(startPos-1) == '\n') || styler.SafeGetCharAt(startPos-2) == '^') { // handle '^' line continuation // When the line continuation is found, // set the Start Position to the Start of the previous line length+=startPos-styler.LineStart(ln); startPos=styler.LineStart(ln); } else break; } } char lineBuffer[1024] {}; styler.StartAt(startPos); styler.StartSegment(startPos); Sci_PositionU linePos = 0; Sci_PositionU startLine = startPos; bool continueProcessing = true; // Used to toggle Regular Keyword Checking bool isNotAssigned=false; // Used to flag Assignment in Set operation for (Sci_PositionU i = startPos; i < startPos + length; i++) { lineBuffer[linePos++] = styler[i]; if (AtEOL(styler, i) || (linePos >= sizeof(lineBuffer) - 1) || (i==startPos + length-1)) { // End of line (or of line buffer) (or End of Last Line) met, colourise it lineBuffer[linePos] = '\0'; const Sci_PositionU lengthLine=linePos; const Sci_PositionU endPos=i; const WordList &keywords = *keywordlists[0]; // Internal Commands const WordList &keywords2 = *keywordlists[1]; // External Commands (optional) // CHOICE, ECHO, GOTO, PROMPT and SET have Default Text that may contain Regular Keywords // Toggling Regular Keyword Checking off improves readability // Other Regular Keywords and External Commands / Programs might also benefit from toggling // Need a more robust algorithm to properly toggle Regular Keyword Checking bool stopLineProcessing=false; // Used to stop line processing if Comment or Drive Change found Sci_PositionU offset = 0; // Line Buffer Offset // Skip initial spaces while ((offset < lengthLine) && (isspacechar(lineBuffer[offset]))) { offset++; } // Colorize Default Text styler.ColourTo(startLine + offset - 1, SCE_BAT_DEFAULT); // Set External Command / Program Location Sci_PositionU cmdLoc = offset; // Check for Fake Label (Comment) or Real Label - return if found if (lineBuffer[offset] == ':') { if (lineBuffer[offset + 1] == ':') { // Colorize Fake Label (Comment) - :: is similar to REM, see http://content.techweb.com/winmag/columns/explorer/2000/21.htm styler.ColourTo(endPos, SCE_BAT_COMMENT); } else { // Colorize Real Label // :[\t ]*[^\t &+:<>|]+ const char *startLabelName = lineBuffer + offset + 1; const size_t whitespaceLength = strspn(startLabelName, "\t "); // Set of label-terminating characters determined experimentally const char *endLabel = strpbrk(startLabelName + whitespaceLength, "\t &+:<>|"); if (endLabel) { styler.ColourTo(startLine + offset + endLabel - startLabelName, SCE_BAT_LABEL); styler.ColourTo(endPos, SCE_BAT_AFTER_LABEL); // New style } else { styler.ColourTo(endPos, SCE_BAT_LABEL); } } stopLineProcessing=true; // Check for Drive Change (Drive Change is internal command) - return if found } else if ((IsAlphabetic(lineBuffer[offset])) && (lineBuffer[offset + 1] == ':') && ((isspacechar(lineBuffer[offset + 2])) || (((lineBuffer[offset + 2] == '\\')) && (isspacechar(lineBuffer[offset + 3]))))) { // Colorize Regular Keyword styler.ColourTo(endPos, SCE_BAT_WORD); stopLineProcessing=true; } // Check for Hide Command (@ECHO OFF/ON) if (lineBuffer[offset] == '@') { styler.ColourTo(startLine + offset, SCE_BAT_HIDE); offset++; } // Skip next spaces while ((offset < lengthLine) && (isspacechar(lineBuffer[offset]))) { offset++; } // Read remainder of line word-at-a-time or remainder-of-word-at-a-time while (offset < lengthLine && !stopLineProcessing) { if (offset > startLine) { // Colorize Default Text styler.ColourTo(startLine + offset - 1, SCE_BAT_DEFAULT); } char wordBuffer[81]{}; // Word Buffer - large to catch long paths // Copy word from Line Buffer into Word Buffer and convert to lower case Sci_PositionU wbl = 0; // Word Buffer Length for (; offset < lengthLine && wbl < 80 && !isspacechar(lineBuffer[offset]); wbl++, offset++) { wordBuffer[wbl] = MakeLowerCase(lineBuffer[offset]); } wordBuffer[wbl] = '\0'; const std::string_view wordView(wordBuffer); Sci_PositionU wbo = 0; // Word Buffer Offset - also Special Keyword Buffer Length // Check for Comment - return if found if (continueProcessing) { if ((wordView == "rem") || (wordBuffer[0] == ':' && wordBuffer[1] == ':')) { if ((offset == wbl) || !textQuoted(lineBuffer, offset - wbl)) { styler.ColourTo(startLine + offset - wbl - 1, SCE_BAT_DEFAULT); styler.ColourTo(endPos, SCE_BAT_COMMENT); break; } } } // Check for Separator if (IsBSeparator(wordBuffer[0])) { // Check for External Command / Program if ((cmdLoc == offset - wbl) && ((wordBuffer[0] == ':') || (wordBuffer[0] == '\\') || (wordBuffer[0] == '.'))) { // Reset Offset to re-process remainder of word offset -= (wbl - 1); // Colorize External Command / Program if (!keywords2) { styler.ColourTo(startLine + offset - 1, SCE_BAT_COMMAND); } else if (keywords2.InList(wordBuffer)) { styler.ColourTo(startLine + offset - 1, SCE_BAT_COMMAND); } else { styler.ColourTo(startLine + offset - 1, SCE_BAT_DEFAULT); } // Reset External Command / Program Location cmdLoc = offset; } else { // Reset Offset to re-process remainder of word offset -= (wbl - 1); // Colorize Default Text styler.ColourTo(startLine + offset - 1, SCE_BAT_DEFAULT); } // Check for Regular Keyword in list } else if ((keywords.InList(wordBuffer)) && (continueProcessing)) { // ECHO, GOTO, PROMPT and SET require no further Regular Keyword Checking if (InList(wordView, {"echo", "goto", "prompt"})) { continueProcessing = false; } // SET requires additional processing for the assignment operator if (wordView == "set") { continueProcessing = false; isNotAssigned=true; } // Identify External Command / Program Location for ERRORLEVEL, and EXIST if (InList(wordView, {"errorlevel", "exist"})) { // Reset External Command / Program Location cmdLoc = offset; // Skip next spaces while ((cmdLoc < lengthLine) && (isspacechar(lineBuffer[cmdLoc]))) { cmdLoc++; } // Skip comparison while ((cmdLoc < lengthLine) && (!isspacechar(lineBuffer[cmdLoc]))) { cmdLoc++; } // Skip next spaces while ((cmdLoc < lengthLine) && (isspacechar(lineBuffer[cmdLoc]))) { cmdLoc++; } // Identify External Command / Program Location for CALL, DO, LOADHIGH and LH } else if (InList(wordView, {"call", "do", "loadhigh", "lh"})) { // Reset External Command / Program Location cmdLoc = offset; // Skip next spaces while ((cmdLoc < lengthLine) && (isspacechar(lineBuffer[cmdLoc]))) { cmdLoc++; } // Check if call is followed by a label if ((lineBuffer[cmdLoc] == ':') && (wordView == "call")) { continueProcessing = false; } } // Colorize Regular keyword styler.ColourTo(startLine + offset - 1, SCE_BAT_WORD); // No need to Reset Offset // Check for Special Keyword in list, External Command / Program, or Default Text } else if ((wordBuffer[0] != '%') && (wordBuffer[0] != '!') && (!IsBOperator(wordBuffer[0])) && (continueProcessing)) { // Check for Special Keyword // Affected Commands are in Length range 2-6 // Good that ERRORLEVEL, EXIST, CALL, DO, LOADHIGH, and LH are unaffected bool sKeywordFound = false; // Exit Special Keyword for-loop if found for (Sci_PositionU keywordLength = 2; keywordLength < wbl && keywordLength < 7 && !sKeywordFound; keywordLength++) { // Special Keywords are those that allow certain characters without whitespace after the command // Examples are: cd. cd\ md. rd. dir| dir> echo: echo. path= // Special Keyword Buffer used to determine if the first n characters is a Keyword char sKeywordBuffer[10]{}; // Special Keyword Buffer wbo = 0; // Copy Keyword Length from Word Buffer into Special Keyword Buffer for (; wbo < keywordLength; wbo++) { sKeywordBuffer[wbo] = wordBuffer[wbo]; } sKeywordBuffer[wbo] = '\0'; // Check for Special Keyword in list if ((keywords.InList(sKeywordBuffer)) && ((IsBOperator(wordBuffer[wbo])) || (IsBSeparator(wordBuffer[wbo])) || (wordBuffer[wbo] == ':' && (InList(sKeywordBuffer, {"call", "echo", "goto"}) )))) { sKeywordFound = true; // ECHO requires no further Regular Keyword Checking if (std::string_view(sKeywordBuffer) == "echo") { continueProcessing = false; } // Colorize Special Keyword as Regular Keyword styler.ColourTo(startLine + offset - 1 - (wbl - wbo), SCE_BAT_WORD); // Reset Offset to re-process remainder of word offset -= (wbl - wbo); } } // Check for External Command / Program or Default Text if (!sKeywordFound) { wbo = 0; // Check for External Command / Program if (cmdLoc == offset - wbl) { // Read up to %, Operator or Separator while ((wbo < wbl) && (((wordBuffer[wbo] != '%') && (wordBuffer[wbo] != '!') && (!IsBOperator(wordBuffer[wbo])) && (!IsBSeparator(wordBuffer[wbo]))))) { wbo++; } // Reset External Command / Program Location cmdLoc = offset - (wbl - wbo); // Reset Offset to re-process remainder of word offset -= (wbl - wbo); // CHOICE requires no further Regular Keyword Checking if (wordView == "choice") { continueProcessing = false; } // Check for START (and its switches) - What follows is External Command \ Program if (wordView == "start") { // Reset External Command / Program Location cmdLoc = offset; // Skip next spaces while ((cmdLoc < lengthLine) && (isspacechar(lineBuffer[cmdLoc]))) { cmdLoc++; } // Reset External Command / Program Location if command switch detected if (lineBuffer[cmdLoc] == '/') { // Skip command switch while ((cmdLoc < lengthLine) && (!isspacechar(lineBuffer[cmdLoc]))) { cmdLoc++; } // Skip next spaces while ((cmdLoc < lengthLine) && (isspacechar(lineBuffer[cmdLoc]))) { cmdLoc++; } } } // Colorize External Command / Program if (!keywords2) { styler.ColourTo(startLine + offset - 1, SCE_BAT_COMMAND); } else if (keywords2.InList(wordBuffer)) { styler.ColourTo(startLine + offset - 1, SCE_BAT_COMMAND); } else { styler.ColourTo(startLine + offset - 1, SCE_BAT_DEFAULT); } // No need to Reset Offset // Check for Default Text } else { // Read up to %, Operator or Separator while ((wbo < wbl) && (((wordBuffer[wbo] != '%') && (wordBuffer[wbo] != '!') && (!IsBOperator(wordBuffer[wbo])) && (!IsBSeparator(wordBuffer[wbo]))))) { wbo++; } // Colorize Default Text styler.ColourTo(startLine + offset - 1 - (wbl - wbo), SCE_BAT_DEFAULT); // Reset Offset to re-process remainder of word offset -= (wbl - wbo); } } // Check for Argument (%n), Environment Variable (%x...%) or Local Variable (%%a) } else if (wordBuffer[0] == '%') { // Colorize Default Text styler.ColourTo(startLine + offset - 1 - wbl, SCE_BAT_DEFAULT); wbo++; // Search to end of word for second % (can be a long path) while ((wbo < wbl) && (wordBuffer[wbo] != '%')) { wbo++; } // Check for Argument (%n) or (%*) if (((Is0To9(wordBuffer[1])) || (wordBuffer[1] == '*')) && (wordBuffer[wbo] != '%')) { // Check for External Command / Program if (cmdLoc == offset - wbl) { cmdLoc = offset - (wbl - 2); } // Colorize Argument styler.ColourTo(startLine + offset - 1 - (wbl - 2), SCE_BAT_IDENTIFIER); // Reset Offset to re-process remainder of word offset -= (wbl - 2); // Check for Expanded Argument (%~...) / Variable (%%~...) // Expanded Argument: %~[] // Expanded Variable: %%~[] // Path operators are exclusively alphabetic. // Expanded arguments have a single digit at the end. // Expanded variables have a single identifier character as variable name. } else if (((wbl > 1) && (wordBuffer[1] == '~')) || ((wbl > 2) && (wordBuffer[1] == '%') && (wordBuffer[2] == '~'))) { // Check for External Command / Program if (cmdLoc == offset - wbl) { cmdLoc = offset - (wbl - wbo); } const bool isArgument = (wordBuffer[1] == '~'); if (isArgument) { Sci_PositionU expansionStopOffset = 2; bool isValid = false; for (; expansionStopOffset < wbl; expansionStopOffset++) { if (Is0To9(wordBuffer[expansionStopOffset])) { expansionStopOffset++; isValid = true; wbo = expansionStopOffset; // Colorize Expanded Argument styler.ColourTo(startLine + offset - 1 - (wbl - wbo), SCE_BAT_IDENTIFIER); break; } } if (!isValid) { // not a valid expanded argument or variable styler.ColourTo(startLine + offset - 1 - (wbl - wbo), SCE_BAT_DEFAULT); } // Expanded Variable } else { // start after ~ wbo = 3; // Search to end of word for another % (can be a long path) while ((wbo < wbl) && (wordBuffer[wbo] != '%') && (!IsBOperator(wordBuffer[wbo])) && (!IsBSeparator(wordBuffer[wbo]))) { wbo++; } if (wbo > 3) { // Colorize Expanded Variable styler.ColourTo(startLine + offset - 1 - (wbl - wbo), SCE_BAT_IDENTIFIER); } else { // not a valid expanded argument or variable styler.ColourTo(startLine + offset - 1 - (wbl - wbo), SCE_BAT_DEFAULT); } } // Reset Offset to re-process remainder of word offset -= (wbl - wbo); // Check for Environment Variable (%x...%) } else if ((wordBuffer[1] != '%') && (wordBuffer[wbo] == '%')) { wbo++; // Check for External Command / Program if (cmdLoc == offset - wbl) { cmdLoc = offset - (wbl - wbo); } // Colorize Environment Variable styler.ColourTo(startLine + offset - 1 - (wbl - wbo), SCE_BAT_IDENTIFIER); // Reset Offset to re-process remainder of word offset -= (wbl - wbo); // Check for Local Variable (%%a) } else if ( (wbl > 2) && (wordBuffer[1] == '%') && (wordBuffer[2] != '%') && (!IsBOperator(wordBuffer[2])) && (!IsBSeparator(wordBuffer[2]))) { // Check for External Command / Program if (cmdLoc == offset - wbl) { cmdLoc = offset - (wbl - 3); } // Colorize Local Variable styler.ColourTo(startLine + offset - 1 - (wbl - 3), SCE_BAT_IDENTIFIER); // Reset Offset to re-process remainder of word offset -= (wbl - 3); // escaped % } else if ( (wbl > 1) && (wordBuffer[1] == '%')) { // Reset Offset to re-process remainder of word styler.ColourTo(startLine + offset - 1 - (wbl - 2), SCE_BAT_DEFAULT); offset -= (wbl - 2); } // Check for Environment Variable (!x...!) } else if (wordBuffer[0] == '!') { // Colorize Default Text styler.ColourTo(startLine + offset - 1 - wbl, SCE_BAT_DEFAULT); wbo++; // Search to end of word for second ! (can be a long path) while ((wbo < wbl) && (wordBuffer[wbo] != '!')) { wbo++; } if (wordBuffer[wbo] == '!') { wbo++; // Check for External Command / Program if (cmdLoc == offset - wbl) { cmdLoc = offset - (wbl - wbo); } // Colorize Environment Variable styler.ColourTo(startLine + offset - 1 - (wbl - wbo), SCE_BAT_IDENTIFIER); // Reset Offset to re-process remainder of word offset -= (wbl - wbo); } // Check for Operator } else if (IsBOperator(wordBuffer[0])) { // Colorize Default Text styler.ColourTo(startLine + offset - 1 - wbl, SCE_BAT_DEFAULT); // Check for Comparison Operator if ((wordBuffer[0] == '=') && (wordBuffer[1] == '=')) { // Identify External Command / Program Location for IF cmdLoc = offset; // Skip next spaces while ((cmdLoc < lengthLine) && (isspacechar(lineBuffer[cmdLoc]))) { cmdLoc++; } // Colorize Comparison Operator if (continueProcessing) styler.ColourTo(startLine + offset - 1 - (wbl - 2), SCE_BAT_OPERATOR); else styler.ColourTo(startLine + offset - 1 - (wbl - 2), SCE_BAT_DEFAULT); // Reset Offset to re-process remainder of word offset -= (wbl - 2); // Check for Pipe Operator } else if ((wordBuffer[0] == '|') && !(IsEscaped(lineBuffer,offset - wbl + wbo) || textQuoted(lineBuffer, offset - wbl) )) { // Reset External Command / Program Location cmdLoc = offset - wbl + 1; // Skip next spaces while ((cmdLoc < lengthLine) && (isspacechar(lineBuffer[cmdLoc]))) { cmdLoc++; } // Colorize Pipe Operator styler.ColourTo(startLine + offset - 1 - (wbl - 1), SCE_BAT_OPERATOR); // Reset Offset to re-process remainder of word offset -= (wbl - 1); continueProcessing = true; // Check for Other Operator } else { // Check for Operators: >, |, & if (((wordBuffer[0] == '>')|| (wordBuffer[0] == ')')|| (wordBuffer[0] == '(')|| (wordBuffer[0] == '&' )) && !(!continueProcessing && (IsEscaped(lineBuffer,offset - wbl + wbo) || textQuoted(lineBuffer, offset - wbl) ))){ // Turn Keyword and External Command / Program checking back on continueProcessing = true; isNotAssigned=false; } // Colorize Other Operators // Do not Colorize Parenthesis, quoted text and escaped operators if (((wordBuffer[0] != ')') && (wordBuffer[0] != '(') && !textQuoted(lineBuffer, offset - wbl) && !IsEscaped(lineBuffer,offset - wbl + wbo)) && !((wordBuffer[0] == '=') && !isNotAssigned )) styler.ColourTo(startLine + offset - 1 - (wbl - 1), SCE_BAT_OPERATOR); else styler.ColourTo(startLine + offset - 1 - (wbl - 1), SCE_BAT_DEFAULT); // Reset Offset to re-process remainder of word offset -= (wbl - 1); if ((wordBuffer[0] == '=') && isNotAssigned ){ isNotAssigned=false; } } // Check for Default Text } else { // Read up to %, Operator or Separator while ((wbo < wbl) && ((wordBuffer[wbo] != '%') && (wordBuffer[wbo] != '!') && (!IsBOperator(wordBuffer[wbo])) && (!IsBSeparator(wordBuffer[wbo])))) { wbo++; } // Colorize Default Text styler.ColourTo(startLine + offset - 1 - (wbl - wbo), SCE_BAT_DEFAULT); // Reset Offset to re-process remainder of word offset -= (wbl - wbo); } // Skip next spaces - nothing happens if Offset was Reset while ((offset < lengthLine) && (isspacechar(lineBuffer[offset]))) { offset++; } } // Colorize Default Text for remainder of line - currently not lexed styler.ColourTo(endPos, SCE_BAT_DEFAULT); // handle line continuation for SET and ECHO commands except the last line if (!continueProcessing && (i2) && lineBuffer[linePos-2]=='\r') // Windows EOL lineContinuationPos=linePos-3; else lineContinuationPos=linePos-2; // Unix or Mac EOL // Reset continueProcessing if line continuation was not found if ((lineBuffer[lineContinuationPos]!='^') || IsEscaped(lineBuffer, lineContinuationPos) || textQuoted(lineBuffer, lineContinuationPos)) continueProcessing=true; } } linePos = 0; startLine = i + 1; } } } const char *const batchWordListDesc[] = { "Internal Commands", "External Commands", nullptr }; } LexerModule lmBatch(SCLEX_BATCH, ColouriseBatchDoc, "batch", nullptr, batchWordListDesc); lexilla/lexers/LexMetapost.cxx0000664000175000017500000002547314647367374015505 0ustar neilneil// Scintilla source code edit control // @file LexMetapost.cxx - general context conformant metapost coloring scheme // Author: Hans Hagen - PRAGMA ADE - Hasselt NL - www.pragma-ade.com // Version: September 28, 2003 // Modified by instanton: July 10, 2007 // Folding based on keywordlists[] // Copyright: 1998-2003 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. // This lexer is derived from the one written for the texwork environment (1999++) which in // turn is inspired on texedit (1991++) which finds its roots in wdt (1986). #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; // val SCE_METAPOST_DEFAULT = 0 // val SCE_METAPOST_SPECIAL = 1 // val SCE_METAPOST_GROUP = 2 // val SCE_METAPOST_SYMBOL = 3 // val SCE_METAPOST_COMMAND = 4 // val SCE_METAPOST_TEXT = 5 // Definitions in SciTEGlobal.properties: // // Metapost Highlighting // // # Default // style.metapost.0=fore:#7F7F00 // # Special // style.metapost.1=fore:#007F7F // # Group // style.metapost.2=fore:#880000 // # Symbol // style.metapost.3=fore:#7F7F00 // # Command // style.metapost.4=fore:#008800 // # Text // style.metapost.5=fore:#000000 // lexer.tex.comment.process=0 // Auxiliary functions: static inline bool endOfLine(Accessor &styler, Sci_PositionU i) { return (styler[i] == '\n') || ((styler[i] == '\r') && (styler.SafeGetCharAt(i + 1) != '\n')) ; } static inline bool isMETAPOSTcomment(int ch) { return (ch == '%') ; } static inline bool isMETAPOSTone(int ch) { return (ch == '[') || (ch == ']') || (ch == '(') || (ch == ')') || (ch == ':') || (ch == '=') || (ch == '<') || (ch == '>') || (ch == '{') || (ch == '}') || (ch == '\'') || (ch == '\"') ; } static inline bool isMETAPOSTtwo(int ch) { return (ch == ';') || (ch == '$') || (ch == '@') || (ch == '#'); } static inline bool isMETAPOSTthree(int ch) { return (ch == '.') || (ch == '-') || (ch == '+') || (ch == '/') || (ch == '*') || (ch == ',') || (ch == '|') || (ch == '`') || (ch == '!') || (ch == '?') || (ch == '^') || (ch == '&') || (ch == '%') ; } static inline bool isMETAPOSTidentifier(int ch) { return ((ch >= 'a') && (ch <= 'z')) || ((ch >= 'A') && (ch <= 'Z')) || (ch == '_') ; } static inline bool isMETAPOSTnumber(int ch) { return (ch >= '0') && (ch <= '9') ; } static inline bool isMETAPOSTstring(int ch) { return (ch == '\"') ; } static inline bool isMETAPOSTcolon(int ch) { return (ch == ':') ; } static inline bool isMETAPOSTequal(int ch) { return (ch == '=') ; } static int CheckMETAPOSTInterface( Sci_PositionU startPos, Sci_Position length, Accessor &styler, int defaultInterface) { char lineBuffer[1024] ; Sci_PositionU linePos = 0 ; // some day we can make something lexer.metapost.mapping=(none,0)(metapost,1)(mp,1)(metafun,2)... if (styler.SafeGetCharAt(0) == '%') { for (Sci_PositionU i = 0; i < startPos + length; i++) { lineBuffer[linePos++] = styler.SafeGetCharAt(i) ; if (endOfLine(styler, i) || (linePos >= sizeof(lineBuffer) - 1)) { lineBuffer[linePos] = '\0'; if (strstr(lineBuffer, "interface=none")) { return 0 ; } else if (strstr(lineBuffer, "interface=metapost") || strstr(lineBuffer, "interface=mp")) { return 1 ; } else if (strstr(lineBuffer, "interface=metafun")) { return 2 ; } else if (styler.SafeGetCharAt(1) == 'D' && strstr(lineBuffer, "%D \\module")) { // better would be to limit the search to just one line return 2 ; } else { return defaultInterface ; } } } } return defaultInterface ; } static void ColouriseMETAPOSTDoc( Sci_PositionU startPos, Sci_Position length, int, WordList *keywordlists[], Accessor &styler) { styler.StartAt(startPos) ; styler.StartSegment(startPos) ; bool processComment = styler.GetPropertyInt("lexer.metapost.comment.process", 0) == 1 ; int defaultInterface = styler.GetPropertyInt("lexer.metapost.interface.default", 1) ; int currentInterface = CheckMETAPOSTInterface(startPos,length,styler,defaultInterface) ; // 0 no keyword highlighting // 1 metapost keyword hightlighting // 2+ metafun keyword hightlighting int extraInterface = 0 ; if (currentInterface != 0) { extraInterface = currentInterface ; } WordList &keywords = *keywordlists[0] ; WordList kwEmpty; WordList &keywords2 = (extraInterface > 0) ? *keywordlists[extraInterface - 1] : kwEmpty; StyleContext sc(startPos, length, SCE_METAPOST_TEXT, styler) ; char key[100] ; bool inTeX = false ; bool inComment = false ; bool inString = false ; bool inClause = false ; bool going = sc.More() ; // needed because of a fuzzy end of file state for (; going; sc.Forward()) { if (! sc.More()) { going = false ; } // we need to go one behind the end of text if (inClause) { sc.SetState(SCE_METAPOST_TEXT) ; inClause = false ; } if (inComment) { if (sc.atLineEnd) { sc.SetState(SCE_METAPOST_TEXT) ; inTeX = false ; inComment = false ; inClause = false ; inString = false ; // not correct but we want to stimulate one-lines } } else if (inString) { if (isMETAPOSTstring(sc.ch)) { sc.SetState(SCE_METAPOST_SPECIAL) ; sc.ForwardSetState(SCE_METAPOST_TEXT) ; inString = false ; } else if (sc.atLineEnd) { sc.SetState(SCE_METAPOST_TEXT) ; inTeX = false ; inComment = false ; inClause = false ; inString = false ; // not correct but we want to stimulate one-lines } } else { if ((! isMETAPOSTidentifier(sc.ch)) && (sc.LengthCurrent() > 0)) { if (sc.state == SCE_METAPOST_COMMAND) { sc.GetCurrent(key, sizeof(key)) ; if ((strcmp(key,"btex") == 0) || (strcmp(key,"verbatimtex") == 0)) { sc.ChangeState(SCE_METAPOST_GROUP) ; inTeX = true ; } else if (inTeX) { if (strcmp(key,"etex") == 0) { sc.ChangeState(SCE_METAPOST_GROUP) ; inTeX = false ; } else { sc.ChangeState(SCE_METAPOST_TEXT) ; } } else { if (keywords && keywords.InList(key)) { sc.ChangeState(SCE_METAPOST_COMMAND) ; } else if (keywords2 && keywords2.InList(key)) { sc.ChangeState(SCE_METAPOST_EXTRA) ; } else { sc.ChangeState(SCE_METAPOST_TEXT) ; } } } } if (isMETAPOSTcomment(sc.ch)) { if (! inTeX) { sc.SetState(SCE_METAPOST_SYMBOL) ; sc.ForwardSetState(SCE_METAPOST_DEFAULT) ; inComment = ! processComment ; } else { sc.SetState(SCE_METAPOST_TEXT) ; } } else if (isMETAPOSTstring(sc.ch)) { if (! inTeX) { sc.SetState(SCE_METAPOST_SPECIAL) ; if (! isMETAPOSTstring(sc.chNext)) { sc.ForwardSetState(SCE_METAPOST_TEXT) ; } inString = true ; } else { sc.SetState(SCE_METAPOST_TEXT) ; } } else if (isMETAPOSTcolon(sc.ch)) { if (! inTeX) { if (! isMETAPOSTequal(sc.chNext)) { sc.SetState(SCE_METAPOST_COMMAND) ; inClause = true ; } else { sc.SetState(SCE_METAPOST_SPECIAL) ; } } else { sc.SetState(SCE_METAPOST_TEXT) ; } } else if (isMETAPOSTone(sc.ch)) { if (! inTeX) { sc.SetState(SCE_METAPOST_SPECIAL) ; } else { sc.SetState(SCE_METAPOST_TEXT) ; } } else if (isMETAPOSTtwo(sc.ch)) { if (! inTeX) { sc.SetState(SCE_METAPOST_GROUP) ; } else { sc.SetState(SCE_METAPOST_TEXT) ; } } else if (isMETAPOSTthree(sc.ch)) { if (! inTeX) { sc.SetState(SCE_METAPOST_SYMBOL) ; } else { sc.SetState(SCE_METAPOST_TEXT) ; } } else if (isMETAPOSTidentifier(sc.ch)) { if (sc.state != SCE_METAPOST_COMMAND) { sc.SetState(SCE_METAPOST_TEXT) ; sc.ChangeState(SCE_METAPOST_COMMAND) ; } } else if (isMETAPOSTnumber(sc.ch)) { // rather redundant since for the moment we don't handle numbers sc.SetState(SCE_METAPOST_TEXT) ; } else if (sc.atLineEnd) { sc.SetState(SCE_METAPOST_TEXT) ; inTeX = false ; inComment = false ; inClause = false ; inString = false ; } else { sc.SetState(SCE_METAPOST_TEXT) ; } } } sc.Complete(); } // Hooks info the system: static const char * const metapostWordListDesc[] = { "MetaPost", "MetaFun", 0 } ; static int classifyFoldPointMetapost(const char* s,WordList *keywordlists[]) { WordList& keywordsStart=*keywordlists[3]; WordList& keywordsStop1=*keywordlists[4]; if (keywordsStart.InList(s)) {return 1;} else if (keywordsStop1.InList(s)) {return -1;} return 0; } static int ParseMetapostWord(Sci_PositionU pos, Accessor &styler, char *word) { int length=0; char ch=styler.SafeGetCharAt(pos); *word=0; while(isMETAPOSTidentifier(ch) && isalpha(ch) && length<100){ word[length]=ch; length++; ch=styler.SafeGetCharAt(pos+length); } word[length]=0; return length; } static void FoldMetapostDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *keywordlists[], Accessor &styler) { bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; Sci_PositionU endPos = startPos+length; int visibleChars=0; Sci_Position lineCurrent=styler.GetLine(startPos); int levelPrev=styler.LevelAt(lineCurrent) & SC_FOLDLEVELNUMBERMASK; int levelCurrent=levelPrev; char chNext=styler[startPos]; char buffer[100]=""; for (Sci_PositionU i=startPos; i < endPos; i++) { char ch=chNext; chNext=styler.SafeGetCharAt(i+1); char chPrev=styler.SafeGetCharAt(i-1); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if(i==0 || chPrev == '\r' || chPrev=='\n'|| chPrev==' '|| chPrev=='(' || chPrev=='$') { ParseMetapostWord(i, styler, buffer); levelCurrent += classifyFoldPointMetapost(buffer,keywordlists); } if (atEOL) { int lev = levelPrev; if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if ((levelCurrent > levelPrev) && (visibleChars > 0)) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelPrev = levelCurrent; visibleChars = 0; } if (!isspacechar(ch)) visibleChars++; } // Fill in the real level of the next line, keeping the current flags as they will be filled in later int flagsNext = styler.LevelAt(lineCurrent) & ~SC_FOLDLEVELNUMBERMASK; styler.SetLevel(lineCurrent, levelPrev | flagsNext); } LexerModule lmMETAPOST(SCLEX_METAPOST, ColouriseMETAPOSTDoc, "metapost", FoldMetapostDoc, metapostWordListDesc); lexilla/lexers/LexMatlab.cxx0000664000175000017500000004305314647367374015103 0ustar neilneil// Scintilla source code edit control // Encoding: UTF-8 /** @file LexMatlab.cxx ** Lexer for Matlab. ** Written by José Fonseca ** ** Changes by Christoph Dalitz 2003/12/04: ** - added support for Octave ** - Strings can now be included both in single or double quotes ** ** Changes by John Donoghue 2012/04/02 ** - added block comment (and nested block comments) ** - added ... displayed as a comment ** - removed unused IsAWord functions ** - added some comments ** ** Changes by John Donoghue 2014/08/01 ** - fix allowed transpose ' after {} operator ** ** Changes by John Donoghue 2016/11/15 ** - update matlab code folding ** ** Changes by John Donoghue 2017/01/18 ** - update matlab block comment detection ** ** Changes by Andrey Smolyakov 2022/04/15 ** - add support for "arguments" block and class definition syntax **/ // Copyright 1998-2001 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static bool IsMatlabCommentChar(int c) { return (c == '%') ; } static bool IsOctaveCommentChar(int c) { return (c == '%' || c == '#') ; } static inline int LowerCase(int c) { if (c >= 'A' && c <= 'Z') return 'a' + c - 'A'; return c; } static int CheckKeywordFoldPoint(char *str) { if (strcmp ("if", str) == 0 || strcmp ("for", str) == 0 || strcmp ("switch", str) == 0 || strcmp ("while", str) == 0 || strcmp ("try", str) == 0 || strcmp ("do", str) == 0 || strcmp ("parfor", str) == 0 || strcmp ("classdef", str) == 0 || strcmp ("spmd", str) == 0 || strcmp ("arguments", str) == 0 || strcmp ("methods", str) == 0 || strcmp ("properties", str) == 0 || strcmp ("events", str) == 0 || strcmp ("function", str) == 0) return 1; if (strncmp("end", str, 3) == 0 || strcmp("until", str) == 0) return -1; return 0; } static bool IsSpaceToEOL(Sci_Position startPos, Accessor &styler) { Sci_Position line = styler.GetLine(startPos); Sci_Position eol_pos = styler.LineStart(line + 1) - 1; for (Sci_Position i = startPos; i < eol_pos; i++) { char ch = styler[i]; if(!IsASpace(ch)) return false; } return true; } #define MATLAB_STATE_FOLD_LVL_OFFSET 8 #define MATLAB_STATE_FOLD_LVL_MASK (0xFF00) #define MATLAB_STATE_FLAGS_OFFSET 16 #define MATLAB_STATE_COMM_DEPTH_OFFSET 0 #define MATLAB_STATE_COMM_DEPTH_MASK (0xFF) #define MATLAB_STATE_EXPECTING_ARG_BLOCK (1 << MATLAB_STATE_FLAGS_OFFSET) #define MATLAB_STATE_IN_CLASS_SCOPE (1 <<(MATLAB_STATE_FLAGS_OFFSET+1)) #define MATLAB_STATE_IN_ARGUMENTS_SCOPE (1 <<(MATLAB_STATE_FLAGS_OFFSET+2)) static int ComposeLineState(int commentDepth, int foldingLevel, int expectingArgumentsBlock, int inClassScope, int inArgumentsScope) { return ((commentDepth << MATLAB_STATE_COMM_DEPTH_OFFSET) & MATLAB_STATE_COMM_DEPTH_MASK) | ((foldingLevel << MATLAB_STATE_FOLD_LVL_OFFSET) & MATLAB_STATE_FOLD_LVL_MASK) | (expectingArgumentsBlock & MATLAB_STATE_EXPECTING_ARG_BLOCK) | (inClassScope & MATLAB_STATE_IN_CLASS_SCOPE) | (inArgumentsScope & MATLAB_STATE_IN_ARGUMENTS_SCOPE); } static void ColouriseMatlabOctaveDoc( Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler, bool (*IsCommentChar)(int), bool ismatlab) { WordList &keywords = *keywordlists[0]; styler.StartAt(startPos); // boolean for when the ' is allowed to be transpose vs the start/end // of a string bool transpose = false; // count of brackets as boolean for when end could be an operator not a keyword int allow_end_op = 0; // approximate position of first non space character in a line int nonSpaceColumn = -1; // approximate column position of the current character in a line int column = 0; // This line contains a function declaration bool funcDeclarationLine = false; // We've just seen "function" keyword, so now we may expect the "arguments" // keyword opening the corresponding code block int expectingArgumentsBlock = 0; // We saw "arguments" keyword, but not the closing "end" int inArgumentsScope = 0; // Current line's folding level int foldingLevel = 0; // Current line in in class scope int inClassScope = 0; // use the line state of each line to store the block comment depth Sci_Position curLine = styler.GetLine(startPos); int commentDepth = 0; // Restore the previous line's state, if there was such a line if (curLine > 0) { int prevState = styler.GetLineState(curLine-1); commentDepth = (prevState & MATLAB_STATE_COMM_DEPTH_MASK) >> MATLAB_STATE_COMM_DEPTH_OFFSET; foldingLevel = (prevState & MATLAB_STATE_FOLD_LVL_MASK) >> MATLAB_STATE_FOLD_LVL_OFFSET; expectingArgumentsBlock = prevState & MATLAB_STATE_EXPECTING_ARG_BLOCK; inClassScope = prevState & MATLAB_STATE_IN_CLASS_SCOPE; inArgumentsScope = prevState & MATLAB_STATE_IN_ARGUMENTS_SCOPE; } StyleContext sc(startPos, length, initStyle, styler); for (; sc.More(); sc.Forward(), column++) { if(sc.atLineStart) { // set the line state to the current commentDepth curLine = styler.GetLine(sc.currentPos); styler.SetLineState(curLine, ComposeLineState( commentDepth, foldingLevel, expectingArgumentsBlock, inClassScope, inArgumentsScope)); // reset the column to 0, nonSpace to -1 (not set) column = 0; nonSpaceColumn = -1; // Reset the flag funcDeclarationLine = false; } // Semicolon ends function declaration // This condition is for one line functions support if (sc.chPrev == ';') { funcDeclarationLine = false; } // Only comments allowed between the function declaration and the // arguments code block if (expectingArgumentsBlock && !(funcDeclarationLine || inArgumentsScope)) { if ((sc.state != SCE_MATLAB_KEYWORD) && (sc.state != SCE_MATLAB_COMMENT) && (sc.state != SCE_MATLAB_DEFAULT) && !(sc.state == SCE_MATLAB_OPERATOR && sc.chPrev == ';')) { expectingArgumentsBlock = 0; styler.SetLineState(curLine, ComposeLineState( commentDepth, foldingLevel, expectingArgumentsBlock, inClassScope, inArgumentsScope)); } } // We've just left the class scope if ((foldingLevel ==0) && inClassScope) { inClassScope = 0; } // save the column position of first non space character in a line if((nonSpaceColumn == -1) && (! IsASpace(sc.ch))) { nonSpaceColumn = column; } // check for end of states if (sc.state == SCE_MATLAB_OPERATOR) { if (sc.chPrev == '.') { if (sc.ch == '*' || sc.ch == '/' || sc.ch == '\\' || sc.ch == '^') { sc.ForwardSetState(SCE_MATLAB_DEFAULT); transpose = false; } else if (sc.ch == '\'') { sc.ForwardSetState(SCE_MATLAB_DEFAULT); transpose = true; } else if(sc.ch == '.' && sc.chNext == '.') { // we werent an operator, but a '...' sc.ChangeState(SCE_MATLAB_COMMENT); transpose = false; } else { sc.SetState(SCE_MATLAB_DEFAULT); } } else { sc.SetState(SCE_MATLAB_DEFAULT); } } else if (sc.state == SCE_MATLAB_KEYWORD) { if (!isalnum(sc.ch) && sc.ch != '_') { char s[100]; sc.GetCurrent(s, sizeof(s)); bool notKeyword = false; transpose = false; if (keywords.InList(s)) { expectingArgumentsBlock = (funcDeclarationLine || inArgumentsScope) ? expectingArgumentsBlock : 0; if (strcmp ("end", s) == 0 && allow_end_op) { sc.ChangeState(SCE_MATLAB_NUMBER); notKeyword = true; } else if (strcmp("end", s) == 0 && !allow_end_op) { inArgumentsScope = 0; } else if (strcmp("function", s) == 0) { // Need this flag to handle "arguments" block correctly funcDeclarationLine = true; expectingArgumentsBlock = ismatlab ? MATLAB_STATE_EXPECTING_ARG_BLOCK : 0; } else if (strcmp("classdef", s) == 0) { // Need this flag to process "events", "methods" and "properties" blocks inClassScope = MATLAB_STATE_IN_CLASS_SCOPE; } } else { // "arguments" is a keyword here, despite not being in the keywords list if (expectingArgumentsBlock && !(funcDeclarationLine || inArgumentsScope) && (strcmp("arguments", s) == 0)) { // We've entered an "arguments" block inArgumentsScope = MATLAB_STATE_IN_ARGUMENTS_SCOPE; } else { // Found an identifier or a keyword after the function declaration // No need to wait for the arguments block anymore expectingArgumentsBlock = (funcDeclarationLine || inArgumentsScope) ? expectingArgumentsBlock : 0; // "properties", "methods" and "events" are not keywords if they're declared // inside some function in methods block // To avoid tracking possible nested functions scopes, lexer considers everything // beyond level 2 of folding to be in a scope of some function declared in the // methods block. It is ok for the valid syntax: classes can only be declared in // a separate file, function - only in methods block. However, in case of the invalid // syntax lexer may erroneously ignore a keyword. if (!((inClassScope) && (foldingLevel <= 2) && ( strcmp("properties", s) == 0 || strcmp("methods", s) == 0 || strcmp("events", s) == 0 ))) { sc.ChangeState(SCE_MATLAB_IDENTIFIER); transpose = true; notKeyword = true; } } } sc.SetState(SCE_MATLAB_DEFAULT); if (!notKeyword) { foldingLevel += CheckKeywordFoldPoint(s); } } styler.SetLineState(curLine, ComposeLineState( commentDepth, foldingLevel, expectingArgumentsBlock, inClassScope, inArgumentsScope)); } else if (sc.state == SCE_MATLAB_NUMBER) { if (!isdigit(sc.ch) && sc.ch != '.' && !(sc.ch == 'e' || sc.ch == 'E') && !((sc.ch == '+' || sc.ch == '-') && (sc.chPrev == 'e' || sc.chPrev == 'E')) && !(((sc.ch == 'x' || sc.ch == 'X') && sc.chPrev == '0') || (sc.ch >= 'a' && sc.ch <= 'f') || (sc.ch >= 'A' && sc.ch <= 'F')) && !(sc.ch == 's' || sc.ch == 'S' || sc.ch == 'u' || sc.ch == 'U') && !(sc.ch == 'i' || sc.ch == 'I' || sc.ch == 'j' || sc.ch == 'J') && !(sc.ch == '_')) { sc.SetState(SCE_MATLAB_DEFAULT); transpose = true; } } else if (sc.state == SCE_MATLAB_STRING) { if (sc.ch == '\'') { if (sc.chNext == '\'') { sc.Forward(); } else { sc.ForwardSetState(SCE_MATLAB_DEFAULT); } } else if (sc.MatchLineEnd()) { sc.SetState(SCE_MATLAB_DEFAULT); } } else if (sc.state == SCE_MATLAB_DOUBLEQUOTESTRING) { if (sc.ch == '\\' && !ismatlab) { sc.Forward(); // skip escape sequence, new line and others after backlash } else if (sc.ch == '\"') { sc.ForwardSetState(SCE_MATLAB_DEFAULT); } else if (sc.MatchLineEnd()) { sc.SetState(SCE_MATLAB_DEFAULT); } } else if (sc.state == SCE_MATLAB_COMMAND) { if (sc.atLineEnd) { sc.SetState(SCE_MATLAB_DEFAULT); transpose = false; } } else if (sc.state == SCE_MATLAB_COMMENT) { // end or start of a nested a block comment? if( IsCommentChar(sc.ch) && sc.chNext == '}' && nonSpaceColumn == column && IsSpaceToEOL(sc.currentPos+2, styler)) { if(commentDepth > 0) commentDepth --; curLine = styler.GetLine(sc.currentPos); styler.SetLineState(curLine, ComposeLineState( commentDepth, foldingLevel, expectingArgumentsBlock, inClassScope, inArgumentsScope)); sc.Forward(); if (commentDepth == 0) { sc.ForwardSetState(SCE_MATLAB_DEFAULT); transpose = false; } } else if( IsCommentChar(sc.ch) && sc.chNext == '{' && nonSpaceColumn == column && IsSpaceToEOL(sc.currentPos+2, styler)) { commentDepth ++; curLine = styler.GetLine(sc.currentPos); styler.SetLineState(curLine, ComposeLineState( commentDepth, foldingLevel, expectingArgumentsBlock, inClassScope, inArgumentsScope)); sc.Forward(); transpose = false; } else if(commentDepth == 0) { // single line comment if (sc.atLineEnd || sc.ch == '\r' || sc.ch == '\n') { sc.SetState(SCE_MATLAB_DEFAULT); transpose = false; } } } // check start of a new state if (sc.state == SCE_MATLAB_DEFAULT) { if (IsCommentChar(sc.ch)) { // ncrement depth if we are a block comment if(sc.chNext == '{' && nonSpaceColumn == column) { if(IsSpaceToEOL(sc.currentPos+2, styler)) { commentDepth ++; } } curLine = styler.GetLine(sc.currentPos); styler.SetLineState(curLine, ComposeLineState( commentDepth, foldingLevel, expectingArgumentsBlock, inClassScope, inArgumentsScope)); sc.SetState(SCE_MATLAB_COMMENT); } else if (sc.ch == '!' && sc.chNext != '=' ) { if(ismatlab) { sc.SetState(SCE_MATLAB_COMMAND); } else { sc.SetState(SCE_MATLAB_OPERATOR); } } else if (sc.ch == '\'') { if (transpose) { sc.SetState(SCE_MATLAB_OPERATOR); } else { sc.SetState(SCE_MATLAB_STRING); } } else if (sc.ch == '"') { sc.SetState(SCE_MATLAB_DOUBLEQUOTESTRING); } else if (isdigit(sc.ch) || (sc.ch == '.' && isdigit(sc.chNext))) { sc.SetState(SCE_MATLAB_NUMBER); } else if (isalpha(sc.ch)) { sc.SetState(SCE_MATLAB_KEYWORD); } else if (isoperator(static_cast(sc.ch)) || sc.ch == '@' || sc.ch == '\\') { if (sc.ch == '(' || sc.ch == '[' || sc.ch == '{') { allow_end_op ++; } else if ((sc.ch == ')' || sc.ch == ']' || sc.ch == '}') && (allow_end_op > 0)) { allow_end_op --; } if (sc.ch == ')' || sc.ch == ']' || sc.ch == '}') { transpose = true; } else { transpose = false; } sc.SetState(SCE_MATLAB_OPERATOR); } else { transpose = false; } } } sc.Complete(); } static void ColouriseMatlabDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { ColouriseMatlabOctaveDoc(startPos, length, initStyle, keywordlists, styler, IsMatlabCommentChar, true); } static void ColouriseOctaveDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { ColouriseMatlabOctaveDoc(startPos, length, initStyle, keywordlists, styler, IsOctaveCommentChar, false); } static void FoldMatlabOctaveDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *[], Accessor &styler, bool (*IsComment)(int ch)) { if (styler.GetPropertyInt("fold") == 0) return; const bool foldComment = styler.GetPropertyInt("fold.comment") != 0; const bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelCurrent = SC_FOLDLEVELBASE; if (lineCurrent > 0) levelCurrent = styler.LevelAt(lineCurrent-1) >> 16; int levelNext = levelCurrent; char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); int style = initStyle; char word[100]; int wordlen = 0; for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); style = styleNext; styleNext = styler.StyleAt(i + 1); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); // a line that starts with a comment if (foldComment && style == SCE_MATLAB_COMMENT && IsComment(ch) && visibleChars == 0) { // start/end of block comment if (chNext == '{' && IsSpaceToEOL(i+2, styler)) levelNext ++; if (chNext == '}' && IsSpaceToEOL(i+2, styler)) levelNext --; } // keyword if(style == SCE_MATLAB_KEYWORD) { word[wordlen++] = static_cast(LowerCase(ch)); if (wordlen == 100) { // prevent overflow word[0] = '\0'; wordlen = 1; } if (styleNext != SCE_MATLAB_KEYWORD) { word[wordlen] = '\0'; wordlen = 0; levelNext += CheckKeywordFoldPoint(word); } } if (!IsASpace(ch)) visibleChars++; if (atEOL || (i == endPos-1)) { int levelUse = levelCurrent; int lev = levelUse | levelNext << 16; if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if (levelUse < levelNext) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelCurrent = levelNext; if (atEOL && (i == static_cast(styler.Length() - 1))) { // There is an empty line at end of file so give it same level and empty styler.SetLevel(lineCurrent, (levelCurrent | levelCurrent << 16) | SC_FOLDLEVELWHITEFLAG); } visibleChars = 0; } } } static void FoldMatlabDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { FoldMatlabOctaveDoc(startPos, length, initStyle, keywordlists, styler, IsMatlabCommentChar); } static void FoldOctaveDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { FoldMatlabOctaveDoc(startPos, length, initStyle, keywordlists, styler, IsOctaveCommentChar); } static const char * const matlabWordListDesc[] = { "Keywords", 0 }; static const char * const octaveWordListDesc[] = { "Keywords", 0 }; LexerModule lmMatlab(SCLEX_MATLAB, ColouriseMatlabDoc, "matlab", FoldMatlabDoc, matlabWordListDesc); LexerModule lmOctave(SCLEX_OCTAVE, ColouriseOctaveDoc, "octave", FoldOctaveDoc, octaveWordListDesc); lexilla/lexers/LexMaxima.cxx0000664000175000017500000001165514647367374015122 0ustar neilneil// Scintilla source code edit control /** @file LexMaxima.cxx ** Lexer for Maxima (http://maxima.sourceforge.net). ** Written by Gunter Königsmann based on the lisp lexer by Alexey Yutkin and Neil Hodgson . **/ // Copyright 2018 by Gunter Königsmann // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static inline bool isMaximaoperator(char ch) { return (ch == '\'' || ch == '`' || ch == '(' || ch == ')' || ch == '[' || ch == ']' || ch == '{' || ch == '}' || ch == '!' || ch == '*' || ch == '/' || ch == '^' || ch == ',' || ch == ':' || ch == '+' || ch == '-'); } static void ColouriseMaximaDoc(Sci_PositionU startPos, Sci_Position length, int lastStyle, WordList *[], Accessor &styler) { styler.StartAt(startPos); Sci_PositionU lengthDoc = startPos + length; styler.StartSegment(startPos); Sci_PositionU i = startPos; // If we are in the middle of a comment we go back to its start before highlighting if(lastStyle == SCE_MAXIMA_COMMENT) { while((i>0) && !((styler.SafeGetCharAt(i+1) == '*') && (styler.SafeGetCharAt(i) == '/'))) i--; } for (; i < lengthDoc; i++) { char ch = styler.SafeGetCharAt(i); char chNext = styler.SafeGetCharAt(i + 1); if (styler.IsLeadByte(ch)) continue; // Handle comments. // Comments start with /* and end with */ if((ch == '/') && (chNext == '*')) { i++;i++; chNext = styler.SafeGetCharAt(i); for (; i < lengthDoc; i++) { ch = chNext; chNext = styler.SafeGetCharAt(i + 1); if((ch == '*') && (chNext == '/')) { i++; i++; break; } } if(i > lengthDoc) i = lengthDoc; i--; styler.ColourTo(i, SCE_MAXIMA_COMMENT); continue; } // Handle Operators if(isMaximaoperator(ch)) { styler.ColourTo(i, SCE_MAXIMA_OPERATOR); continue; } // Handle command endings. if((ch == '$') || (ch == ';')) { styler.ColourTo(i, SCE_MAXIMA_COMMANDENDING); continue; } // Handle numbers. Numbers always begin with a digit. if(IsASCII(ch) && isdigit(ch)) { i++; for (; i < lengthDoc; i++) { ch = chNext; chNext = styler.SafeGetCharAt(i + 1); if(ch == '.') continue; // A "e" or similar can be followed by a "+" or a "-" if(((ch == 'e') || (ch == 'b') || (ch == 'g') || (ch == 'f')) && ((chNext == '+') || (chNext == '-'))) { i++; chNext = styler.SafeGetCharAt(i + 1); continue; } if(!IsASCII(ch) || !(isdigit(ch) || islower(ch) || isupper(ch))) { i--; break; } } styler.ColourTo(i, SCE_MAXIMA_NUMBER); continue; } // Handle strings if(ch == '\"') { i++; for (; i < lengthDoc; i++) { ch = chNext; chNext = styler.SafeGetCharAt(i + 1); if(ch == '\\') i++; else { if(ch == '\"') break; } } styler.ColourTo(i, SCE_MAXIMA_STRING); continue; } // Handle keywords. Maxima treats Non-ASCII chars as ordinary letters. if(((!IsASCII(ch))) || isalpha(ch) || (ch == '_')) { char cmd[100]; int cmdidx = 0; memset(cmd,0,100); cmd[cmdidx++] = ch; i++; for (; i < lengthDoc; i++) { ch = chNext; chNext = styler.SafeGetCharAt(i + 1); if(ch == '\\') { if(cmdidx < 99) cmd[cmdidx++] = ch; i++; if(cmdidx < 99) cmd[cmdidx++] = ch; continue; } if(isMaximaoperator(ch) || ((IsASCII(ch) && !isalpha(ch) && !isdigit(ch) && (ch != '_')))) { i--; break; } if(cmdidx < 99) cmd[cmdidx++] = ch; } // A few known keywords if( (strncmp(cmd,"if",99) == 0) || (strncmp(cmd,"then",99) == 0) || (strncmp(cmd,"else",99) == 0) || (strncmp(cmd,"thru",99) == 0) || (strncmp(cmd,"for",99) == 0) || (strncmp(cmd,"while",99) == 0) || (strncmp(cmd,"do",99) == 0) ) { styler.ColourTo(i, SCE_MAXIMA_COMMAND); continue; } // All other keywords are functions if they are followed // by an opening parenthesis char nextNonwhitespace = ' '; for (Sci_PositionU o = i + 1; o < lengthDoc; o++) { nextNonwhitespace = styler.SafeGetCharAt(o); if(!IsASCII(nextNonwhitespace) || !isspacechar(nextNonwhitespace)) break; } if(nextNonwhitespace == '(') { styler.ColourTo(i, SCE_MAXIMA_COMMAND); } else { styler.ColourTo(i, SCE_MAXIMA_VARIABLE); } continue; } styler.ColourTo(i-1, SCE_MAXIMA_UNKNOWN); } } LexerModule lmMaxima(SCLEX_MAXIMA, ColouriseMaximaDoc, "maxima", 0, 0); lexilla/lexers/LexMPT.cxx0000664000175000017500000001223614647367374014342 0ustar neilneil// Scintilla source code edit control /** @file LexMPT.cxx ** Lexer for MPT specific files. Based on LexOthers.cxx ** LOT = the text log file created by the MPT application while running a test program ** Other MPT specific files to be added later. **/ // Copyright 2003 by Marius Gheorghe // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static int GetLotLineState(std::string &line) { if (line.length()) { // Most of the time the first non-blank character in line determines that line's type // Now finds the first non-blank character unsigned i; // Declares counter here to make it persistent after the for loop for (i = 0; i < line.length(); ++i) { if (!(IsASCII(line[i]) && isspace(line[i]))) break; } // Checks if it was a blank line if (i == line.length()) return SCE_LOT_DEFAULT; switch (line[i]) { case '*': // Fail measurement return SCE_LOT_FAIL; case '+': // Header case '|': // Header return SCE_LOT_HEADER; case ':': // Set test limits return SCE_LOT_SET; case '-': // Section break return SCE_LOT_BREAK; default: // Any other line // Checks for message at the end of lot file if (line.find("PASSED") != std::string::npos) { return SCE_LOT_PASS; } else if (line.find("FAILED") != std::string::npos) { return SCE_LOT_FAIL; } else if (line.find("ABORTED") != std::string::npos) { return SCE_LOT_ABORT; } else { return i ? SCE_LOT_PASS : SCE_LOT_DEFAULT; } } } else { return SCE_LOT_DEFAULT; } } static void ColourizeLotDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { styler.StartAt(startPos); styler.StartSegment(startPos); bool atLineStart = true;// Arms the 'at line start' flag char chNext = styler.SafeGetCharAt(startPos); std::string line(""); line.reserve(256); // Lot lines are less than 256 chars long most of the time. This should avoid reallocations // Styles LOT document Sci_PositionU i; // Declared here because it's used after the for loop for (i = startPos; i < startPos + length; ++i) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); line += ch; atLineStart = false; // LOT files are only used on the Win32 platform, thus EOL == CR+LF // Searches for the end of line if (ch == '\r' && chNext == '\n') { line += chNext; // Gets the '\n' ++i; // Advances past the '\n' chNext = styler.SafeGetCharAt(i + 1); // Gets character of next line styler.ColourTo(i, GetLotLineState(line)); line = ""; atLineStart = true; // Arms flag for next line } } // Last line may not have a line ending if (!atLineStart) { styler.ColourTo(i - 1, GetLotLineState(line)); } } // Folds an MPT LOT file: the blocks that can be folded are: // sections (headed by a set line) // passes (contiguous pass results within a section) // fails (contiguous fail results within a section) static void FoldLotDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { bool foldCompact = styler.GetPropertyInt("fold.compact", 0) != 0; Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); char chNext = styler.SafeGetCharAt(startPos); int style = SCE_LOT_DEFAULT; int styleNext = styler.StyleAt(startPos); int lev = SC_FOLDLEVELBASE; // Gets style of previous line if not at the beginning of the document if (startPos > 1) style = styler.StyleAt(startPos - 2); for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); if (ch == '\r' && chNext == '\n') { // TO DO: // Should really get the state of the previous line from the styler int stylePrev = style; style = styleNext; styleNext = styler.StyleAt(i + 2); switch (style) { /* case SCE_LOT_SET: lev = SC_FOLDLEVELBASE | SC_FOLDLEVELHEADERFLAG; break; */ case SCE_LOT_FAIL: /* if (stylePrev != SCE_LOT_FAIL) lev = SC_FOLDLEVELBASE | SC_FOLDLEVELHEADERFLAG; else lev = SC_FOLDLEVELBASE + 1; */ lev = SC_FOLDLEVELBASE; break; default: if (lineCurrent == 0 || stylePrev == SCE_LOT_FAIL) lev = SC_FOLDLEVELBASE | SC_FOLDLEVELHEADERFLAG; else lev = SC_FOLDLEVELBASE + 1; if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; break; } if (lev != styler.LevelAt(lineCurrent)) styler.SetLevel(lineCurrent, lev); lineCurrent++; visibleChars = 0; } if (!isspacechar(ch)) visibleChars++; } int flagsNext = styler.LevelAt(lineCurrent) & ~SC_FOLDLEVELNUMBERMASK; styler.SetLevel(lineCurrent, lev | flagsNext); } static const char * const emptyWordListDesc[] = { 0 }; LexerModule lmLot(SCLEX_LOT, ColourizeLotDoc, "lot", FoldLotDoc, emptyWordListDesc); lexilla/lexers/LexSorcus.cxx0000664000175000017500000001126014647367374015154 0ustar neilneil// Scintilla source code edit control /** @file LexSorcus.cxx ** Lexer for SORCUS installation files ** Written by Eugen Bitter and Christoph Baumann at SORCUS Computer, Heidelberg Germany ** Based on the ASM Lexer by The Black Horus **/ // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; //each character a..z and A..Z + '_' can be part of a keyword //additionally numbers that follow 'M' can be contained in a keyword static inline bool IsSWordStart(const int ch, const int prev_ch) { if (isalpha(ch) || (ch == '_') || ((isdigit(ch)) && (prev_ch == 'M'))) return true; return false; } //only digits that are not preceded by 'M' count as a number static inline bool IsSorcusNumber(const int ch, const int prev_ch) { if ((isdigit(ch)) && (prev_ch != 'M')) return true; return false; } //only = is a valid operator static inline bool IsSorcusOperator(const int ch) { if (ch == '=') return true; return false; } static void ColouriseSorcusDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { WordList &Command = *keywordlists[0]; WordList &Parameter = *keywordlists[1]; WordList &Constant = *keywordlists[2]; // Do not leak onto next line if (initStyle == SCE_SORCUS_STRINGEOL) initStyle = SCE_SORCUS_DEFAULT; StyleContext sc(startPos, length, initStyle, styler); for (; sc.More(); sc.Forward()) { // Prevent SCE_SORCUS_STRINGEOL from leaking back to previous line if (sc.atLineStart && (sc.state == SCE_SORCUS_STRING)) { sc.SetState(SCE_SORCUS_STRING); } // Determine if the current state should terminate. if (sc.state == SCE_SORCUS_OPERATOR) { if (!IsSorcusOperator(sc.ch)) { sc.SetState(SCE_SORCUS_DEFAULT); } } else if(sc.state == SCE_SORCUS_NUMBER) { if(!IsSorcusNumber(sc.ch, sc.chPrev)) { sc.SetState(SCE_SORCUS_DEFAULT); } } else if (sc.state == SCE_SORCUS_IDENTIFIER) { if (!IsSWordStart(sc.ch, sc.chPrev)) { char s[100]; sc.GetCurrent(s, sizeof(s)); if (Command.InList(s)) { sc.ChangeState(SCE_SORCUS_COMMAND); } else if (Parameter.InList(s)) { sc.ChangeState(SCE_SORCUS_PARAMETER); } else if (Constant.InList(s)) { sc.ChangeState(SCE_SORCUS_CONSTANT); } sc.SetState(SCE_SORCUS_DEFAULT); } } else if (sc.state == SCE_SORCUS_COMMENTLINE ) { if (sc.atLineEnd) { sc.SetState(SCE_SORCUS_DEFAULT); } } else if (sc.state == SCE_SORCUS_STRING) { if (sc.ch == '\"') { sc.ForwardSetState(SCE_SORCUS_DEFAULT); } else if (sc.atLineEnd) { sc.ChangeState(SCE_SORCUS_STRINGEOL); sc.ForwardSetState(SCE_SORCUS_DEFAULT); } } // Determine if a new state should be entered. if (sc.state == SCE_SORCUS_DEFAULT) { if ((sc.ch == ';') || (sc.ch == '\'')) { sc.SetState(SCE_SORCUS_COMMENTLINE); } else if (IsSWordStart(sc.ch, sc.chPrev)) { sc.SetState(SCE_SORCUS_IDENTIFIER); } else if (sc.ch == '\"') { sc.SetState(SCE_SORCUS_STRING); } else if (IsSorcusOperator(sc.ch)) { sc.SetState(SCE_SORCUS_OPERATOR); } else if (IsSorcusNumber(sc.ch, sc.chPrev)) { sc.SetState(SCE_SORCUS_NUMBER); } } } sc.Complete(); } static const char* const SorcusWordListDesc[] = {"Command","Parameter", "Constant", 0}; LexerModule lmSorc(SCLEX_SORCUS, ColouriseSorcusDoc, "sorcins", 0, SorcusWordListDesc); lexilla/lexers/LexAU3.cxx0000664000175000017500000007152614647367374014301 0ustar neilneil// Scintilla source code edit control // @file LexAU3.cxx // Lexer for AutoIt3 https://www.autoitscript.com/site/ // by Jos van der Zande, jvdzande@yahoo.com // // Changes: // March 28, 2004 - Added the standard Folding code // April 21, 2004 - Added Preprosessor Table + Syntax Highlighting // Fixed Number highlighting // Changed default isoperator to IsAOperator to have a better match to AutoIt3 // Fixed "#comments_start" -> "#comments-start" // Fixed "#comments_end" -> "#comments-end" // Fixed Sendkeys in Strings when not terminated with } // Added support for Sendkey strings that have second parameter e.g. {UP 5} or {a down} // April 26, 2004 - Fixed # pre-processor statement inside of comment block would invalidly change the color. // Added logic for #include to treat the <> as string // Added underscore to IsAOperator. // May 17, 2004 - Changed the folding logic from indent to keyword folding. // Added Folding logic for blocks of single-commentlines or commentblock. // triggered by: fold.comment=1 // Added Folding logic for preprocessor blocks triggered by fold.preprocessor=1 // Added Special for #region - #endregion syntax highlight and folding. // May 30, 2004 - Fixed issue with continuation lines on If statements. // June 5, 2004 - Added comma to Operators for better readability. // Added fold.compact support set with fold.compact=1 // Changed folding inside of #cs-#ce. Default is no keyword folding inside comment blocks when fold.comment=1 // it will now only happen when fold.comment=2. // Sep 5, 2004 - Added logic to handle colourizing words on the last line. // Typed Characters now show as "default" till they match any table. // Oct 10, 2004 - Added logic to show Comments in "Special" directives. // Nov 1, 2004 - Added better testing for Numbers supporting x and e notation. // Nov 28, 2004 - Added logic to handle continuation lines for syntax highlighting. // Jan 10, 2005 - Added Abbreviations Keyword used for expansion // Mar 24, 2005 - Updated Abbreviations Keywords to fix when followed by Operator. // Apr 18, 2005 - Updated #CE/#Comment-End logic to take a linecomment ";" into account // - Added folding support for With...EndWith // - Added support for a DOT in variable names // - Fixed Underscore in CommentBlock // May 23, 2005 - Fixed the SentKey lexing in case of a missing } // Aug 11, 2005 - Fixed possible bug with s_save length > 100. // Aug 23, 2005 - Added Switch/endswitch support to the folding logic. // Sep 27, 2005 - Fixed the SentKey lexing logic in case of multiple sentkeys. // Mar 12, 2006 - Fixed issue with <> coloring as String in stead of Operator in rare occasions. // Apr 8, 2006 - Added support for AutoIt3 Standard UDF library (SCE_AU3_UDF) // Mar 9, 2007 - Fixed bug with + following a String getting the wrong Color. // Jun 20, 2007 - Fixed Commentblock issue when LF's are used as EOL. // Jul 26, 2007 - Fixed #endregion undetected bug. // // Copyright for Scintilla: 1998-2001 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. // Scintilla source code edit control #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static inline bool IsTypeCharacter(const int ch) { return ch == '$'; } static inline bool IsAWordChar(const int ch) { return (ch < 0x80) && (isalnum(ch) || ch == '_'); } static inline bool IsAWordStart(const int ch) { return (ch < 0x80) && (isalnum(ch) || ch == '_' || ch == '@' || ch == '#' || ch == '$' || ch == '.'); } static inline bool IsAOperator(char ch) { if (IsASCII(ch) && isalnum(ch)) return false; if (ch == '+' || ch == '-' || ch == '*' || ch == '/' || ch == '&' || ch == '^' || ch == '=' || ch == '<' || ch == '>' || ch == '(' || ch == ')' || ch == '[' || ch == ']' || ch == ',' ) return true; return false; } /////////////////////////////////////////////////////////////////////////////// // GetSendKey() filters the portion before and after a/multiple space(s) // and return the first portion to be looked-up in the table // also check if the second portion is valid... (up,down.on.off,toggle or a number) /////////////////////////////////////////////////////////////////////////////// static int GetSendKey(const char *szLine, char *szKey) { int nFlag = 0; int nStartFound = 0; int nKeyPos = 0; int nSpecPos= 0; int nSpecNum= 1; int nPos = 0; char cTemp; char szSpecial[100]; // split the portion of the sendkey in the part before and after the spaces while ( ( (cTemp = szLine[nPos]) != '\0')) { // skip leading Ctrl/Shift/Alt state if (cTemp == '{') { nStartFound = 1; } // if (nStartFound == 1) { if ((cTemp == ' ') && (nFlag == 0) ) // get the stuff till first space { nFlag = 1; // Add } to the end of the first bit for table lookup later. szKey[nKeyPos++] = '}'; } else if (cTemp == ' ') { // skip other spaces } else if (nFlag == 0) { // save first portion into var till space or } is hit szKey[nKeyPos++] = cTemp; } else if ((nFlag == 1) && (cTemp != '}')) { // Save second portion into var... szSpecial[nSpecPos++] = cTemp; // check if Second portion is all numbers for repeat fuction if (isdigit(cTemp) == false) {nSpecNum = 0;} } } nPos++; // skip to next char } // End While // Check if the second portion is either a number or one of these keywords szKey[nKeyPos] = '\0'; szSpecial[nSpecPos] = '\0'; if (strcmp(szSpecial,"down")== 0 || strcmp(szSpecial,"up")== 0 || strcmp(szSpecial,"on")== 0 || strcmp(szSpecial,"off")== 0 || strcmp(szSpecial,"toggle")== 0 || nSpecNum == 1 ) { nFlag = 0; } else { nFlag = 1; } return nFlag; // 1 is bad, 0 is good } // GetSendKey() // // Routine to check the last "none comment" character on a line to see if its a continuation // static bool IsContinuationLine(Sci_PositionU szLine, Accessor &styler) { Sci_Position nsPos = styler.LineStart(szLine); Sci_Position nePos = styler.LineStart(szLine+1) - 2; //int stylech = styler.StyleAt(nsPos); while (nsPos < nePos) { //stylech = styler.StyleAt(nePos); int stylech = styler.StyleAt(nsPos); if (!(stylech == SCE_AU3_COMMENT)) { char ch = styler.SafeGetCharAt(nePos); if (!isspacechar(ch)) { if (ch == '_') return true; else return false; } } nePos--; // skip to next char } // End While return false; } // IsContinuationLine() // // syntax highlighting logic static void ColouriseAU3Doc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { WordList &keywords = *keywordlists[0]; WordList &keywords2 = *keywordlists[1]; WordList &keywords3 = *keywordlists[2]; WordList &keywords4 = *keywordlists[3]; WordList &keywords5 = *keywordlists[4]; WordList &keywords6 = *keywordlists[5]; WordList &keywords7 = *keywordlists[6]; WordList &keywords8 = *keywordlists[7]; // find the first previous line without continuation character at the end Sci_Position lineCurrent = styler.GetLine(startPos); Sci_Position s_startPos = startPos; // When not inside a Block comment: find First line without _ if (!(initStyle==SCE_AU3_COMMENTBLOCK)) { while ((lineCurrent > 0 && IsContinuationLine(lineCurrent,styler)) || (lineCurrent > 1 && IsContinuationLine(lineCurrent-1,styler))) { lineCurrent--; startPos = styler.LineStart(lineCurrent); // get start position initStyle = 0; // reset the start style to 0 } } // Set the new length to include it from the start and set the start position length = length + s_startPos - startPos; // correct the total length to process styler.StartAt(startPos); StyleContext sc(startPos, length, initStyle, styler); char si; // string indicator "=1 '=2 char ni; // Numeric indicator error=9 normal=0 normal+dec=1 hex=2 Enot=3 char ci; // comment indicator 0=not linecomment(;) char s_save[100] = ""; si=0; ni=0; ci=0; //$$$ for (; sc.More(); sc.Forward()) { char s[100]; sc.GetCurrentLowered(s, sizeof(s)); // ********************************************** // save the total current word for eof processing if (IsAWordChar(sc.ch) || sc.ch == '}') { strcpy(s_save,s); int tp = static_cast(strlen(s_save)); if (tp < 99) { s_save[tp] = static_cast(tolower(sc.ch)); s_save[tp+1] = '\0'; } } // ********************************************** // switch (sc.state) { case SCE_AU3_COMMENTBLOCK: { //Reset at line end if (sc.atLineEnd) { ci=0; if (strcmp(s, "#ce")== 0 || strcmp(s, "#comments-end")== 0) { if (sc.atLineEnd) sc.SetState(SCE_AU3_DEFAULT); else sc.SetState(SCE_AU3_COMMENTBLOCK); } break; } //skip rest of line when a ; is encountered if (sc.chPrev == ';') { ci=2; sc.SetState(SCE_AU3_COMMENTBLOCK); } // skip rest of the line if (ci==2) break; // check when first character is detected on the line if (ci==0) { if (IsAWordStart(static_cast(sc.ch)) || IsAOperator(static_cast(sc.ch))) { ci=1; sc.SetState(SCE_AU3_COMMENTBLOCK); } break; } if (!(IsAWordChar(sc.ch) || (sc.ch == '-' && strcmp(s, "#comments") == 0))) { if ((strcmp(s, "#ce")== 0 || strcmp(s, "#comments-end")== 0)) sc.SetState(SCE_AU3_COMMENT); // set to comment line for the rest of the line else ci=2; // line doesn't begin with #CE so skip the rest of the line } break; } case SCE_AU3_COMMENT: { if (sc.atLineEnd) {sc.SetState(SCE_AU3_DEFAULT);} break; } case SCE_AU3_OPERATOR: { // check if its a COMobject if (sc.chPrev == '.' && IsAWordChar(sc.ch)) { sc.SetState(SCE_AU3_COMOBJ); } else { sc.SetState(SCE_AU3_DEFAULT); } break; } case SCE_AU3_SPECIAL: { if (sc.ch == ';') {sc.SetState(SCE_AU3_COMMENT);} if (sc.atLineEnd) {sc.SetState(SCE_AU3_DEFAULT);} break; } case SCE_AU3_KEYWORD: { if (!(IsAWordChar(sc.ch) || (sc.ch == '-' && (strcmp(s, "#comments") == 0 || strcmp(s, "#include") == 0)))) { if (!IsTypeCharacter(sc.ch)) { if (strcmp(s, "#cs")== 0 || strcmp(s, "#comments-start")== 0 ) { sc.ChangeState(SCE_AU3_COMMENTBLOCK); sc.SetState(SCE_AU3_COMMENTBLOCK); break; } else if (keywords.InList(s)) { sc.ChangeState(SCE_AU3_KEYWORD); sc.SetState(SCE_AU3_DEFAULT); } else if (keywords2.InList(s)) { sc.ChangeState(SCE_AU3_FUNCTION); sc.SetState(SCE_AU3_DEFAULT); } else if (keywords3.InList(s)) { sc.ChangeState(SCE_AU3_MACRO); sc.SetState(SCE_AU3_DEFAULT); } else if (keywords5.InList(s)) { sc.ChangeState(SCE_AU3_PREPROCESSOR); sc.SetState(SCE_AU3_DEFAULT); if (strcmp(s, "#include")== 0) { si = 3; // use to determine string start for #inlude <> } } else if (keywords6.InList(s)) { sc.ChangeState(SCE_AU3_SPECIAL); sc.SetState(SCE_AU3_SPECIAL); } else if ((keywords7.InList(s)) && (!IsAOperator(static_cast(sc.ch)))) { sc.ChangeState(SCE_AU3_EXPAND); sc.SetState(SCE_AU3_DEFAULT); } else if (keywords8.InList(s)) { sc.ChangeState(SCE_AU3_UDF); sc.SetState(SCE_AU3_DEFAULT); } else if (strcmp(s, "_") == 0) { sc.ChangeState(SCE_AU3_OPERATOR); sc.SetState(SCE_AU3_DEFAULT); } else if (!IsAWordChar(sc.ch)) { sc.ChangeState(SCE_AU3_DEFAULT); sc.SetState(SCE_AU3_DEFAULT); } } } if (sc.atLineEnd) { sc.SetState(SCE_AU3_DEFAULT);} break; } case SCE_AU3_NUMBER: { // Numeric indicator error=9 normal=0 normal+dec=1 hex=2 E-not=3 // // test for Hex notation if (strcmp(s, "0") == 0 && (sc.ch == 'x' || sc.ch == 'X') && ni == 0) { ni = 2; break; } // test for E notation if (IsADigit(sc.chPrev) && (sc.ch == 'e' || sc.ch == 'E') && ni <= 1) { ni = 3; break; } // Allow Hex characters inside hex numeric strings if ((ni == 2) && (sc.ch == 'a' || sc.ch == 'b' || sc.ch == 'c' || sc.ch == 'd' || sc.ch == 'e' || sc.ch == 'f' || sc.ch == 'A' || sc.ch == 'B' || sc.ch == 'C' || sc.ch == 'D' || sc.ch == 'E' || sc.ch == 'F' )) { break; } // test for 1 dec point only if (sc.ch == '.') { if (ni==0) { ni=1; } else { ni=9; } break; } // end of numeric string ? if (!(IsADigit(sc.ch))) { if (ni==9) { sc.ChangeState(SCE_AU3_DEFAULT); } sc.SetState(SCE_AU3_DEFAULT); } break; } case SCE_AU3_VARIABLE: { // Check if its a COMObject if (sc.ch == '.' && !IsADigit(sc.chNext)) { sc.SetState(SCE_AU3_OPERATOR); } else if (!IsAWordChar(sc.ch)) { sc.SetState(SCE_AU3_DEFAULT); } break; } case SCE_AU3_COMOBJ: { if (!(IsAWordChar(sc.ch))) { sc.SetState(SCE_AU3_DEFAULT); } break; } case SCE_AU3_STRING: { // check for " to end a double qouted string or // check for ' to end a single qouted string if ((si == 1 && sc.ch == '\"') || (si == 2 && sc.ch == '\'') || (si == 3 && sc.ch == '>')) { sc.ForwardSetState(SCE_AU3_DEFAULT); si=0; break; } if (sc.atLineEnd) { si=0; // at line end and not found a continuation char then reset to default Sci_Position lineCurrent = styler.GetLine(sc.currentPos); if (!IsContinuationLine(lineCurrent,styler)) { sc.SetState(SCE_AU3_DEFAULT); break; } } // find Sendkeys in a STRING if (sc.ch == '{' || sc.ch == '+' || sc.ch == '!' || sc.ch == '^' || sc.ch == '#' ) { sc.SetState(SCE_AU3_SENT);} break; } case SCE_AU3_SENT: { // Send key string ended if (sc.chPrev == '}' && sc.ch != '}') { // set color to SENDKEY when valid sendkey .. else set back to regular string char sk[100]; // split {111 222} and return {111} and check if 222 is valid. // if return code = 1 then invalid 222 so must be string if (GetSendKey(s,sk)) { sc.ChangeState(SCE_AU3_STRING); } // if single char between {?} then its ok as sendkey for a single character else if (strlen(sk) == 3) { sc.ChangeState(SCE_AU3_SENT); } // if sendkey {111} is in table then ok as sendkey else if (keywords4.InList(sk)) { sc.ChangeState(SCE_AU3_SENT); } else { sc.ChangeState(SCE_AU3_STRING); } sc.SetState(SCE_AU3_STRING); } else { // check if the start is a valid SendKey start Sci_Position nPos = 0; int nState = 1; char cTemp; while (!(nState == 2) && ((cTemp = s[nPos]) != '\0')) { if (cTemp == '{' && nState == 1) { nState = 2; } if (nState == 1 && !(cTemp == '+' || cTemp == '!' || cTemp == '^' || cTemp == '#' )) { nState = 0; } nPos++; } //Verify characters infront of { ... if not assume regular string if (nState == 1 && (!(sc.ch == '{' || sc.ch == '+' || sc.ch == '!' || sc.ch == '^' || sc.ch == '#' ))) { sc.ChangeState(SCE_AU3_STRING); sc.SetState(SCE_AU3_STRING); } // If invalid character found then assume its a regular string if (nState == 0) { sc.ChangeState(SCE_AU3_STRING); sc.SetState(SCE_AU3_STRING); } } // check if next portion is again a sendkey if (sc.atLineEnd) { sc.ChangeState(SCE_AU3_STRING); sc.SetState(SCE_AU3_DEFAULT); si = 0; // reset string indicator } //* check in next characters following a sentkey are again a sent key // Need this test incase of 2 sentkeys like {F1}{ENTER} but not detect {{} if (sc.state == SCE_AU3_STRING && (sc.ch == '{' || sc.ch == '+' || sc.ch == '!' || sc.ch == '^' || sc.ch == '#' )) { sc.SetState(SCE_AU3_SENT);} // check to see if the string ended... // Sendkey string isn't complete but the string ended.... if ((si == 1 && sc.ch == '\"') || (si == 2 && sc.ch == '\'')) { sc.ChangeState(SCE_AU3_STRING); sc.ForwardSetState(SCE_AU3_DEFAULT); } break; } } //switch (sc.state) // Determine if a new state should be entered: if (sc.state == SCE_AU3_DEFAULT) { if (sc.ch == ';') {sc.SetState(SCE_AU3_COMMENT);} else if (sc.ch == '#') {sc.SetState(SCE_AU3_KEYWORD);} else if (sc.ch == '$') {sc.SetState(SCE_AU3_VARIABLE);} else if (sc.ch == '.' && !IsADigit(sc.chNext)) {sc.SetState(SCE_AU3_OPERATOR);} else if (sc.ch == '@') {sc.SetState(SCE_AU3_KEYWORD);} //else if (sc.ch == '_') {sc.SetState(SCE_AU3_KEYWORD);} else if (sc.ch == '<' && si==3) {sc.SetState(SCE_AU3_STRING);} // string after #include else if (sc.ch == '\"') { sc.SetState(SCE_AU3_STRING); si = 1; } else if (sc.ch == '\'') { sc.SetState(SCE_AU3_STRING); si = 2; } else if (IsADigit(sc.ch) || (sc.ch == '.' && IsADigit(sc.chNext))) { sc.SetState(SCE_AU3_NUMBER); ni = 0; } else if (IsAWordStart(sc.ch)) {sc.SetState(SCE_AU3_KEYWORD);} else if (IsAOperator(static_cast(sc.ch))) {sc.SetState(SCE_AU3_OPERATOR);} else if (sc.atLineEnd) {sc.SetState(SCE_AU3_DEFAULT);} } } //for (; sc.More(); sc.Forward()) //************************************* // Colourize the last word correctly //************************************* if (sc.state == SCE_AU3_KEYWORD) { if (strcmp(s_save, "#cs")== 0 || strcmp(s_save, "#comments-start")== 0 ) { sc.ChangeState(SCE_AU3_COMMENTBLOCK); sc.SetState(SCE_AU3_COMMENTBLOCK); } else if (keywords.InList(s_save)) { sc.ChangeState(SCE_AU3_KEYWORD); sc.SetState(SCE_AU3_KEYWORD); } else if (keywords2.InList(s_save)) { sc.ChangeState(SCE_AU3_FUNCTION); sc.SetState(SCE_AU3_FUNCTION); } else if (keywords3.InList(s_save)) { sc.ChangeState(SCE_AU3_MACRO); sc.SetState(SCE_AU3_MACRO); } else if (keywords5.InList(s_save)) { sc.ChangeState(SCE_AU3_PREPROCESSOR); sc.SetState(SCE_AU3_PREPROCESSOR); } else if (keywords6.InList(s_save)) { sc.ChangeState(SCE_AU3_SPECIAL); sc.SetState(SCE_AU3_SPECIAL); } else if (keywords7.InList(s_save) && sc.atLineEnd) { sc.ChangeState(SCE_AU3_EXPAND); sc.SetState(SCE_AU3_EXPAND); } else if (keywords8.InList(s_save)) { sc.ChangeState(SCE_AU3_UDF); sc.SetState(SCE_AU3_UDF); } else { sc.ChangeState(SCE_AU3_DEFAULT); sc.SetState(SCE_AU3_DEFAULT); } } if (sc.state == SCE_AU3_SENT) { // Send key string ended if (sc.chPrev == '}' && sc.ch != '}') { // set color to SENDKEY when valid sendkey .. else set back to regular string char sk[100]; // split {111 222} and return {111} and check if 222 is valid. // if return code = 1 then invalid 222 so must be string if (GetSendKey(s_save,sk)) { sc.ChangeState(SCE_AU3_STRING); } // if single char between {?} then its ok as sendkey for a single character else if (strlen(sk) == 3) { sc.ChangeState(SCE_AU3_SENT); } // if sendkey {111} is in table then ok as sendkey else if (keywords4.InList(sk)) { sc.ChangeState(SCE_AU3_SENT); } else { sc.ChangeState(SCE_AU3_STRING); } sc.SetState(SCE_AU3_STRING); } // check if next portion is again a sendkey if (sc.atLineEnd) { sc.ChangeState(SCE_AU3_STRING); sc.SetState(SCE_AU3_DEFAULT); } } //************************************* sc.Complete(); } // static bool IsStreamCommentStyle(int style) { return style == SCE_AU3_COMMENT || style == SCE_AU3_COMMENTBLOCK; } // // Routine to find first none space on the current line and return its Style // needed for comment lines not starting on pos 1 static int GetStyleFirstWord(Sci_PositionU szLine, Accessor &styler) { Sci_Position nsPos = styler.LineStart(szLine); Sci_Position nePos = styler.LineStart(szLine+1) - 1; while (isspacechar(styler.SafeGetCharAt(nsPos)) && nsPos < nePos) { nsPos++; // skip to next char } // End While return styler.StyleAt(nsPos); } // GetStyleFirstWord() // static void FoldAU3Doc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { Sci_Position endPos = startPos + length; // get settings from the config files for folding comments and preprocessor lines bool foldComment = styler.GetPropertyInt("fold.comment") != 0; bool foldInComment = styler.GetPropertyInt("fold.comment") == 2; bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; bool foldpreprocessor = styler.GetPropertyInt("fold.preprocessor") != 0; // Backtrack to previous line in case need to fix its fold status Sci_Position lineCurrent = styler.GetLine(startPos); if (startPos > 0) { if (lineCurrent > 0) { lineCurrent--; startPos = styler.LineStart(lineCurrent); } } // vars for style of previous/current/next lines int style = GetStyleFirstWord(lineCurrent,styler); int stylePrev = 0; // find the first previous line without continuation character at the end while ((lineCurrent > 0 && IsContinuationLine(lineCurrent,styler)) || (lineCurrent > 1 && IsContinuationLine(lineCurrent-1,styler))) { lineCurrent--; startPos = styler.LineStart(lineCurrent); } if (lineCurrent > 0) { stylePrev = GetStyleFirstWord(lineCurrent-1,styler); } // vars for getting first word to check for keywords bool FirstWordStart = false; bool FirstWordEnd = false; char szKeyword[11]=""; int szKeywordlen = 0; char szThen[5]=""; int szThenlen = 0; bool ThenFoundLast = false; // var for indentlevel int levelCurrent = SC_FOLDLEVELBASE; if (lineCurrent > 0) levelCurrent = styler.LevelAt(lineCurrent-1) >> 16; int levelNext = levelCurrent; // int visibleChars = 0; char chNext = styler.SafeGetCharAt(startPos); char chPrev = ' '; // for (Sci_Position i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); if (IsAWordChar(ch)) { visibleChars++; } // get the syle for the current character neede to check in comment int stylech = styler.StyleAt(i); // get first word for the line for indent check max 9 characters if (FirstWordStart && (!(FirstWordEnd))) { if (!IsAWordChar(ch)) { FirstWordEnd = true; szKeyword[szKeywordlen] = '\0'; } else { if (szKeywordlen < 10) { szKeyword[szKeywordlen++] = static_cast(tolower(ch)); } } } // start the capture of the first word if (!(FirstWordStart)) { if (IsAWordChar(ch) || IsAWordStart(ch) || ch == ';') { FirstWordStart = true; szKeyword[szKeywordlen++] = static_cast(tolower(ch)); } } // only process this logic when not in comment section if (!(stylech == SCE_AU3_COMMENT)) { if (ThenFoundLast) { if (IsAWordChar(ch)) { ThenFoundLast = false; } } // find out if the word "then" is the last on a "if" line if (FirstWordEnd && strcmp(szKeyword,"if") == 0) { if (szThenlen == 4) { szThen[0] = szThen[1]; szThen[1] = szThen[2]; szThen[2] = szThen[3]; szThen[3] = static_cast(tolower(ch)); if (strcmp(szThen,"then") == 0 ) { ThenFoundLast = true; } } else { szThen[szThenlen++] = static_cast(tolower(ch)); if (szThenlen == 5) { szThen[4] = '\0'; } } } } // End of Line found so process the information if ((ch == '\r' && chNext != '\n') || (ch == '\n') || (i == endPos)) { // ************************** // Folding logic for Keywords // ************************** // if a keyword is found on the current line and the line doesn't end with _ (continuation) // and we are not inside a commentblock. if (szKeywordlen > 0 && (!(chPrev == '_')) && ((!(IsStreamCommentStyle(style)) || foldInComment)) ) { szKeyword[szKeywordlen] = '\0'; // only fold "if" last keyword is "then" (else its a one line if) if (strcmp(szKeyword,"if") == 0 && ThenFoundLast) { levelNext++; } // create new fold for these words if (strcmp(szKeyword,"do") == 0 || strcmp(szKeyword,"for") == 0 || strcmp(szKeyword,"func") == 0 || strcmp(szKeyword,"while") == 0|| strcmp(szKeyword,"with") == 0 || strcmp(szKeyword,"#region") == 0 ) { levelNext++; } // create double Fold for select&switch because Case will subtract one of the current level if (strcmp(szKeyword,"select") == 0 || strcmp(szKeyword,"switch") == 0) { levelNext++; levelNext++; } // end the fold for these words before the current line if (strcmp(szKeyword,"endfunc") == 0 || strcmp(szKeyword,"endif") == 0 || strcmp(szKeyword,"next") == 0 || strcmp(szKeyword,"until") == 0 || strcmp(szKeyword,"endwith") == 0 ||strcmp(szKeyword,"wend") == 0){ levelNext--; levelCurrent--; } // end the fold for these words before the current line and Start new fold if (strcmp(szKeyword,"case") == 0 || strcmp(szKeyword,"else") == 0 || strcmp(szKeyword,"elseif") == 0 ) { levelCurrent--; } // end the double fold for this word before the current line if (strcmp(szKeyword,"endselect") == 0 || strcmp(szKeyword,"endswitch") == 0 ) { levelNext--; levelNext--; levelCurrent--; levelCurrent--; } // end the fold for these words on the current line if (strcmp(szKeyword,"#endregion") == 0 ) { levelNext--; } } // Preprocessor and Comment folding int styleNext = GetStyleFirstWord(lineCurrent + 1,styler); // ************************************* // Folding logic for preprocessor blocks // ************************************* // process preprosessor line if (foldpreprocessor && style == SCE_AU3_PREPROCESSOR) { if (!(stylePrev == SCE_AU3_PREPROCESSOR) && (styleNext == SCE_AU3_PREPROCESSOR)) { levelNext++; } // fold till the last line for normal comment lines else if (stylePrev == SCE_AU3_PREPROCESSOR && !(styleNext == SCE_AU3_PREPROCESSOR)) { levelNext--; } } // ********************************* // Folding logic for Comment blocks // ********************************* if (foldComment && IsStreamCommentStyle(style)) { // Start of a comment block if (!(stylePrev==style) && IsStreamCommentStyle(styleNext) && styleNext==style) { levelNext++; } // fold till the last line for normal comment lines else if (IsStreamCommentStyle(stylePrev) && !(styleNext == SCE_AU3_COMMENT) && stylePrev == SCE_AU3_COMMENT && style == SCE_AU3_COMMENT) { levelNext--; } // fold till the one but last line for Blockcomment lines else if (IsStreamCommentStyle(stylePrev) && !(styleNext == SCE_AU3_COMMENTBLOCK) && style == SCE_AU3_COMMENTBLOCK) { levelNext--; levelCurrent--; } } int levelUse = levelCurrent; int lev = levelUse | levelNext << 16; if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if (levelUse < levelNext) { lev |= SC_FOLDLEVELHEADERFLAG; } if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } // reset values for the next line lineCurrent++; stylePrev = style; style = styleNext; levelCurrent = levelNext; visibleChars = 0; // if the last character is an Underscore then don't reset since the line continues on the next line. if (!(chPrev == '_')) { szKeywordlen = 0; szThenlen = 0; FirstWordStart = false; FirstWordEnd = false; ThenFoundLast = false; } } // save the last processed character if (!isspacechar(ch)) { chPrev = ch; visibleChars++; } } } // static const char * const AU3WordLists[] = { "#autoit keywords", "#autoit functions", "#autoit macros", "#autoit Sent keys", "#autoit Pre-processors", "#autoit Special", "#autoit Expand", "#autoit UDF", 0 }; LexerModule lmAU3(SCLEX_AU3, ColouriseAU3Doc, "au3", FoldAU3Doc , AU3WordLists); lexilla/lexers/LexScriptol.cxx0000664000175000017500000002732114647367374015502 0ustar neilneil// Scintilla source code edit control /** @file LexScriptol.cxx ** Lexer for Scriptol. **/ #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static void ClassifyWordSol(Sci_PositionU start, Sci_PositionU end, WordList &keywords, Accessor &styler, char *prevWord) { char s[100] = ""; bool wordIsNumber = isdigit(styler[start]) != 0; for (Sci_PositionU i = 0; i < end - start + 1 && i < 30; i++) { s[i] = styler[start + i]; s[i + 1] = '\0'; } char chAttr = SCE_SCRIPTOL_IDENTIFIER; if (0 == strcmp(prevWord, "class")) chAttr = SCE_SCRIPTOL_CLASSNAME; else if (wordIsNumber) chAttr = SCE_SCRIPTOL_NUMBER; else if (keywords.InList(s)) chAttr = SCE_SCRIPTOL_KEYWORD; else for (Sci_PositionU i = 0; i < end - start + 1; i++) // test dotted idents { if (styler[start + i] == '.') { styler.ColourTo(start + i - 1, chAttr); styler.ColourTo(start + i, SCE_SCRIPTOL_OPERATOR); } } styler.ColourTo(end, chAttr); strcpy(prevWord, s); } static bool IsSolComment(Accessor &styler, Sci_Position pos, Sci_Position len) { if(len > 0) { char c = styler[pos]; if(c == '`') return true; if(len > 1) { if(c == '/') { c = styler[pos + 1]; if(c == '/') return true; if(c == '*') return true; } } } return false; } static bool IsSolStringStart(char ch) { if (ch == '\'' || ch == '"') return true; return false; } static bool IsSolWordStart(char ch) { return (iswordchar(ch) && !IsSolStringStart(ch)); } static int GetSolStringState(Accessor &styler, Sci_Position i, Sci_Position *nextIndex) { char ch = styler.SafeGetCharAt(i); char chNext = styler.SafeGetCharAt(i + 1); if (ch != '\"' && ch != '\'') { *nextIndex = i + 1; return SCE_SCRIPTOL_DEFAULT; } // ch is either single or double quotes in string // code below seem non-sense but is here for future extensions if (ch == chNext && ch == styler.SafeGetCharAt(i + 2)) { *nextIndex = i + 3; if(ch == '\"') return SCE_SCRIPTOL_TRIPLE; if(ch == '\'') return SCE_SCRIPTOL_TRIPLE; return SCE_SCRIPTOL_STRING; } else { *nextIndex = i + 1; if (ch == '"') return SCE_SCRIPTOL_STRING; else return SCE_SCRIPTOL_STRING; } } static void ColouriseSolDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { Sci_Position lengthDoc = startPos + length; char stringType = '\"'; if (startPos > 0) { Sci_Position lineCurrent = styler.GetLine(startPos); if (lineCurrent > 0) { startPos = styler.LineStart(lineCurrent-1); if (startPos == 0) initStyle = SCE_SCRIPTOL_DEFAULT; else initStyle = styler.StyleAt(startPos-1); } } styler.StartAt(startPos); WordList &keywords = *keywordlists[0]; char prevWord[200]; prevWord[0] = '\0'; if (length == 0) return; int state = initStyle & 31; Sci_Position nextIndex = 0; char chPrev = ' '; char chPrev2 = ' '; char chNext = styler[startPos]; styler.StartSegment(startPos); for (Sci_Position i = startPos; i < lengthDoc; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); if ((ch == '\r' && chNext != '\n') || (ch == '\n') || (i == lengthDoc)) { if ((state == SCE_SCRIPTOL_DEFAULT) || (state == SCE_SCRIPTOL_TRIPLE) || (state == SCE_SCRIPTOL_COMMENTBLOCK)) { styler.ColourTo(i, state); } } if (styler.IsLeadByte(ch)) { chNext = styler.SafeGetCharAt(i + 2); chPrev = ' '; chPrev2 = ' '; i += 1; continue; } if (state == SCE_SCRIPTOL_STRINGEOL) { if (ch != '\r' && ch != '\n') { styler.ColourTo(i - 1, state); state = SCE_SCRIPTOL_DEFAULT; } } if (state == SCE_SCRIPTOL_DEFAULT) { if (IsSolWordStart(ch)) { styler.ColourTo(i - 1, state); state = SCE_SCRIPTOL_KEYWORD; } else if (ch == '`') { styler.ColourTo(i - 1, state); state = SCE_SCRIPTOL_COMMENTLINE; } else if (ch == '/') { styler.ColourTo(i - 1, state); if(chNext == '/') state = SCE_SCRIPTOL_CSTYLE; if(chNext == '*') state = SCE_SCRIPTOL_COMMENTBLOCK; } else if (IsSolStringStart(ch)) { styler.ColourTo(i - 1, state); state = GetSolStringState(styler, i, &nextIndex); if(state == SCE_SCRIPTOL_STRING) { stringType = ch; } if (nextIndex != i + 1) { i = nextIndex - 1; ch = ' '; chPrev = ' '; chNext = styler.SafeGetCharAt(i + 1); } } else if (isoperator(ch)) { styler.ColourTo(i - 1, state); styler.ColourTo(i, SCE_SCRIPTOL_OPERATOR); } } else if (state == SCE_SCRIPTOL_KEYWORD) { if (!iswordchar(ch)) { ClassifyWordSol(styler.GetStartSegment(), i - 1, keywords, styler, prevWord); state = SCE_SCRIPTOL_DEFAULT; if (ch == '`') { state = chNext == '`' ? SCE_SCRIPTOL_PERSISTENT : SCE_SCRIPTOL_COMMENTLINE; } else if (IsSolStringStart(ch)) { styler.ColourTo(i - 1, state); state = GetSolStringState(styler, i, &nextIndex); if (nextIndex != i + 1) { i = nextIndex - 1; ch = ' '; chPrev = ' '; chNext = styler.SafeGetCharAt(i + 1); } } else if (isoperator(ch)) { styler.ColourTo(i, SCE_SCRIPTOL_OPERATOR); } } } else { if (state == SCE_SCRIPTOL_COMMENTLINE || state == SCE_SCRIPTOL_PERSISTENT || state == SCE_SCRIPTOL_CSTYLE) { if (ch == '\r' || ch == '\n') { styler.ColourTo(i - 1, state); state = SCE_SCRIPTOL_DEFAULT; } } else if(state == SCE_SCRIPTOL_COMMENTBLOCK) { if(chPrev == '*' && ch == '/') { styler.ColourTo(i, state); state = SCE_SCRIPTOL_DEFAULT; } } else if ((state == SCE_SCRIPTOL_STRING) || (state == SCE_SCRIPTOL_CHARACTER)) { if ((ch == '\r' || ch == '\n') && (chPrev != '\\')) { styler.ColourTo(i - 1, state); state = SCE_SCRIPTOL_STRINGEOL; } else if (ch == '\\') { if (chNext == '\"' || chNext == '\'' || chNext == '\\') { i++; ch = chNext; chNext = styler.SafeGetCharAt(i + 1); } } else if ((ch == '\"') || (ch == '\'')) { // must match the entered quote type if(ch == stringType) { styler.ColourTo(i, state); state = SCE_SCRIPTOL_DEFAULT; } } } else if (state == SCE_SCRIPTOL_TRIPLE) { if ((ch == '\'' && chPrev == '\'' && chPrev2 == '\'') || (ch == '\"' && chPrev == '\"' && chPrev2 == '\"')) { styler.ColourTo(i, state); state = SCE_SCRIPTOL_DEFAULT; } } } chPrev2 = chPrev; chPrev = ch; } if (state == SCE_SCRIPTOL_KEYWORD) { ClassifyWordSol(styler.GetStartSegment(), lengthDoc-1, keywords, styler, prevWord); } else { styler.ColourTo(lengthDoc-1, state); } } static void FoldSolDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *[], Accessor &styler) { Sci_Position lengthDoc = startPos + length; Sci_Position lineCurrent = styler.GetLine(startPos); if (startPos > 0) { if (lineCurrent > 0) { lineCurrent--; startPos = styler.LineStart(lineCurrent); if (startPos == 0) initStyle = SCE_SCRIPTOL_DEFAULT; else initStyle = styler.StyleAt(startPos-1); } } int state = initStyle & 31; int spaceFlags = 0; int indentCurrent = styler.IndentAmount(lineCurrent, &spaceFlags, IsSolComment); if (state == SCE_SCRIPTOL_TRIPLE) indentCurrent |= SC_FOLDLEVELWHITEFLAG; char chNext = styler[startPos]; for (Sci_Position i = startPos; i < lengthDoc; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); int style = styler.StyleAt(i) & 31; if ((ch == '\r' && chNext != '\n') || (ch == '\n') || (i == lengthDoc)) { int lev = indentCurrent; int indentNext = styler.IndentAmount(lineCurrent + 1, &spaceFlags, IsSolComment); if (style == SCE_SCRIPTOL_TRIPLE) indentNext |= SC_FOLDLEVELWHITEFLAG; if (!(indentCurrent & SC_FOLDLEVELWHITEFLAG)) { // Only non whitespace lines can be headers if ((indentCurrent & SC_FOLDLEVELNUMBERMASK) < (indentNext & SC_FOLDLEVELNUMBERMASK)) { lev |= SC_FOLDLEVELHEADERFLAG; } else if (indentNext & SC_FOLDLEVELWHITEFLAG) { // Line after is blank so check the next - maybe should continue further? int spaceFlags2 = 0; int indentNext2 = styler.IndentAmount(lineCurrent + 2, &spaceFlags2, IsSolComment); if ((indentCurrent & SC_FOLDLEVELNUMBERMASK) < (indentNext2 & SC_FOLDLEVELNUMBERMASK)) { lev |= SC_FOLDLEVELHEADERFLAG; } } } indentCurrent = indentNext; styler.SetLevel(lineCurrent, lev); lineCurrent++; } } } LexerModule lmScriptol(SCLEX_SCRIPTOL, ColouriseSolDoc, "scriptol", FoldSolDoc); lexilla/lexers/LexStata.cxx0000664000175000017500000001624414647367374014761 0ustar neilneil// Scintilla source code edit control /** @file LexStata.cxx ** Lexer for Stata **/ // Author: Luke Rasmussen (luke.rasmussen@gmail.com) // // The License.txt file describes the conditions under which this software may // be distributed. // // Developed as part of the StatTag project at Northwestern University Feinberg // School of Medicine with funding from Northwestern University Clinical and // Translational Sciences Institute through CTSA grant UL1TR001422. This work // has not been reviewed or endorsed by NCATS or the NIH. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static void ColouriseStataDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { WordList &keywords = *keywordlists[0]; WordList &types = *keywordlists[1]; CharacterSet setCouldBePostOp(CharacterSet::setNone, "+-"); CharacterSet setWordStart(CharacterSet::setAlpha, "_", 0x80, true); CharacterSet setWord(CharacterSet::setAlphaNum, "._", 0x80, true); StyleContext sc(startPos, length, initStyle, styler); bool lineHasNonCommentChar = false; for (; sc.More(); sc.Forward()) { if (sc.atLineStart) { lineHasNonCommentChar = false; } // Determine if the current state should terminate. switch (sc.state) { case SCE_STATA_OPERATOR: sc.SetState(SCE_STATA_DEFAULT); break; case SCE_STATA_NUMBER: // We accept almost anything because of hex. and number suffixes if (!setWord.Contains(sc.ch)) { sc.SetState(SCE_STATA_DEFAULT); } break; case SCE_STATA_IDENTIFIER: if (!setWord.Contains(sc.ch) || (sc.ch == '.')) { char s[1000]; sc.GetCurrent(s, sizeof(s)); if (keywords.InList(s)) { sc.ChangeState(SCE_STATA_WORD); } else if (types.InList(s)) { sc.ChangeState(SCE_STATA_TYPE); } sc.SetState(SCE_STATA_DEFAULT); } break; case SCE_STATA_COMMENTBLOCK: if (sc.Match('*', '/')) { sc.Forward(); sc.ForwardSetState(SCE_STATA_DEFAULT); } break; case SCE_STATA_COMMENT: case SCE_STATA_COMMENTLINE: if (sc.atLineStart) { sc.SetState(SCE_STATA_DEFAULT); } break; case SCE_STATA_STRING: if (sc.ch == '\\') { // Per Stata documentation, the following characters are the only ones that can // be escaped (not our typical set of quotes, etc.): // https://www.stata.com/support/faqs/programming/backslashes-and-macros/ if (sc.chNext == '$' || sc.chNext == '`' || sc.chNext == '\\') { sc.Forward(); } } else if (sc.ch == '\"') { sc.ForwardSetState(SCE_STATA_DEFAULT); } break; } // Determine if a new state should be entered. if (sc.state == SCE_STATA_DEFAULT) { if (IsADigit(sc.ch) || (sc.ch == '.' && IsADigit(sc.chNext))) { lineHasNonCommentChar = true; sc.SetState(SCE_STATA_NUMBER); } else if (setWordStart.Contains(sc.ch)) { lineHasNonCommentChar = true; sc.SetState(SCE_STATA_IDENTIFIER); } else if (sc.Match('*') && !lineHasNonCommentChar) { sc.SetState(SCE_STATA_COMMENT); } else if (sc.Match('/', '*')) { sc.SetState(SCE_STATA_COMMENTBLOCK); sc.Forward(); // Eat the * so it isn't used for the end of the comment } else if (sc.Match('/', '/')) { sc.SetState(SCE_STATA_COMMENTLINE); } else if (sc.ch == '\"') { lineHasNonCommentChar = true; sc.SetState(SCE_STATA_STRING); } else if (isoperator(sc.ch)) { lineHasNonCommentChar = true; sc.SetState(SCE_STATA_OPERATOR); } } } sc.Complete(); } // Store both the current line's fold level and the next lines in the // level store to make it easy to pick up with each increment // and to make it possible to fiddle the current level for "} else {". static void FoldStataDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; bool foldAtElse = styler.GetPropertyInt("fold.at.else", 0) != 0; Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelCurrent = SC_FOLDLEVELBASE; if (lineCurrent > 0) levelCurrent = styler.LevelAt(lineCurrent - 1) >> 16; int levelMinCurrent = levelCurrent; int levelNext = levelCurrent; char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); int style = styleNext; styleNext = styler.StyleAt(i + 1); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (style == SCE_R_OPERATOR) { if (ch == '{') { // Measure the minimum before a '{' to allow // folding on "} else {" if (levelMinCurrent > levelNext) { levelMinCurrent = levelNext; } levelNext++; } else if (ch == '}') { levelNext--; } } if (atEOL) { int levelUse = levelCurrent; if (foldAtElse) { levelUse = levelMinCurrent; } int lev = levelUse | levelNext << 16; if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if (levelUse < levelNext) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelCurrent = levelNext; levelMinCurrent = levelCurrent; visibleChars = 0; } if (!isspacechar(ch)) visibleChars++; } } static const char * const StataWordLists[] = { "Language Keywords", "Types", 0, }; LexerModule lmStata(SCLEX_STATA, ColouriseStataDoc, "stata", FoldStataDoc, StataWordLists); lexilla/lexers/LexHaskell.cxx0000664000175000017500000010746414647367374015275 0ustar neilneil/****************************************************************** * LexHaskell.cxx * * A haskell lexer for the scintilla code control. * Some stuff "lended" from LexPython.cxx and LexCPP.cxx. * External lexer stuff inspired from the caml external lexer. * Folder copied from Python's. * * Written by Tobias Engvall - tumm at dtek dot chalmers dot se * * Several bug fixes by Krasimir Angelov - kr.angelov at gmail.com * * Improved by kudah * * TODO: * * A proper lexical folder to fold group declarations, comments, pragmas, * #ifdefs, explicit layout, lists, tuples, quasi-quotes, splces, etc, etc, * etc. * *****************************************************************/ #include #include #include #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "PropSetSimple.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "CharacterCategory.h" #include "LexerModule.h" #include "OptionSet.h" #include "DefaultLexer.h" using namespace Scintilla; using namespace Lexilla; // See https://github.com/ghc/ghc/blob/master/compiler/parser/Lexer.x#L1682 // Note, letter modifiers are prohibited. static int u_iswupper (int ch) { CharacterCategory c = CategoriseCharacter(ch); return c == ccLu || c == ccLt; } static int u_iswalpha (int ch) { CharacterCategory c = CategoriseCharacter(ch); return c == ccLl || c == ccLu || c == ccLt || c == ccLo; } static int u_iswalnum (int ch) { CharacterCategory c = CategoriseCharacter(ch); return c == ccLl || c == ccLu || c == ccLt || c == ccLo || c == ccNd || c == ccNo; } static int u_IsHaskellSymbol(int ch) { CharacterCategory c = CategoriseCharacter(ch); return c == ccPc || c == ccPd || c == ccPo || c == ccSm || c == ccSc || c == ccSk || c == ccSo; } static inline bool IsHaskellLetter(const int ch) { if (IsASCII(ch)) { return (ch >= 'a' && ch <= 'z') || (ch >= 'A' && ch <= 'Z'); } else { return u_iswalpha(ch) != 0; } } static inline bool IsHaskellAlphaNumeric(const int ch) { if (IsASCII(ch)) { return IsAlphaNumeric(ch); } else { return u_iswalnum(ch) != 0; } } static inline bool IsHaskellUpperCase(const int ch) { if (IsASCII(ch)) { return ch >= 'A' && ch <= 'Z'; } else { return u_iswupper(ch) != 0; } } static inline bool IsAnHaskellOperatorChar(const int ch) { if (IsASCII(ch)) { return ( ch == '!' || ch == '#' || ch == '$' || ch == '%' || ch == '&' || ch == '*' || ch == '+' || ch == '-' || ch == '.' || ch == '/' || ch == ':' || ch == '<' || ch == '=' || ch == '>' || ch == '?' || ch == '@' || ch == '^' || ch == '|' || ch == '~' || ch == '\\'); } else { return u_IsHaskellSymbol(ch) != 0; } } static inline bool IsAHaskellWordStart(const int ch) { return IsHaskellLetter(ch) || ch == '_'; } static inline bool IsAHaskellWordChar(const int ch) { return ( IsHaskellAlphaNumeric(ch) || ch == '_' || ch == '\''); } static inline bool IsCommentBlockStyle(int style) { return (style >= SCE_HA_COMMENTBLOCK && style <= SCE_HA_COMMENTBLOCK3); } static inline bool IsCommentStyle(int style) { return (style >= SCE_HA_COMMENTLINE && style <= SCE_HA_COMMENTBLOCK3) || ( style == SCE_HA_LITERATE_COMMENT || style == SCE_HA_LITERATE_CODEDELIM); } // styles which do not belong to Haskell, but to external tools static inline bool IsExternalStyle(int style) { return ( style == SCE_HA_PREPROCESSOR || style == SCE_HA_LITERATE_COMMENT || style == SCE_HA_LITERATE_CODEDELIM); } static inline int CommentBlockStyleFromNestLevel(const unsigned int nestLevel) { return SCE_HA_COMMENTBLOCK + (nestLevel % 3); } // Mangled version of lexlib/Accessor.cxx IndentAmount. // Modified to treat comment blocks as whitespace // plus special case for commentline/preprocessor. static int HaskellIndentAmount(Accessor &styler, const Sci_Position line) { // Determines the indentation level of the current line // Comment blocks are treated as whitespace Sci_Position pos = styler.LineStart(line); Sci_Position eol_pos = styler.LineStart(line + 1) - 1; char ch = styler[pos]; int style = styler.StyleAt(pos); int indent = 0; bool inPrevPrefix = line > 0; Sci_Position posPrev = inPrevPrefix ? styler.LineStart(line-1) : 0; while (( ch == ' ' || ch == '\t' || IsCommentBlockStyle(style) || style == SCE_HA_LITERATE_CODEDELIM) && (pos < eol_pos)) { if (inPrevPrefix) { char chPrev = styler[posPrev++]; if (chPrev != ' ' && chPrev != '\t') { inPrevPrefix = false; } } if (ch == '\t') { indent = (indent / 8 + 1) * 8; } else { // Space or comment block indent++; } pos++; ch = styler[pos]; style = styler.StyleAt(pos); } indent += SC_FOLDLEVELBASE; // if completely empty line or the start of a comment or preprocessor... if ( styler.LineStart(line) == styler.Length() || ch == ' ' || ch == '\t' || ch == '\n' || ch == '\r' || IsCommentStyle(style) || style == SCE_HA_PREPROCESSOR) return indent | SC_FOLDLEVELWHITEFLAG; else return indent; } struct OptionsHaskell { bool magicHash; bool allowQuotes; bool implicitParams; bool highlightSafe; bool cpp; bool stylingWithinPreprocessor; bool fold; bool foldComment; bool foldCompact; bool foldImports; OptionsHaskell() { magicHash = true; // Widespread use, enabled by default. allowQuotes = true; // Widespread use, enabled by default. implicitParams = false; // Fell out of favor, seldom used, disabled. highlightSafe = true; // Moderately used, doesn't hurt to enable. cpp = true; // Widespread use, enabled by default; stylingWithinPreprocessor = false; fold = false; foldComment = false; foldCompact = false; foldImports = false; } }; static const char * const haskellWordListDesc[] = { "Keywords", "FFI", "Reserved operators", 0 }; struct OptionSetHaskell : public OptionSet { OptionSetHaskell() { DefineProperty("lexer.haskell.allow.hash", &OptionsHaskell::magicHash, "Set to 0 to disallow the '#' character at the end of identifiers and " "literals with the haskell lexer " "(GHC -XMagicHash extension)"); DefineProperty("lexer.haskell.allow.quotes", &OptionsHaskell::allowQuotes, "Set to 0 to disable highlighting of Template Haskell name quotations " "and promoted constructors " "(GHC -XTemplateHaskell and -XDataKinds extensions)"); DefineProperty("lexer.haskell.allow.questionmark", &OptionsHaskell::implicitParams, "Set to 1 to allow the '?' character at the start of identifiers " "with the haskell lexer " "(GHC & Hugs -XImplicitParams extension)"); DefineProperty("lexer.haskell.import.safe", &OptionsHaskell::highlightSafe, "Set to 0 to disallow \"safe\" keyword in imports " "(GHC -XSafe, -XTrustworthy, -XUnsafe extensions)"); DefineProperty("lexer.haskell.cpp", &OptionsHaskell::cpp, "Set to 0 to disable C-preprocessor highlighting " "(-XCPP extension)"); DefineProperty("styling.within.preprocessor", &OptionsHaskell::stylingWithinPreprocessor, "For Haskell code, determines whether all preprocessor code is styled in the " "preprocessor style (0, the default) or only from the initial # to the end " "of the command word(1)." ); DefineProperty("fold", &OptionsHaskell::fold); DefineProperty("fold.comment", &OptionsHaskell::foldComment); DefineProperty("fold.compact", &OptionsHaskell::foldCompact); DefineProperty("fold.haskell.imports", &OptionsHaskell::foldImports, "Set to 1 to enable folding of import declarations"); DefineWordListSets(haskellWordListDesc); } }; class LexerHaskell : public DefaultLexer { bool literate; Sci_Position firstImportLine; int firstImportIndent; WordList keywords; WordList ffi; WordList reserved_operators; OptionsHaskell options; OptionSetHaskell osHaskell; enum HashCount { oneHash ,twoHashes ,unlimitedHashes }; enum KeywordMode { HA_MODE_DEFAULT = 0 ,HA_MODE_IMPORT1 = 1 // after "import", before "qualified" or "safe" or package name or module name. ,HA_MODE_IMPORT2 = 2 // after module name, before "as" or "hiding". ,HA_MODE_IMPORT3 = 3 // after "as", before "hiding" ,HA_MODE_MODULE = 4 // after "module", before module name. ,HA_MODE_FFI = 5 // after "foreign", before FFI keywords ,HA_MODE_TYPE = 6 // after "type" or "data", before "family" }; enum LiterateMode { LITERATE_BIRD = 0 // if '>' is the first character on the line, // color '>' as a codedelim and the rest of // the line as code. // else if "\begin{code}" is the only word on the // line except whitespace, switch to LITERATE_BLOCK // otherwise color the line as a literate comment. ,LITERATE_BLOCK = 1 // if the string "\end{code}" is encountered at column // 0 ignoring all later characters, color the line // as a codedelim and switch to LITERATE_BIRD // otherwise color the line as code. }; struct HaskellLineInfo { unsigned int nestLevel; // 22 bits ought to be enough for anybody unsigned int nonexternalStyle; // 5 bits, widen if number of styles goes // beyond 31. bool pragma; LiterateMode lmode; KeywordMode mode; HaskellLineInfo(int state) : nestLevel (state >> 10) , nonexternalStyle ((state >> 5) & 0x1F) , pragma ((state >> 4) & 0x1) , lmode (static_cast((state >> 3) & 0x1)) , mode (static_cast(state & 0x7)) {} int ToLineState() { return (nestLevel << 10) | (nonexternalStyle << 5) | (pragma << 4) | (lmode << 3) | mode; } }; inline void skipMagicHash(StyleContext &sc, const HashCount hashes) const { if (options.magicHash && sc.ch == '#') { sc.Forward(); if (hashes == twoHashes && sc.ch == '#') { sc.Forward(); } else if (hashes == unlimitedHashes) { while (sc.ch == '#') { sc.Forward(); } } } } bool LineContainsImport(const Sci_Position line, Accessor &styler) const { if (options.foldImports) { Sci_Position currentPos = styler.LineStart(line); int style = styler.StyleAt(currentPos); Sci_Position eol_pos = styler.LineStart(line + 1) - 1; while (currentPos < eol_pos) { int ch = styler[currentPos]; style = styler.StyleAt(currentPos); if (ch == ' ' || ch == '\t' || IsCommentBlockStyle(style) || style == SCE_HA_LITERATE_CODEDELIM) { currentPos++; } else { break; } } return (style == SCE_HA_KEYWORD && styler.Match(currentPos, "import")); } else { return false; } } inline int IndentAmountWithOffset(Accessor &styler, const Sci_Position line) const { const int indent = HaskellIndentAmount(styler, line); const int indentLevel = indent & SC_FOLDLEVELNUMBERMASK; return indentLevel <= ((firstImportIndent - 1) + SC_FOLDLEVELBASE) ? indent : (indentLevel + firstImportIndent) | (indent & ~SC_FOLDLEVELNUMBERMASK); } inline int IndentLevelRemoveIndentOffset(const int indentLevel) const { return indentLevel <= ((firstImportIndent - 1) + SC_FOLDLEVELBASE) ? indentLevel : indentLevel - firstImportIndent; } public: LexerHaskell(bool literate_) : DefaultLexer(literate_ ? "literatehaskell" : "haskell", literate_ ? SCLEX_LITERATEHASKELL : SCLEX_HASKELL) , literate(literate_) , firstImportLine(-1) , firstImportIndent(0) {} virtual ~LexerHaskell() {} void SCI_METHOD Release() override { delete this; } int SCI_METHOD Version() const override { return lvRelease5; } const char * SCI_METHOD PropertyNames() override { return osHaskell.PropertyNames(); } int SCI_METHOD PropertyType(const char *name) override { return osHaskell.PropertyType(name); } const char * SCI_METHOD DescribeProperty(const char *name) override { return osHaskell.DescribeProperty(name); } Sci_Position SCI_METHOD PropertySet(const char *key, const char *val) override; const char * SCI_METHOD PropertyGet(const char *key) override { return osHaskell.PropertyGet(key); } const char * SCI_METHOD DescribeWordListSets() override { return osHaskell.DescribeWordListSets(); } Sci_Position SCI_METHOD WordListSet(int n, const char *wl) override; void SCI_METHOD Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void SCI_METHOD Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void * SCI_METHOD PrivateCall(int, void *) override { return 0; } static ILexer5 *LexerFactoryHaskell() { return new LexerHaskell(false); } static ILexer5 *LexerFactoryLiterateHaskell() { return new LexerHaskell(true); } }; Sci_Position SCI_METHOD LexerHaskell::PropertySet(const char *key, const char *val) { if (osHaskell.PropertySet(&options, key, val)) { return 0; } return -1; } Sci_Position SCI_METHOD LexerHaskell::WordListSet(int n, const char *wl) { WordList *wordListN = 0; switch (n) { case 0: wordListN = &keywords; break; case 1: wordListN = &ffi; break; case 2: wordListN = &reserved_operators; break; } Sci_Position firstModification = -1; if (wordListN) { WordList wlNew; wlNew.Set(wl); if (*wordListN != wlNew) { wordListN->Set(wl); firstModification = 0; } } return firstModification; } void SCI_METHOD LexerHaskell::Lex(Sci_PositionU startPos, Sci_Position length, int initStyle ,IDocument *pAccess) { LexAccessor styler(pAccess); Sci_Position lineCurrent = styler.GetLine(startPos); HaskellLineInfo hs = HaskellLineInfo(lineCurrent ? styler.GetLineState(lineCurrent-1) : 0); // Do not leak onto next line if (initStyle == SCE_HA_STRINGEOL) initStyle = SCE_HA_DEFAULT; else if (initStyle == SCE_HA_LITERATE_CODEDELIM) initStyle = hs.nonexternalStyle; StyleContext sc(startPos, length, initStyle, styler); int base = 10; bool dot = false; bool inDashes = false; bool alreadyInTheMiddleOfOperator = false; assert(!(IsCommentBlockStyle(initStyle) && hs.nestLevel == 0)); while (sc.More()) { // Check for state end if (!IsExternalStyle(sc.state)) { hs.nonexternalStyle = sc.state; } // For lexer to work, states should unconditionally forward at least one // character. // If they don't, they should still check if they are at line end and // forward if so. // If a state forwards more than one character, it should check every time // that it is not a line end and cease forwarding otherwise. if (sc.atLineEnd) { // Remember the line state for future incremental lexing styler.SetLineState(lineCurrent, hs.ToLineState()); lineCurrent++; } // Handle line continuation generically. if (sc.ch == '\\' && (sc.chNext == '\n' || sc.chNext == '\r') && ( sc.state == SCE_HA_STRING || sc.state == SCE_HA_PREPROCESSOR)) { // Remember the line state for future incremental lexing styler.SetLineState(lineCurrent, hs.ToLineState()); lineCurrent++; sc.Forward(); if (sc.ch == '\r' && sc.chNext == '\n') { sc.Forward(); } sc.Forward(); continue; } if (sc.atLineStart) { if (sc.state == SCE_HA_STRING || sc.state == SCE_HA_CHARACTER) { // Prevent SCE_HA_STRINGEOL from leaking back to previous line sc.SetState(sc.state); } if (literate && hs.lmode == LITERATE_BIRD) { if (!IsExternalStyle(sc.state)) { sc.SetState(SCE_HA_LITERATE_COMMENT); } } } // External // Literate if ( literate && hs.lmode == LITERATE_BIRD && sc.atLineStart && sc.ch == '>') { sc.SetState(SCE_HA_LITERATE_CODEDELIM); sc.ForwardSetState(hs.nonexternalStyle); } else if (literate && hs.lmode == LITERATE_BIRD && sc.atLineStart && ( sc.ch == ' ' || sc.ch == '\t' || sc.Match("\\begin{code}"))) { sc.SetState(sc.state); while ((sc.ch == ' ' || sc.ch == '\t') && sc.More()) sc.Forward(); if (sc.Match("\\begin{code}")) { sc.Forward(static_cast(strlen("\\begin{code}"))); bool correct = true; while (!sc.atLineEnd && sc.More()) { if (sc.ch != ' ' && sc.ch != '\t') { correct = false; } sc.Forward(); } if (correct) { sc.ChangeState(SCE_HA_LITERATE_CODEDELIM); // color the line end hs.lmode = LITERATE_BLOCK; } } } else if (literate && hs.lmode == LITERATE_BLOCK && sc.atLineStart && sc.Match("\\end{code}")) { sc.SetState(SCE_HA_LITERATE_CODEDELIM); sc.Forward(static_cast(strlen("\\end{code}"))); while (!sc.atLineEnd && sc.More()) { sc.Forward(); } sc.SetState(SCE_HA_LITERATE_COMMENT); hs.lmode = LITERATE_BIRD; } // Preprocessor else if (sc.atLineStart && sc.ch == '#' && options.cpp && (!options.stylingWithinPreprocessor || sc.state == SCE_HA_DEFAULT)) { sc.SetState(SCE_HA_PREPROCESSOR); sc.Forward(); } // Literate else if (sc.state == SCE_HA_LITERATE_COMMENT) { sc.Forward(); } else if (sc.state == SCE_HA_LITERATE_CODEDELIM) { sc.ForwardSetState(hs.nonexternalStyle); } // Preprocessor else if (sc.state == SCE_HA_PREPROCESSOR) { if (sc.atLineEnd) { sc.SetState(options.stylingWithinPreprocessor ? SCE_HA_DEFAULT : hs.nonexternalStyle); sc.Forward(); // prevent double counting a line } else if (options.stylingWithinPreprocessor && !IsHaskellLetter(sc.ch)) { sc.SetState(SCE_HA_DEFAULT); } else { sc.Forward(); } } // Haskell // Operator else if (sc.state == SCE_HA_OPERATOR) { int style = SCE_HA_OPERATOR; if ( sc.ch == ':' && !alreadyInTheMiddleOfOperator // except "::" && !( sc.chNext == ':' && !IsAnHaskellOperatorChar(sc.GetRelative(2)))) { style = SCE_HA_CAPITAL; } alreadyInTheMiddleOfOperator = false; while (IsAnHaskellOperatorChar(sc.ch)) sc.Forward(); char s[100]; sc.GetCurrent(s, sizeof(s)); if (reserved_operators.InList(s)) style = SCE_HA_RESERVED_OPERATOR; sc.ChangeState(style); sc.SetState(SCE_HA_DEFAULT); } // String else if (sc.state == SCE_HA_STRING) { if (sc.atLineEnd) { sc.ChangeState(SCE_HA_STRINGEOL); sc.ForwardSetState(SCE_HA_DEFAULT); } else if (sc.ch == '\"') { sc.Forward(); skipMagicHash(sc, oneHash); sc.SetState(SCE_HA_DEFAULT); } else if (sc.ch == '\\') { sc.Forward(2); } else { sc.Forward(); } } // Char else if (sc.state == SCE_HA_CHARACTER) { if (sc.atLineEnd) { sc.ChangeState(SCE_HA_STRINGEOL); sc.ForwardSetState(SCE_HA_DEFAULT); } else if (sc.ch == '\'') { sc.Forward(); skipMagicHash(sc, oneHash); sc.SetState(SCE_HA_DEFAULT); } else if (sc.ch == '\\') { sc.Forward(2); } else { sc.Forward(); } } // Number else if (sc.state == SCE_HA_NUMBER) { if (sc.atLineEnd) { sc.SetState(SCE_HA_DEFAULT); sc.Forward(); // prevent double counting a line } else if (IsADigit(sc.ch, base)) { sc.Forward(); } else if (sc.ch=='.' && dot && IsADigit(sc.chNext, base)) { sc.Forward(2); dot = false; } else if ((base == 10) && (sc.ch == 'e' || sc.ch == 'E') && (IsADigit(sc.chNext) || sc.chNext == '+' || sc.chNext == '-')) { sc.Forward(); if (sc.ch == '+' || sc.ch == '-') sc.Forward(); } else { skipMagicHash(sc, twoHashes); sc.SetState(SCE_HA_DEFAULT); } } // Keyword or Identifier else if (sc.state == SCE_HA_IDENTIFIER) { int style = IsHaskellUpperCase(sc.ch) ? SCE_HA_CAPITAL : SCE_HA_IDENTIFIER; assert(IsAHaskellWordStart(sc.ch)); sc.Forward(); while (sc.More()) { if (IsAHaskellWordChar(sc.ch)) { sc.Forward(); } else if (sc.ch == '.' && style == SCE_HA_CAPITAL) { if (IsHaskellUpperCase(sc.chNext)) { sc.Forward(); style = SCE_HA_CAPITAL; } else if (IsAHaskellWordStart(sc.chNext)) { sc.Forward(); style = SCE_HA_IDENTIFIER; } else if (IsAnHaskellOperatorChar(sc.chNext)) { sc.Forward(); style = sc.ch == ':' ? SCE_HA_CAPITAL : SCE_HA_OPERATOR; while (IsAnHaskellOperatorChar(sc.ch)) sc.Forward(); break; } else { break; } } else { break; } } skipMagicHash(sc, unlimitedHashes); char s[100]; sc.GetCurrent(s, sizeof(s)); KeywordMode new_mode = HA_MODE_DEFAULT; if (keywords.InList(s)) { style = SCE_HA_KEYWORD; } else if (style == SCE_HA_CAPITAL) { if (hs.mode == HA_MODE_IMPORT1 || hs.mode == HA_MODE_IMPORT3) { style = SCE_HA_MODULE; new_mode = HA_MODE_IMPORT2; } else if (hs.mode == HA_MODE_MODULE) { style = SCE_HA_MODULE; } } else if (hs.mode == HA_MODE_IMPORT1 && strcmp(s,"qualified") == 0) { style = SCE_HA_KEYWORD; new_mode = HA_MODE_IMPORT1; } else if (options.highlightSafe && hs.mode == HA_MODE_IMPORT1 && strcmp(s,"safe") == 0) { style = SCE_HA_KEYWORD; new_mode = HA_MODE_IMPORT1; } else if (hs.mode == HA_MODE_IMPORT2) { if (strcmp(s,"as") == 0) { style = SCE_HA_KEYWORD; new_mode = HA_MODE_IMPORT3; } else if (strcmp(s,"hiding") == 0) { style = SCE_HA_KEYWORD; } } else if (hs.mode == HA_MODE_TYPE) { if (strcmp(s,"family") == 0) style = SCE_HA_KEYWORD; } if (hs.mode == HA_MODE_FFI) { if (ffi.InList(s)) { style = SCE_HA_KEYWORD; new_mode = HA_MODE_FFI; } } sc.ChangeState(style); sc.SetState(SCE_HA_DEFAULT); if (strcmp(s,"import") == 0 && hs.mode != HA_MODE_FFI) new_mode = HA_MODE_IMPORT1; else if (strcmp(s,"module") == 0) new_mode = HA_MODE_MODULE; else if (strcmp(s,"foreign") == 0) new_mode = HA_MODE_FFI; else if (strcmp(s,"type") == 0 || strcmp(s,"data") == 0) new_mode = HA_MODE_TYPE; hs.mode = new_mode; } // Comments // Oneliner else if (sc.state == SCE_HA_COMMENTLINE) { if (sc.atLineEnd) { sc.SetState(hs.pragma ? SCE_HA_PRAGMA : SCE_HA_DEFAULT); sc.Forward(); // prevent double counting a line } else if (inDashes && sc.ch != '-' && !hs.pragma) { inDashes = false; if (IsAnHaskellOperatorChar(sc.ch)) { alreadyInTheMiddleOfOperator = true; sc.ChangeState(SCE_HA_OPERATOR); } } else { sc.Forward(); } } // Nested else if (IsCommentBlockStyle(sc.state)) { if (sc.Match('{','-')) { sc.SetState(CommentBlockStyleFromNestLevel(hs.nestLevel)); sc.Forward(2); hs.nestLevel++; } else if (sc.Match('-','}')) { sc.Forward(2); assert(hs.nestLevel > 0); if (hs.nestLevel > 0) hs.nestLevel--; sc.SetState( hs.nestLevel == 0 ? (hs.pragma ? SCE_HA_PRAGMA : SCE_HA_DEFAULT) : CommentBlockStyleFromNestLevel(hs.nestLevel - 1)); } else { sc.Forward(); } } // Pragma else if (sc.state == SCE_HA_PRAGMA) { if (sc.Match("#-}")) { hs.pragma = false; sc.Forward(3); sc.SetState(SCE_HA_DEFAULT); } else if (sc.Match('-','-')) { sc.SetState(SCE_HA_COMMENTLINE); sc.Forward(2); inDashes = false; } else if (sc.Match('{','-')) { sc.SetState(CommentBlockStyleFromNestLevel(hs.nestLevel)); sc.Forward(2); hs.nestLevel = 1; } else { sc.Forward(); } } // New state? else if (sc.state == SCE_HA_DEFAULT) { // Digit if (IsADigit(sc.ch)) { hs.mode = HA_MODE_DEFAULT; sc.SetState(SCE_HA_NUMBER); if (sc.ch == '0' && (sc.chNext == 'X' || sc.chNext == 'x')) { // Match anything starting with "0x" or "0X", too sc.Forward(2); base = 16; dot = false; } else if (sc.ch == '0' && (sc.chNext == 'O' || sc.chNext == 'o')) { // Match anything starting with "0o" or "0O", too sc.Forward(2); base = 8; dot = false; } else { sc.Forward(); base = 10; dot = true; } } // Pragma else if (sc.Match("{-#")) { hs.pragma = true; sc.SetState(SCE_HA_PRAGMA); sc.Forward(3); } // Comment line else if (sc.Match('-','-')) { sc.SetState(SCE_HA_COMMENTLINE); sc.Forward(2); inDashes = true; } // Comment block else if (sc.Match('{','-')) { sc.SetState(CommentBlockStyleFromNestLevel(hs.nestLevel)); sc.Forward(2); hs.nestLevel = 1; } // String else if (sc.ch == '\"') { sc.SetState(SCE_HA_STRING); sc.Forward(); } // Character or quoted name or promoted term else if (sc.ch == '\'') { hs.mode = HA_MODE_DEFAULT; sc.SetState(SCE_HA_CHARACTER); sc.Forward(); if (options.allowQuotes) { // Quoted type ''T if (sc.ch=='\'' && IsAHaskellWordStart(sc.chNext)) { sc.Forward(); sc.ChangeState(SCE_HA_IDENTIFIER); } else if (sc.chNext != '\'') { // Quoted name 'n or promoted constructor 'N if (IsAHaskellWordStart(sc.ch)) { sc.ChangeState(SCE_HA_IDENTIFIER); // Promoted constructor operator ':~> } else if (sc.ch == ':') { alreadyInTheMiddleOfOperator = false; sc.ChangeState(SCE_HA_OPERATOR); // Promoted list or tuple '[T] } else if (sc.ch == '[' || sc.ch== '(') { sc.ChangeState(SCE_HA_OPERATOR); sc.ForwardSetState(SCE_HA_DEFAULT); } } } } // Operator starting with '?' or an implicit parameter else if (sc.ch == '?') { hs.mode = HA_MODE_DEFAULT; alreadyInTheMiddleOfOperator = false; sc.SetState(SCE_HA_OPERATOR); if ( options.implicitParams && IsAHaskellWordStart(sc.chNext) && !IsHaskellUpperCase(sc.chNext)) { sc.Forward(); sc.ChangeState(SCE_HA_IDENTIFIER); } } // Operator else if (IsAnHaskellOperatorChar(sc.ch)) { hs.mode = HA_MODE_DEFAULT; sc.SetState(SCE_HA_OPERATOR); } // Braces and punctuation else if (sc.ch == ',' || sc.ch == ';' || sc.ch == '(' || sc.ch == ')' || sc.ch == '[' || sc.ch == ']' || sc.ch == '{' || sc.ch == '}') { sc.SetState(SCE_HA_OPERATOR); sc.ForwardSetState(SCE_HA_DEFAULT); } // Keyword or Identifier else if (IsAHaskellWordStart(sc.ch)) { sc.SetState(SCE_HA_IDENTIFIER); // Something we don't care about } else { sc.Forward(); } } // This branch should never be reached. else { assert(false); sc.Forward(); } } sc.Complete(); } void SCI_METHOD LexerHaskell::Fold(Sci_PositionU startPos, Sci_Position length, int // initStyle ,IDocument *pAccess) { if (!options.fold) return; Accessor styler(pAccess, NULL); Sci_Position lineCurrent = styler.GetLine(startPos); if (lineCurrent <= firstImportLine) { firstImportLine = -1; // readjust first import position firstImportIndent = 0; } const Sci_Position maxPos = startPos + length; const Sci_Position maxLines = maxPos == styler.Length() ? styler.GetLine(maxPos) : styler.GetLine(maxPos - 1); // Requested last line const Sci_Position docLines = styler.GetLine(styler.Length()); // Available last line // Backtrack to previous non-blank line so we can determine indent level // for any white space lines // and so we can fix any preceding fold level (which is why we go back // at least one line in all cases) bool importHere = LineContainsImport(lineCurrent, styler); int indentCurrent = IndentAmountWithOffset(styler, lineCurrent); while (lineCurrent > 0) { lineCurrent--; importHere = LineContainsImport(lineCurrent, styler); indentCurrent = IndentAmountWithOffset(styler, lineCurrent); if (!(indentCurrent & SC_FOLDLEVELWHITEFLAG)) break; } int indentCurrentLevel = indentCurrent & SC_FOLDLEVELNUMBERMASK; if (importHere) { indentCurrentLevel = IndentLevelRemoveIndentOffset(indentCurrentLevel); if (firstImportLine == -1) { firstImportLine = lineCurrent; firstImportIndent = (1 + indentCurrentLevel) - SC_FOLDLEVELBASE; } if (firstImportLine != lineCurrent) { indentCurrentLevel++; } } indentCurrent = indentCurrentLevel | (indentCurrent & ~SC_FOLDLEVELNUMBERMASK); // Process all characters to end of requested range //that hangs over the end of the range. Cap processing in all cases // to end of document. while (lineCurrent <= docLines && lineCurrent <= maxLines) { // Gather info Sci_Position lineNext = lineCurrent + 1; importHere = false; int indentNext = indentCurrent; if (lineNext <= docLines) { // Information about next line is only available if not at end of document importHere = LineContainsImport(lineNext, styler); indentNext = IndentAmountWithOffset(styler, lineNext); } if (indentNext & SC_FOLDLEVELWHITEFLAG) indentNext = SC_FOLDLEVELWHITEFLAG | indentCurrentLevel; // Skip past any blank lines for next indent level info; we skip also // comments (all comments, not just those starting in column 0) // which effectively folds them into surrounding code rather // than screwing up folding. while (lineNext < docLines && (indentNext & SC_FOLDLEVELWHITEFLAG)) { lineNext++; importHere = LineContainsImport(lineNext, styler); indentNext = IndentAmountWithOffset(styler, lineNext); } int indentNextLevel = indentNext & SC_FOLDLEVELNUMBERMASK; if (importHere) { indentNextLevel = IndentLevelRemoveIndentOffset(indentNextLevel); if (firstImportLine == -1) { firstImportLine = lineNext; firstImportIndent = (1 + indentNextLevel) - SC_FOLDLEVELBASE; } if (firstImportLine != lineNext) { indentNextLevel++; } } indentNext = indentNextLevel | (indentNext & ~SC_FOLDLEVELNUMBERMASK); const int levelBeforeComments = Maximum(indentCurrentLevel,indentNextLevel); // Now set all the indent levels on the lines we skipped // Do this from end to start. Once we encounter one line // which is indented more than the line after the end of // the comment-block, use the level of the block before Sci_Position skipLine = lineNext; int skipLevel = indentNextLevel; while (--skipLine > lineCurrent) { int skipLineIndent = IndentAmountWithOffset(styler, skipLine); if (options.foldCompact) { if ((skipLineIndent & SC_FOLDLEVELNUMBERMASK) > indentNextLevel) { skipLevel = levelBeforeComments; } int whiteFlag = skipLineIndent & SC_FOLDLEVELWHITEFLAG; styler.SetLevel(skipLine, skipLevel | whiteFlag); } else { if ( (skipLineIndent & SC_FOLDLEVELNUMBERMASK) > indentNextLevel && !(skipLineIndent & SC_FOLDLEVELWHITEFLAG)) { skipLevel = levelBeforeComments; } styler.SetLevel(skipLine, skipLevel); } } int lev = indentCurrent; if (!(indentCurrent & SC_FOLDLEVELWHITEFLAG)) { if ((indentCurrent & SC_FOLDLEVELNUMBERMASK) < (indentNext & SC_FOLDLEVELNUMBERMASK)) lev |= SC_FOLDLEVELHEADERFLAG; } // Set fold level for this line and move to next line styler.SetLevel(lineCurrent, options.foldCompact ? lev : lev & ~SC_FOLDLEVELWHITEFLAG); indentCurrent = indentNext; indentCurrentLevel = indentNextLevel; lineCurrent = lineNext; } // NOTE: Cannot set level of last line here because indentCurrent doesn't have // header flag set; the loop above is crafted to take care of this case! //styler.SetLevel(lineCurrent, indentCurrent); } LexerModule lmHaskell(SCLEX_HASKELL, LexerHaskell::LexerFactoryHaskell, "haskell", haskellWordListDesc); LexerModule lmLiterateHaskell(SCLEX_LITERATEHASKELL, LexerHaskell::LexerFactoryLiterateHaskell, "literatehaskell", haskellWordListDesc); lexilla/lexers/LexSpecman.cxx0000664000175000017500000002160014647367374015263 0ustar neilneil// Scintilla source code edit control /** @file LexSpecman.cxx ** Lexer for Specman E language. ** Written by Avi Yegudin, based on C++ lexer by Neil Hodgson **/ // Copyright 1998-2002 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static inline bool IsAWordChar(const int ch) { return (ch < 0x80) && (isalnum(ch) || ch == '.' || ch == '_' || ch == '\''); } static inline bool IsANumberChar(const int ch) { return (ch < 0x80) && (isalnum(ch) || ch == '_' || ch == '\''); } static inline bool IsAWordStart(const int ch) { return (ch < 0x80) && (isalnum(ch) || ch == '_' || ch == '`'); } static void ColouriseSpecmanDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler, bool caseSensitive) { WordList &keywords = *keywordlists[0]; WordList &keywords2 = *keywordlists[1]; WordList &keywords3 = *keywordlists[2]; WordList &keywords4 = *keywordlists[3]; // Do not leak onto next line if (initStyle == SCE_SN_STRINGEOL) initStyle = SCE_SN_CODE; int visibleChars = 0; StyleContext sc(startPos, length, initStyle, styler); for (; sc.More(); sc.Forward()) { if (sc.atLineStart && (sc.state == SCE_SN_STRING)) { // Prevent SCE_SN_STRINGEOL from leaking back to previous line sc.SetState(SCE_SN_STRING); } // Handle line continuation generically. if (sc.ch == '\\') { if (sc.chNext == '\n' || sc.chNext == '\r') { sc.Forward(); if (sc.ch == '\r' && sc.chNext == '\n') { sc.Forward(); } continue; } } // Determine if the current state should terminate. if (sc.state == SCE_SN_OPERATOR) { sc.SetState(SCE_SN_CODE); } else if (sc.state == SCE_SN_NUMBER) { if (!IsANumberChar(sc.ch)) { sc.SetState(SCE_SN_CODE); } } else if (sc.state == SCE_SN_IDENTIFIER) { if (!IsAWordChar(sc.ch) || (sc.ch == '.')) { char s[100]; if (caseSensitive) { sc.GetCurrent(s, sizeof(s)); } else { sc.GetCurrentLowered(s, sizeof(s)); } if (keywords.InList(s)) { sc.ChangeState(SCE_SN_WORD); } else if (keywords2.InList(s)) { sc.ChangeState(SCE_SN_WORD2); } else if (keywords3.InList(s)) { sc.ChangeState(SCE_SN_WORD3); } else if (keywords4.InList(s)) { sc.ChangeState(SCE_SN_USER); } sc.SetState(SCE_SN_CODE); } } else if (sc.state == SCE_SN_PREPROCESSOR) { if (IsASpace(sc.ch)) { sc.SetState(SCE_SN_CODE); } } else if (sc.state == SCE_SN_DEFAULT) { if (sc.Match('<', '\'')) { sc.Forward(); sc.ForwardSetState(SCE_SN_CODE); } } else if (sc.state == SCE_SN_COMMENTLINE || sc.state == SCE_SN_COMMENTLINEBANG) { if (sc.atLineEnd) { sc.SetState(SCE_SN_CODE); visibleChars = 0; } } else if (sc.state == SCE_SN_STRING) { if (sc.ch == '\\') { if (sc.chNext == '\"' || sc.chNext == '\'' || sc.chNext == '\\') { sc.Forward(); } } else if (sc.ch == '\"') { sc.ForwardSetState(SCE_SN_CODE); } else if (sc.atLineEnd) { sc.ChangeState(SCE_SN_STRINGEOL); sc.ForwardSetState(SCE_SN_CODE); visibleChars = 0; } } else if (sc.state == SCE_SN_SIGNAL) { if (sc.atLineEnd) { sc.ChangeState(SCE_SN_STRINGEOL); sc.ForwardSetState(SCE_SN_CODE); visibleChars = 0; } else if (sc.ch == '\\') { if (sc.chNext == '\"' || sc.chNext == '\'' || sc.chNext == '\\') { sc.Forward(); } } else if (sc.ch == '\'') { sc.ForwardSetState(SCE_SN_CODE); } } else if (sc.state == SCE_SN_REGEXTAG) { if (!IsADigit(sc.ch)) { sc.SetState(SCE_SN_CODE); } } // Determine if a new state should be entered. if (sc.state == SCE_SN_CODE) { if (sc.ch == '$' && IsADigit(sc.chNext)) { sc.SetState(SCE_SN_REGEXTAG); sc.Forward(); } else if (IsADigit(sc.ch)) { sc.SetState(SCE_SN_NUMBER); } else if (IsAWordStart(sc.ch)) { sc.SetState(SCE_SN_IDENTIFIER); } else if (sc.Match('\'', '>')) { sc.SetState(SCE_SN_DEFAULT); sc.Forward(); // Eat the * so it isn't used for the end of the comment } else if (sc.Match('/', '/')) { if (sc.Match("//!")) // Nice to have a different comment style sc.SetState(SCE_SN_COMMENTLINEBANG); else sc.SetState(SCE_SN_COMMENTLINE); } else if (sc.Match('-', '-')) { if (sc.Match("--!")) // Nice to have a different comment style sc.SetState(SCE_SN_COMMENTLINEBANG); else sc.SetState(SCE_SN_COMMENTLINE); } else if (sc.ch == '\"') { sc.SetState(SCE_SN_STRING); } else if (sc.ch == '\'') { sc.SetState(SCE_SN_SIGNAL); } else if (sc.ch == '#' && visibleChars == 0) { // Preprocessor commands are alone on their line sc.SetState(SCE_SN_PREPROCESSOR); // Skip whitespace between # and preprocessor word do { sc.Forward(); } while ((sc.ch == ' ' || sc.ch == '\t') && sc.More()); if (sc.atLineEnd) { sc.SetState(SCE_SN_CODE); } } else if (isoperator(static_cast(sc.ch)) || sc.ch == '@') { sc.SetState(SCE_SN_OPERATOR); } } if (sc.atLineEnd) { // Reset states to begining of colourise so no surprises // if different sets of lines lexed. visibleChars = 0; } if (!IsASpace(sc.ch)) { visibleChars++; } } sc.Complete(); } // Store both the current line's fold level and the next lines in the // level store to make it easy to pick up with each increment // and to make it possible to fiddle the current level for "} else {". static void FoldNoBoxSpecmanDoc(Sci_PositionU startPos, Sci_Position length, int, Accessor &styler) { bool foldComment = styler.GetPropertyInt("fold.comment") != 0; bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; bool foldAtElse = styler.GetPropertyInt("fold.at.else", 0) != 0; Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelCurrent = SC_FOLDLEVELBASE; if (lineCurrent > 0) levelCurrent = styler.LevelAt(lineCurrent-1) >> 16; int levelMinCurrent = levelCurrent; int levelNext = levelCurrent; char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); int style; for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); //int stylePrev = style; style = styleNext; styleNext = styler.StyleAt(i + 1); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (foldComment && (style == SCE_SN_COMMENTLINE)) { if (((ch == '/') && (chNext == '/')) || ((ch == '-') && (chNext == '-'))) { char chNext2 = styler.SafeGetCharAt(i + 2); if (chNext2 == '{') { levelNext++; } else if (chNext2 == '}') { levelNext--; } } } if (style == SCE_SN_OPERATOR) { if (ch == '{') { // Measure the minimum before a '{' to allow // folding on "} else {" if (levelMinCurrent > levelNext) { levelMinCurrent = levelNext; } levelNext++; } else if (ch == '}') { levelNext--; } } if (atEOL) { int levelUse = levelCurrent; if (foldAtElse) { levelUse = levelMinCurrent; } int lev = levelUse | levelNext << 16; if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if (levelUse < levelNext) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelCurrent = levelNext; levelMinCurrent = levelCurrent; visibleChars = 0; } if (!isspacechar(ch)) visibleChars++; } } static void FoldSpecmanDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *[], Accessor &styler) { FoldNoBoxSpecmanDoc(startPos, length, initStyle, styler); } static const char * const specmanWordLists[] = { "Primary keywords and identifiers", "Secondary keywords and identifiers", "Sequence keywords and identifiers", "User defined keywords and identifiers", "Unused", 0, }; static void ColouriseSpecmanDocSensitive(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { ColouriseSpecmanDoc(startPos, length, initStyle, keywordlists, styler, true); } LexerModule lmSpecman(SCLEX_SPECMAN, ColouriseSpecmanDocSensitive, "specman", FoldSpecmanDoc, specmanWordLists); lexilla/lexers/LexPB.cxx0000664000175000017500000003051214647367374014200 0ustar neilneil// Scintilla source code edit control // @file LexPB.cxx // Lexer for PowerBasic by Roland Walter, roland@rowalt.de (for PowerBasic see www.powerbasic.com) // // Changes: // 17.10.2003: Toggling of subs/functions now until next sub/function - this gives better results // 29.10.2003: 1. Bug: Toggling didn't work for subs/functions added in editor // 2. Own colors for PB constants and Inline Assembler SCE_B_CONSTANT and SCE_B_ASM // 3. Several smaller syntax coloring improvements and speed optimizations // 12.07.2004: 1. Toggling for macros added // 2. Further folding speed optimitations (for people dealing with very large listings) // // Necessary changes for the PB lexer in Scintilla project: // - In SciLexer.h and Scintilla.iface: // // #define SCLEX_POWERBASIC 51 //ID for PowerBasic lexer // (...) // #define SCE_B_DEFAULT 0 //in both VB and PB lexer // #define SCE_B_COMMENT 1 //in both VB and PB lexer // #define SCE_B_NUMBER 2 //in both VB and PB lexer // #define SCE_B_KEYWORD 3 //in both VB and PB lexer // #define SCE_B_STRING 4 //in both VB and PB lexer // #define SCE_B_PREPROCESSOR 5 //VB lexer only, not in PB lexer // #define SCE_B_OPERATOR 6 //in both VB and PB lexer // #define SCE_B_IDENTIFIER 7 //in both VB and PB lexer // #define SCE_B_DATE 8 //VB lexer only, not in PB lexer // #define SCE_B_CONSTANT 13 //PB lexer only, not in VB lexer // #define SCE_B_ASM 14 //PB lexer only, not in VB lexer // - Statement added to KeyWords.cxx: 'LINK_LEXER(lmPB);' // - Statement added to scintilla_vc6.mak: '$(DIR_O)\LexPB.obj: ...\src\LexPB.cxx $(LEX_HEADERS)' // // Copyright for Scintilla: 1998-2001 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static inline bool IsTypeCharacter(const int ch) { return ch == '%' || ch == '&' || ch == '@' || ch == '!' || ch == '#' || ch == '$' || ch == '?'; } static inline bool IsAWordChar(const int ch) { return (ch < 0x80) && (isalnum(ch) || ch == '.' || ch == '_'); } static inline bool IsAWordStart(const int ch) { return (ch < 0x80) && (isalnum(ch) || ch == '_'); } static bool MatchUpperCase(Accessor &styler, Sci_Position pos, const char *s) //Same as styler.Match() but uppercase comparison (a-z,A-Z and space only) { char ch; for (Sci_Position i=0; *s; i++) { ch=styler.SafeGetCharAt(pos+i); if (ch > 0x60) ch -= '\x20'; if (*s != ch) return false; s++; } return true; } static void ColourisePBDoc(Sci_PositionU startPos, Sci_Position length, int initStyle,WordList *keywordlists[],Accessor &styler) { WordList &keywords = *keywordlists[0]; styler.StartAt(startPos); StyleContext sc(startPos, length, initStyle, styler); for (; sc.More(); sc.Forward()) { switch (sc.state) { case SCE_B_OPERATOR: { sc.SetState(SCE_B_DEFAULT); break; } case SCE_B_KEYWORD: { if (!IsAWordChar(sc.ch)) { if (!IsTypeCharacter(sc.ch)) { char s[100]; sc.GetCurrentLowered(s, sizeof(s)); if (keywords.InList(s)) { if (strcmp(s, "rem") == 0) { sc.ChangeState(SCE_B_COMMENT); if (sc.atLineEnd) {sc.SetState(SCE_B_DEFAULT);} } else if (strcmp(s, "asm") == 0) { sc.ChangeState(SCE_B_ASM); if (sc.atLineEnd) {sc.SetState(SCE_B_DEFAULT);} } else { sc.SetState(SCE_B_DEFAULT); } } else { sc.ChangeState(SCE_B_IDENTIFIER); sc.SetState(SCE_B_DEFAULT); } } } break; } case SCE_B_NUMBER: { if (!IsAWordChar(sc.ch)) {sc.SetState(SCE_B_DEFAULT);} break; } case SCE_B_STRING: { if (sc.ch == '\"'){sc.ForwardSetState(SCE_B_DEFAULT);} break; } case SCE_B_CONSTANT: { if (!IsAWordChar(sc.ch)) {sc.SetState(SCE_B_DEFAULT);} break; } case SCE_B_COMMENT: { if (sc.atLineEnd) {sc.SetState(SCE_B_DEFAULT);} break; } case SCE_B_ASM: { if (sc.atLineEnd) {sc.SetState(SCE_B_DEFAULT);} break; } } //switch (sc.state) // Determine if a new state should be entered: if (sc.state == SCE_B_DEFAULT) { if (sc.ch == '\'') {sc.SetState(SCE_B_COMMENT);} else if (sc.ch == '\"') {sc.SetState(SCE_B_STRING);} else if (sc.ch == '&' && tolower(sc.chNext) == 'h') {sc.SetState(SCE_B_NUMBER);} else if (sc.ch == '&' && tolower(sc.chNext) == 'b') {sc.SetState(SCE_B_NUMBER);} else if (sc.ch == '&' && tolower(sc.chNext) == 'o') {sc.SetState(SCE_B_NUMBER);} else if (IsADigit(sc.ch) || (sc.ch == '.' && IsADigit(sc.chNext))) {sc.SetState(SCE_B_NUMBER);} else if (IsAWordStart(sc.ch)) {sc.SetState(SCE_B_KEYWORD);} else if (sc.ch == '%') {sc.SetState(SCE_B_CONSTANT);} else if (sc.ch == '$') {sc.SetState(SCE_B_CONSTANT);} else if (sc.ch == '#') {sc.SetState(SCE_B_KEYWORD);} else if (sc.ch == '!') {sc.SetState(SCE_B_ASM);} else if (isoperator(static_cast(sc.ch)) || (sc.ch == '\\')) {sc.SetState(SCE_B_OPERATOR);} } } //for (; sc.More(); sc.Forward()) sc.Complete(); } //The folding routine for PowerBasic toggles SUBs and FUNCTIONs only. This was exactly what I wanted, //nothing more. I had worked with this kind of toggling for several years when I used the great good old //GFA Basic which is dead now. After testing the feature of toggling FOR-NEXT loops, WHILE-WEND loops //and so on too I found this is more disturbing then helping (for me). So if You think in another way //you can (or must) write Your own toggling routine ;-) static void FoldPBDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { // No folding enabled, no reason to continue... if( styler.GetPropertyInt("fold") == 0 ) return; Sci_PositionU endPos = startPos + length; Sci_Position lineCurrent = styler.GetLine(startPos); int levelCurrent = SC_FOLDLEVELBASE; if (lineCurrent > 0) levelCurrent = styler.LevelAt(lineCurrent-1) >> 16; int levelNext = levelCurrent; char chNext = styler[startPos]; bool fNewLine=true; bool fMightBeMultiLineMacro=false; bool fBeginOfCommentFound=false; for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); if (fNewLine) //Begin of a new line (The Sub/Function/Macro keywords may occur at begin of line only) { fNewLine=false; fBeginOfCommentFound=false; switch (ch) { case ' ': //Most lines start with space - so check this first, the code is the same as for 'default:' case '\t': //Handle tab too { int levelUse = levelCurrent; int lev = levelUse | levelNext << 16; styler.SetLevel(lineCurrent, lev); break; } case 'F': case 'f': { switch (chNext) { case 'U': case 'u': { if( MatchUpperCase(styler,i,"FUNCTION") ) { styler.SetLevel(lineCurrent, (SC_FOLDLEVELBASE << 16) | SC_FOLDLEVELHEADERFLAG); levelNext=SC_FOLDLEVELBASE+1; } break; } } break; } case 'S': case 's': { switch (chNext) { case 'U': case 'u': { if( MatchUpperCase(styler,i,"SUB") ) { styler.SetLevel(lineCurrent, (SC_FOLDLEVELBASE << 16) | SC_FOLDLEVELHEADERFLAG); levelNext=SC_FOLDLEVELBASE+1; } break; } case 'T': case 't': { if( MatchUpperCase(styler,i,"STATIC FUNCTION") ) { styler.SetLevel(lineCurrent, (SC_FOLDLEVELBASE << 16) | SC_FOLDLEVELHEADERFLAG); levelNext=SC_FOLDLEVELBASE+1; } else if( MatchUpperCase(styler,i,"STATIC SUB") ) { styler.SetLevel(lineCurrent, (SC_FOLDLEVELBASE << 16) | SC_FOLDLEVELHEADERFLAG); levelNext=SC_FOLDLEVELBASE+1; } break; } } break; } case 'C': case 'c': { switch (chNext) { case 'A': case 'a': { if( MatchUpperCase(styler,i,"CALLBACK FUNCTION") ) { styler.SetLevel(lineCurrent, (SC_FOLDLEVELBASE << 16) | SC_FOLDLEVELHEADERFLAG); levelNext=SC_FOLDLEVELBASE+1; } break; } } break; } case 'M': case 'm': { switch (chNext) { case 'A': case 'a': { if( MatchUpperCase(styler,i,"MACRO") ) { fMightBeMultiLineMacro=true; //Set folder level at end of line, we have to check for single line macro } break; } } break; } default: { int levelUse = levelCurrent; int lev = levelUse | levelNext << 16; styler.SetLevel(lineCurrent, lev); break; } } //switch (ch) } //if( fNewLine ) switch (ch) { case '=': //To test single line macros { if (fBeginOfCommentFound==false) fMightBeMultiLineMacro=false; //The found macro is a single line macro only; break; } case '\'': //A comment starts { fBeginOfCommentFound=true; break; } case '\n': { if (fMightBeMultiLineMacro) //The current line is the begin of a multi line macro { fMightBeMultiLineMacro=false; styler.SetLevel(lineCurrent, (SC_FOLDLEVELBASE << 16) | SC_FOLDLEVELHEADERFLAG); levelNext=SC_FOLDLEVELBASE+1; } lineCurrent++; levelCurrent = levelNext; fNewLine=true; break; } case '\r': { if (chNext != '\n') { lineCurrent++; levelCurrent = levelNext; fNewLine=true; } break; } } //switch (ch) } //for (Sci_PositionU i = startPos; i < endPos; i++) } static const char * const pbWordListDesc[] = { "Keywords", 0 }; LexerModule lmPB(SCLEX_POWERBASIC, ColourisePBDoc, "powerbasic", FoldPBDoc, pbWordListDesc); lexilla/lexers/LexNull.cxx0000664000175000017500000000216214647367374014611 0ustar neilneil// Scintilla source code edit control /** @file LexNull.cxx ** Lexer for no language. Used for plain text and unrecognized files. **/ // Copyright 1998-2001 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static void ColouriseNullDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { // Null language means all style bytes are 0 so just mark the end - no need to fill in. if (length > 0) { styler.StartAt(startPos + length - 1); styler.StartSegment(startPos + length - 1); styler.ColourTo(startPos + length - 1, 0); } } LexerModule lmNull(SCLEX_NULL, ColouriseNullDoc, "null"); lexilla/lexers/LexDataflex.cxx0000664000175000017500000004661314647367374015440 0ustar neilneil// Scintilla source code edit control /** @file LexDataflex.cxx ** Lexer for DataFlex. ** Based on LexPascal.cxx ** Written by Wil van Antwerpen, June 2019 **/ /* // The License.txt file describes the conditions under which this software may be distributed. A few words about features of LexDataflex... Generally speaking LexDataflex tries to support all available DataFlex features (up to DataFlex 19.1 at this time). ~ FOLDING: Folding is supported in the following cases: - Folding of stream-like comments - Folding of groups of consecutive line comments - Folding of preprocessor blocks (the following preprocessor blocks are supported: #IFDEF, #IFNDEF, #ENDIF and #HEADER / #ENDHEADER blocks), - Folding of code blocks on appropriate keywords (the following code blocks are supported: "begin, struct, type, case / end" blocks, class & object declarations and interface declarations) Remarks: - We pass 4 arrays to the lexer: 1. The DataFlex keyword list, these are normal DataFlex keywords 2. The Scope Open list, for example, begin / procedure / while 3. The Scope Close list, for example, end / end_procedure / loop 4. Operator list, for ex. + / - / * / Lt / iand These lists are all mutually exclusive, scope open words should not be in the keyword list and vice versa - Folding of code blocks tries to handle all special cases in which folding should not occur. ~ KEYWORDS: The list of keywords that can be used in dataflex.properties file (up to DataFlex 19.1): - Keywords: .. snipped .. see dataflex.properties file. */ #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static void GetRangeLowered(Sci_PositionU start, Sci_PositionU end, Accessor &styler, char *s, Sci_PositionU len) { Sci_PositionU i = 0; while ((i < end - start + 1) && (i < len-1)) { s[i] = static_cast(tolower(styler[start + i])); i++; } s[i] = '\0'; } static void GetForwardRangeLowered(Sci_PositionU start, CharacterSet &charSet, Accessor &styler, char *s, Sci_PositionU len) { Sci_PositionU i = 0; while ((i < len-1) && charSet.Contains(styler.SafeGetCharAt(start + i))) { s[i] = static_cast(tolower(styler.SafeGetCharAt(start + i))); i++; } s[i] = '\0'; } enum { stateInICode = 0x1000, stateSingleQuoteOpen = 0x2000, stateDoubleQuoteOpen = 0x4000, stateFoldInPreprocessor = 0x0100, stateFoldInCaseStatement = 0x0200, stateFoldInPreprocessorLevelMask = 0x00FF, stateFoldMaskAll = 0x0FFF }; static bool IsFirstDataFlexWord(Sci_Position pos, Accessor &styler) { Sci_Position line = styler.GetLine(pos); Sci_Position start_pos = styler.LineStart(line); for (Sci_Position i = start_pos; i < pos; i++) { char ch = styler.SafeGetCharAt(i); if (!(ch == ' ' || ch == '\t')) return false; } return true; } inline bool IsADataFlexField(int ch) { return (ch == '.'); } static void ClassifyDataFlexWord(WordList *keywordlists[], StyleContext &sc, Accessor &styler) { WordList& keywords = *keywordlists[0]; WordList& scopeOpen = *keywordlists[1]; WordList& scopeClosed = *keywordlists[2]; WordList& operators = *keywordlists[3]; char s[100]; int oldState; int newState; size_t tokenlen; oldState = sc.state; newState = oldState; sc.GetCurrentLowered(s, sizeof(s)); tokenlen = strnlen(s,sizeof(s)); if (keywords.InList(s)) { // keywords in DataFlex can be used as table column names (file.field) and as such they // should not be characterized as a keyword. So test for that. // for ex. somebody using date as field name. if (!IsADataFlexField(sc.GetRelative(-static_cast(tokenlen+1)))) { newState = SCE_DF_WORD; } } if (oldState == newState) { if ((scopeOpen.InList(s) || scopeClosed.InList(s)) && (strcmp(s, "for") != 0) && (strcmp(s, "repeat") != 0)) { // scope words in DataFlex can be used as table column names (file.field) and as such they // should not be characterized as a scope word. So test for that. // for ex. somebody using procedure for field name. if (!IsADataFlexField(sc.GetRelative(-static_cast(tokenlen+1)))) { newState = SCE_DF_SCOPEWORD; } } // no code folding on the next words, but just want to paint them like keywords (as they are) (??? doesn't the code to the opposite?) if (strcmp(s, "if") == 0 || strcmp(s, "ifnot") == 0 || strcmp(s, "case") == 0 || strcmp(s, "else") == 0 ) { newState = SCE_DF_SCOPEWORD; } } if (oldState != newState && newState == SCE_DF_WORD) { // a for loop must have for at the start of the line, for is also used in "define abc for 123" if ( (strcmp(s, "for") == 0) && (IsFirstDataFlexWord(sc.currentPos-3, styler)) ) { newState = SCE_DF_SCOPEWORD; } } if (oldState != newState && newState == SCE_DF_WORD) { // a repeat loop must have repeat at the start of the line, repeat is also used in 'move (repeat("d",5)) to sFoo' if ( (strcmp(s, "repeat") == 0) && (IsFirstDataFlexWord(sc.currentPos-6, styler)) ) { newState = SCE_DF_SCOPEWORD; } } if (oldState == newState) { if (operators.InList(s)) { newState = SCE_DF_OPERATOR; } } if (oldState != newState) { sc.ChangeState(newState); } sc.SetState(SCE_DF_DEFAULT); } static void ColouriseDataFlexDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { // bool bSmartHighlighting = styler.GetPropertyInt("lexer.dataflex.smart.highlighting", 1) != 0; CharacterSet setWordStart(CharacterSet::setAlpha, "_$#@", 0x80, true); CharacterSet setWord(CharacterSet::setAlphaNum, "_$#@", 0x80, true); CharacterSet setNumber(CharacterSet::setDigits, ".-+eE"); CharacterSet setHexNumber(CharacterSet::setDigits, "abcdefABCDEF"); CharacterSet setOperator(CharacterSet::setNone, "*+-/<=>^"); Sci_Position curLine = styler.GetLine(startPos); int curLineState = curLine > 0 ? styler.GetLineState(curLine - 1) : 0; StyleContext sc(startPos, length, initStyle, styler); for (; sc.More(); sc.Forward()) { if (sc.atLineEnd) { // Update the line state, so it can be seen by next line curLine = styler.GetLine(sc.currentPos); styler.SetLineState(curLine, curLineState); } // Determine if the current state should terminate. switch (sc.state) { case SCE_DF_NUMBER: if (!setNumber.Contains(sc.ch) || (sc.ch == '.' && sc.chNext == '.')) { sc.SetState(SCE_DF_DEFAULT); } else if (sc.ch == '-' || sc.ch == '+') { if (sc.chPrev != 'E' && sc.chPrev != 'e') { sc.SetState(SCE_DF_DEFAULT); } } break; case SCE_DF_IDENTIFIER: if (!setWord.Contains(sc.ch)) { ClassifyDataFlexWord(keywordlists, sc, styler); } break; case SCE_DF_HEXNUMBER: if (!(setHexNumber.Contains(sc.ch) || sc.ch == 'I') ) { // in |CI$22a we also want to color the "I" sc.SetState(SCE_DF_DEFAULT); } break; case SCE_DF_METATAG: if (sc.atLineStart || sc.chPrev == '}') { sc.SetState(SCE_DF_DEFAULT); } break; case SCE_DF_PREPROCESSOR: if (sc.atLineStart || IsASpaceOrTab(sc.ch)) { sc.SetState(SCE_DF_DEFAULT); } break; case SCE_DF_IMAGE: if (sc.atLineStart && sc.Match("/*")) { sc.Forward(); // these characters are still part of the DF Image sc.ForwardSetState(SCE_DF_DEFAULT); } break; case SCE_DF_PREPROCESSOR2: // we don't have inline comments or preprocessor2 commands //if (sc.Match('*', ')')) { // sc.Forward(); // sc.ForwardSetState(SCE_DF_DEFAULT); //} break; case SCE_DF_COMMENTLINE: if (sc.atLineStart) { sc.SetState(SCE_DF_DEFAULT); } break; case SCE_DF_STRING: if (sc.atLineEnd) { sc.ChangeState(SCE_DF_STRINGEOL); } else if (sc.ch == '\'' && sc.chNext == '\'') { sc.Forward(); } else if (sc.ch == '\"' && sc.chNext == '\"') { sc.Forward(); } else if (sc.ch == '\'' || sc.ch == '\"') { if (sc.ch == '\'' && (curLineState & stateSingleQuoteOpen) ) { curLineState &= ~(stateSingleQuoteOpen); sc.ForwardSetState(SCE_DF_DEFAULT); } else if (sc.ch == '\"' && (curLineState & stateDoubleQuoteOpen) ) { curLineState &= ~(stateDoubleQuoteOpen); sc.ForwardSetState(SCE_DF_DEFAULT); } } break; case SCE_DF_STRINGEOL: if (sc.atLineStart) { sc.SetState(SCE_DF_DEFAULT); } break; case SCE_DF_SCOPEWORD: //if (!setHexNumber.Contains(sc.ch) && sc.ch != '$') { // sc.SetState(SCE_DF_DEFAULT); //} break; case SCE_DF_OPERATOR: // if (bSmartHighlighting && sc.chPrev == ';') { // curLineState &= ~(stateInProperty | stateInExport); // } sc.SetState(SCE_DF_DEFAULT); break; case SCE_DF_ICODE: if (sc.atLineStart || IsASpace(sc.ch) || isoperator(sc.ch)) { sc.SetState(SCE_DF_DEFAULT); } break; } // Determine if a new state should be entered. if (sc.state == SCE_DF_DEFAULT) { if (IsADigit(sc.ch)) { sc.SetState(SCE_DF_NUMBER); } else if (sc.Match('/', '/') || sc.Match("#REM")) { sc.SetState(SCE_DF_COMMENTLINE); } else if ((sc.ch == '#' && !sc.Match("#REM")) && IsFirstDataFlexWord(sc.currentPos, styler)) { sc.SetState(SCE_DF_PREPROCESSOR); // || (sc.ch == '|' && sc.chNext == 'C' && sc.GetRelativeCharacter(2) == 'I' && sc.GetRelativeCharacter(3) == '$') ) { } else if ((sc.ch == '$' && ((!setWord.Contains(sc.chPrev)) || sc.chPrev == 'I' ) ) || (sc.Match("|CI$")) ) { sc.SetState(SCE_DF_HEXNUMBER); // start with $ and previous character not in a..zA..Z0..9 excluding "I" OR start with |CI$ } else if (setWordStart.Contains(sc.ch)) { sc.SetState(SCE_DF_IDENTIFIER); } else if (sc.ch == '{') { sc.SetState(SCE_DF_METATAG); //} else if (sc.Match("(*$")) { // sc.SetState(SCE_DF_PREPROCESSOR2); } else if (sc.ch == '/' && setWord.Contains(sc.chNext) && sc.atLineStart) { sc.SetState(SCE_DF_IMAGE); // sc.Forward(); // Eat the * so it isn't used for the end of the comment } else if (sc.ch == '\'' || sc.ch == '\"') { if (sc.ch == '\'' && !(curLineState & stateDoubleQuoteOpen)) { curLineState |= stateSingleQuoteOpen; } else if (sc.ch == '\"' && !(curLineState & stateSingleQuoteOpen)) { curLineState |= stateDoubleQuoteOpen; } sc.SetState(SCE_DF_STRING); } else if (setOperator.Contains(sc.ch)) { sc.SetState(SCE_DF_OPERATOR); // } else if (curLineState & stateInICode) { // ICode start ! in a string followed by close string mark is not icode } else if ((sc.ch == '!') && !(sc.ch == '!' && ((sc.chNext == '\"') || (sc.ch == '\'')) )) { sc.SetState(SCE_DF_ICODE); } } } if (sc.state == SCE_DF_IDENTIFIER && setWord.Contains(sc.chPrev)) { ClassifyDataFlexWord(keywordlists, sc, styler); } sc.Complete(); } static bool IsStreamCommentStyle(int style) { return style == SCE_DF_IMAGE; } static bool IsCommentLine(Sci_Position line, Accessor &styler) { Sci_Position pos = styler.LineStart(line); Sci_Position eolPos = styler.LineStart(line + 1) - 1; for (Sci_Position i = pos; i < eolPos; i++) { char ch = styler[i]; char chNext = styler.SafeGetCharAt(i + 1); int style = styler.StyleAt(i); if (ch == '/' && chNext == '/' && style == SCE_DF_COMMENTLINE) { return true; } else if (!IsASpaceOrTab(ch)) { return false; } } return false; } static unsigned int GetFoldInPreprocessorLevelFlag(int lineFoldStateCurrent) { return lineFoldStateCurrent & stateFoldInPreprocessorLevelMask; } static void SetFoldInPreprocessorLevelFlag(int &lineFoldStateCurrent, unsigned int nestLevel) { lineFoldStateCurrent &= ~stateFoldInPreprocessorLevelMask; lineFoldStateCurrent |= nestLevel & stateFoldInPreprocessorLevelMask; } static int ClassifyDataFlexPreprocessorFoldPoint(int &levelCurrent, int &lineFoldStateCurrent, Sci_PositionU startPos, Accessor &styler) { CharacterSet setWord(CharacterSet::setAlpha); char s[100]; // Size of the longest possible keyword + one additional character + null GetForwardRangeLowered(startPos, setWord, styler, s, sizeof(s)); size_t iLen = strnlen(s,sizeof(s)); size_t iWordSize = 0; unsigned int nestLevel = GetFoldInPreprocessorLevelFlag(lineFoldStateCurrent); if (strcmp(s, "command") == 0 || // The #if/#ifdef etcetera commands are not currently foldable as it is easy to write code that // breaks the collaps logic, so we keep things simple and not include that for now. strcmp(s, "header") == 0) { nestLevel++; SetFoldInPreprocessorLevelFlag(lineFoldStateCurrent, nestLevel); lineFoldStateCurrent |= stateFoldInPreprocessor; levelCurrent++; iWordSize = iLen; } else if (strcmp(s, "endcommand") == 0 || strcmp(s, "endheader") == 0) { nestLevel--; SetFoldInPreprocessorLevelFlag(lineFoldStateCurrent, nestLevel); if (nestLevel == 0) { lineFoldStateCurrent &= ~stateFoldInPreprocessor; } levelCurrent--; iWordSize = iLen; if (levelCurrent < SC_FOLDLEVELBASE) { levelCurrent = SC_FOLDLEVELBASE; } } return static_cast(iWordSize); } static void ClassifyDataFlexWordFoldPoint(int &levelCurrent, int &lineFoldStateCurrent, Sci_PositionU lastStart, Sci_PositionU currentPos, WordList *[], Accessor &styler) { char s[100]; // property fold.dataflex.compilerlist // Set to 1 for enabling the code folding feature in *.prn files bool foldPRN = styler.GetPropertyInt("fold.dataflex.compilerlist",0) != 0; GetRangeLowered(lastStart, currentPos, styler, s, sizeof(s)); if (strcmp(s, "case") == 0) { lineFoldStateCurrent |= stateFoldInCaseStatement; } else if (strcmp(s, "begin") == 0) { levelCurrent++; } else if (strcmp(s, "for") == 0 || strcmp(s, "while") == 0 || strcmp(s, "repeat") == 0 || strcmp(s, "for_all") == 0 || strcmp(s, "struct") == 0 || strcmp(s, "type") == 0 || strcmp(s, "begin_row") == 0 || strcmp(s, "item_list") == 0 || strcmp(s, "begin_constraints") == 0 || strcmp(s, "begin_transaction") == 0 || strcmp(s, "enum_list") == 0 || strcmp(s, "class") == 0 || strcmp(s, "object") == 0 || strcmp(s, "cd_popup_object") == 0 || strcmp(s, "procedure") == 0 || strcmp(s, "procedure_section") == 0 || strcmp(s, "function") == 0 ) { if ((IsFirstDataFlexWord(lastStart, styler )) || foldPRN) { levelCurrent++; } } else if (strcmp(s, "end") == 0) { // end is not always the first keyword, for example "case end" levelCurrent--; if (levelCurrent < SC_FOLDLEVELBASE) { levelCurrent = SC_FOLDLEVELBASE; } } else if (strcmp(s, "loop") == 0 || strcmp(s, "until") == 0 || strcmp(s, "end_class") == 0 || strcmp(s, "end_object") == 0 || strcmp(s, "cd_end_object") == 0 || strcmp(s, "end_procedure") == 0 || strcmp(s, "end_function") == 0 || strcmp(s, "end_for_all") == 0 || strcmp(s, "end_struct") == 0 || strcmp(s, "end_type") == 0 || strcmp(s, "end_row") == 0 || strcmp(s, "end_item_list") == 0 || strcmp(s, "end_constraints") == 0 || strcmp(s, "end_transaction") == 0 || strcmp(s, "end_enum_list") == 0 ) { // lineFoldStateCurrent &= ~stateFoldInRecord; if ((IsFirstDataFlexWord(lastStart, styler )) || foldPRN) { levelCurrent--; if (levelCurrent < SC_FOLDLEVELBASE) { levelCurrent = SC_FOLDLEVELBASE; } } } } static void ClassifyDataFlexMetaDataFoldPoint(int &levelCurrent, Sci_PositionU lastStart, Sci_PositionU currentPos, WordList *[], Accessor &styler) { char s[100]; GetRangeLowered(lastStart, currentPos, styler, s, sizeof(s)); if (strcmp(s, "#beginsection") == 0) { levelCurrent++; } else if (strcmp(s, "#endsection") == 0) { levelCurrent--; if (levelCurrent < SC_FOLDLEVELBASE) { levelCurrent = SC_FOLDLEVELBASE; } } } static void FoldDataFlexDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { bool foldComment = styler.GetPropertyInt("fold.comment") != 0; bool foldPreprocessor = styler.GetPropertyInt("fold.preprocessor") != 0; bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelPrev = styler.LevelAt(lineCurrent) & SC_FOLDLEVELNUMBERMASK; int levelCurrent = levelPrev; int lineFoldStateCurrent = lineCurrent > 0 ? styler.GetLineState(lineCurrent - 1) & stateFoldMaskAll : 0; char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); int style = initStyle; int iWordSize; Sci_Position lastStart = 0; CharacterSet setWord(CharacterSet::setAlphaNum, "_$#@", 0x80, true); for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); int stylePrev = style; style = styleNext; styleNext = styler.StyleAt(i + 1); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (foldComment && IsStreamCommentStyle(style)) { if (!IsStreamCommentStyle(stylePrev)) { levelCurrent++; } else if (!IsStreamCommentStyle(styleNext)) { levelCurrent--; } } if (foldComment && atEOL && IsCommentLine(lineCurrent, styler)) { if (!IsCommentLine(lineCurrent - 1, styler) && IsCommentLine(lineCurrent + 1, styler)) levelCurrent++; else if (IsCommentLine(lineCurrent - 1, styler) && !IsCommentLine(lineCurrent+1, styler)) levelCurrent--; } if (foldPreprocessor) { if (style == SCE_DF_PREPROCESSOR) { iWordSize = ClassifyDataFlexPreprocessorFoldPoint(levelCurrent, lineFoldStateCurrent, i + 1, styler); //} else if (style == SCE_DF_PREPROCESSOR2 && ch == '(' && chNext == '*' // && styler.SafeGetCharAt(i + 2) == '$') { // ClassifyDataFlexPreprocessorFoldPoint(levelCurrent, lineFoldStateCurrent, i + 3, styler); i = i + iWordSize; } } if (stylePrev != SCE_DF_SCOPEWORD && style == SCE_DF_SCOPEWORD) { // Store last word start point. lastStart = i; } if (stylePrev == SCE_DF_SCOPEWORD) { if(setWord.Contains(ch) && !setWord.Contains(chNext)) { ClassifyDataFlexWordFoldPoint(levelCurrent, lineFoldStateCurrent, lastStart, i, keywordlists, styler); } } if (stylePrev == SCE_DF_METATAG && ch == '#') { // Store last word start point. lastStart = i; } if (stylePrev == SCE_DF_METATAG) { if(setWord.Contains(ch) && !setWord.Contains(chNext)) { ClassifyDataFlexMetaDataFoldPoint(levelCurrent, lastStart, i, keywordlists, styler); } } if (!IsASpace(ch)) visibleChars++; if (atEOL) { int lev = levelPrev; if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if ((levelCurrent > levelPrev) && (visibleChars > 0)) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } int newLineState = (styler.GetLineState(lineCurrent) & ~stateFoldMaskAll) | lineFoldStateCurrent; styler.SetLineState(lineCurrent, newLineState); lineCurrent++; levelPrev = levelCurrent; visibleChars = 0; } } // If we didn't reach the EOL in previous loop, store line level and whitespace information. // The rest will be filled in later... int lev = levelPrev; if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; styler.SetLevel(lineCurrent, lev); } static const char * const dataflexWordListDesc[] = { "Keywords", "Scope open", "Scope close", "Operators", 0 }; LexerModule lmDataflex(SCLEX_DATAFLEX, ColouriseDataFlexDoc, "dataflex", FoldDataFlexDoc, dataflexWordListDesc); lexilla/lexers/LexCoffeeScript.cxx0000664000175000017500000004125314647367374016257 0ustar neilneil// Scintilla source code edit control /** @file LexCoffeeScript.cxx ** Lexer for CoffeeScript. **/ // Copyright 1998-2011 by Neil Hodgson // Based on the Scintilla C++ Lexer // Written by Eric Promislow in 2011 for the Komodo IDE // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static bool IsSpaceEquiv(int state) { return (state == SCE_COFFEESCRIPT_DEFAULT || state == SCE_COFFEESCRIPT_COMMENTLINE || state == SCE_COFFEESCRIPT_COMMENTBLOCK || state == SCE_COFFEESCRIPT_VERBOSE_REGEX || state == SCE_COFFEESCRIPT_VERBOSE_REGEX_COMMENT || state == SCE_COFFEESCRIPT_WORD || state == SCE_COFFEESCRIPT_REGEX); } // Store the current lexer state and brace count prior to starting a new // `#{}` interpolation level. // Based on LexRuby.cxx. static void enterInnerExpression(int *p_inner_string_types, int *p_inner_expn_brace_counts, int& inner_string_count, int state, int& brace_counts ) { p_inner_string_types[inner_string_count] = state; p_inner_expn_brace_counts[inner_string_count] = brace_counts; brace_counts = 0; ++inner_string_count; } // Restore the lexer state and brace count for the previous `#{}` interpolation // level upon returning to it. // Note the previous lexer state is the return value and needs to be restored // manually by the StyleContext. // Based on LexRuby.cxx. static int exitInnerExpression(int *p_inner_string_types, int *p_inner_expn_brace_counts, int& inner_string_count, int& brace_counts ) { --inner_string_count; brace_counts = p_inner_expn_brace_counts[inner_string_count]; return p_inner_string_types[inner_string_count]; } // Preconditions: sc.currentPos points to a character after '+' or '-'. // The test for pos reaching 0 should be redundant, // and is in only for safety measures. // Limitation: this code will give the incorrect answer for code like // a = b+++/ptn/... // Putting a space between the '++' post-inc operator and the '+' binary op // fixes this, and is highly recommended for readability anyway. static bool FollowsPostfixOperator(StyleContext &sc, Accessor &styler) { Sci_Position pos = (Sci_Position) sc.currentPos; while (--pos > 0) { char ch = styler[pos]; if (ch == '+' || ch == '-') { return styler[pos - 1] == ch; } } return false; } static bool followsKeyword(StyleContext &sc, Accessor &styler) { Sci_Position pos = (Sci_Position) sc.currentPos; Sci_Position currentLine = styler.GetLine(pos); Sci_Position lineStartPos = styler.LineStart(currentLine); while (--pos > lineStartPos) { char ch = styler.SafeGetCharAt(pos); if (ch != ' ' && ch != '\t') { break; } } styler.Flush(); return styler.StyleAt(pos) == SCE_COFFEESCRIPT_WORD; } #if defined(__clang__) #if __has_warning("-Wunused-but-set-variable") // Disable warning for visibleChars #pragma clang diagnostic ignored "-Wunused-but-set-variable" #endif #endif static void ColouriseCoffeeScriptDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { WordList &keywords = *keywordlists[0]; WordList &keywords2 = *keywordlists[1]; WordList &keywords4 = *keywordlists[3]; CharacterSet setOKBeforeRE(CharacterSet::setNone, "([{=,:;!%^&*|?~+-"); CharacterSet setCouldBePostOp(CharacterSet::setNone, "+-"); CharacterSet setWordStart(CharacterSet::setAlpha, "_$@", 0x80, true); CharacterSet setWord(CharacterSet::setAlphaNum, "._$", 0x80, true); int chPrevNonWhite = ' '; int visibleChars = 0; // String/Regex interpolation variables, based on LexRuby.cxx. // In most cases a value of 2 should be ample for the code the user is // likely to enter. For example, // "Filling the #{container} with #{liquid}..." // from the CoffeeScript homepage nests to a level of 2 // If the user actually hits a 6th occurrence of '#{' in a double-quoted // string (including regexes), it will stay as a string. The problem with // this is that quotes might flip, a 7th '#{' will look like a comment, // and code-folding might be wrong. #define INNER_STRINGS_MAX_COUNT 5 // These vars track our instances of "...#{,,,'..#{,,,}...',,,}..." int inner_string_types[INNER_STRINGS_MAX_COUNT]; // Track # braces when we push a new #{ thing int inner_expn_brace_counts[INNER_STRINGS_MAX_COUNT]; int inner_string_count = 0; int brace_counts = 0; // Number of #{ ... } things within an expression for (int i = 0; i < INNER_STRINGS_MAX_COUNT; i++) { inner_string_types[i] = 0; inner_expn_brace_counts[i] = 0; } // look back to set chPrevNonWhite properly for better regex colouring Sci_Position endPos = startPos + length; if (startPos > 0 && IsSpaceEquiv(initStyle)) { Sci_PositionU back = startPos; styler.Flush(); while (back > 0 && IsSpaceEquiv(styler.StyleAt(--back))) ; if (styler.StyleAt(back) == SCE_COFFEESCRIPT_OPERATOR) { chPrevNonWhite = styler.SafeGetCharAt(back); } if (startPos != back) { initStyle = styler.StyleAt(back); if (IsSpaceEquiv(initStyle)) { initStyle = SCE_COFFEESCRIPT_DEFAULT; } } startPos = back; } StyleContext sc(startPos, endPos - startPos, initStyle, styler); for (; sc.More();) { if (sc.atLineStart) { // Reset states to beginning of colourise so no surprises // if different sets of lines lexed. visibleChars = 0; } // Determine if the current state should terminate. switch (sc.state) { case SCE_COFFEESCRIPT_OPERATOR: sc.SetState(SCE_COFFEESCRIPT_DEFAULT); break; case SCE_COFFEESCRIPT_NUMBER: // We accept almost anything because of hex. and number suffixes if (!setWord.Contains(sc.ch) || sc.Match('.', '.')) { sc.SetState(SCE_COFFEESCRIPT_DEFAULT); } break; case SCE_COFFEESCRIPT_IDENTIFIER: if (!setWord.Contains(sc.ch) || (sc.ch == '.') || (sc.ch == '$')) { char s[1000]; sc.GetCurrent(s, sizeof(s)); if (keywords.InList(s)) { sc.ChangeState(SCE_COFFEESCRIPT_WORD); } else if (keywords2.InList(s)) { sc.ChangeState(SCE_COFFEESCRIPT_WORD2); } else if (keywords4.InList(s)) { sc.ChangeState(SCE_COFFEESCRIPT_GLOBALCLASS); } else if (sc.LengthCurrent() > 0 && s[0] == '@') { sc.ChangeState(SCE_COFFEESCRIPT_INSTANCEPROPERTY); } sc.SetState(SCE_COFFEESCRIPT_DEFAULT); } break; case SCE_COFFEESCRIPT_WORD: case SCE_COFFEESCRIPT_WORD2: case SCE_COFFEESCRIPT_GLOBALCLASS: case SCE_COFFEESCRIPT_INSTANCEPROPERTY: if (!setWord.Contains(sc.ch)) { sc.SetState(SCE_COFFEESCRIPT_DEFAULT); } break; case SCE_COFFEESCRIPT_COMMENTLINE: if (sc.atLineStart) { sc.SetState(SCE_COFFEESCRIPT_DEFAULT); } break; case SCE_COFFEESCRIPT_STRING: if (sc.ch == '\\') { if (sc.chNext == '\"' || sc.chNext == '\'' || sc.chNext == '\\') { sc.Forward(); } } else if (sc.ch == '\"') { sc.ForwardSetState(SCE_COFFEESCRIPT_DEFAULT); } else if (sc.ch == '#' && sc.chNext == '{' && inner_string_count < INNER_STRINGS_MAX_COUNT) { // process interpolated code #{ ... } enterInnerExpression(inner_string_types, inner_expn_brace_counts, inner_string_count, sc.state, brace_counts); sc.SetState(SCE_COFFEESCRIPT_OPERATOR); sc.ForwardSetState(SCE_COFFEESCRIPT_DEFAULT); } break; case SCE_COFFEESCRIPT_CHARACTER: if (sc.ch == '\\') { if (sc.chNext == '\"' || sc.chNext == '\'' || sc.chNext == '\\') { sc.Forward(); } } else if (sc.ch == '\'') { sc.ForwardSetState(SCE_COFFEESCRIPT_DEFAULT); } break; case SCE_COFFEESCRIPT_REGEX: if (sc.atLineStart) { sc.SetState(SCE_COFFEESCRIPT_DEFAULT); } else if (sc.ch == '/') { sc.Forward(); while ((sc.ch < 0x80) && islower(sc.ch)) sc.Forward(); // gobble regex flags sc.SetState(SCE_COFFEESCRIPT_DEFAULT); } else if (sc.ch == '\\') { // Gobble up the quoted character if (sc.chNext == '\\' || sc.chNext == '/') { sc.Forward(); } } break; case SCE_COFFEESCRIPT_STRINGEOL: if (sc.atLineStart) { sc.SetState(SCE_COFFEESCRIPT_DEFAULT); } break; case SCE_COFFEESCRIPT_COMMENTBLOCK: if (sc.Match("###")) { sc.Forward(); sc.Forward(); sc.ForwardSetState(SCE_COFFEESCRIPT_DEFAULT); } else if (sc.ch == '\\') { sc.Forward(); } break; case SCE_COFFEESCRIPT_VERBOSE_REGEX: if (sc.Match("///")) { sc.Forward(); sc.Forward(); sc.ForwardSetState(SCE_COFFEESCRIPT_DEFAULT); } else if (sc.Match('#')) { sc.SetState(SCE_COFFEESCRIPT_VERBOSE_REGEX_COMMENT); } else if (sc.ch == '\\') { sc.Forward(); } break; case SCE_COFFEESCRIPT_VERBOSE_REGEX_COMMENT: if (sc.atLineStart) { sc.SetState(SCE_COFFEESCRIPT_VERBOSE_REGEX); } break; } // Determine if a new state should be entered. if (sc.state == SCE_COFFEESCRIPT_DEFAULT) { if (IsADigit(sc.ch) || (sc.ch == '.' && IsADigit(sc.chNext))) { sc.SetState(SCE_COFFEESCRIPT_NUMBER); } else if (setWordStart.Contains(sc.ch)) { sc.SetState(SCE_COFFEESCRIPT_IDENTIFIER); } else if (sc.Match("///")) { sc.SetState(SCE_COFFEESCRIPT_VERBOSE_REGEX); sc.Forward(); sc.Forward(); } else if (sc.ch == '/' && (setOKBeforeRE.Contains(chPrevNonWhite) || followsKeyword(sc, styler)) && (!setCouldBePostOp.Contains(chPrevNonWhite) || !FollowsPostfixOperator(sc, styler))) { sc.SetState(SCE_COFFEESCRIPT_REGEX); // JavaScript's RegEx } else if (sc.ch == '\"') { sc.SetState(SCE_COFFEESCRIPT_STRING); } else if (sc.ch == '\'') { sc.SetState(SCE_COFFEESCRIPT_CHARACTER); } else if (sc.ch == '#') { if (sc.Match("###")) { sc.SetState(SCE_COFFEESCRIPT_COMMENTBLOCK); sc.Forward(); sc.Forward(); } else { sc.SetState(SCE_COFFEESCRIPT_COMMENTLINE); } } else if (isoperator(static_cast(sc.ch))) { sc.SetState(SCE_COFFEESCRIPT_OPERATOR); // Handle '..' and '...' operators correctly. if (sc.ch == '.') { for (int i = 0; i < 2 && sc.chNext == '.'; i++, sc.Forward()) ; } else if (sc.ch == '{') { ++brace_counts; } else if (sc.ch == '}' && --brace_counts <= 0 && inner_string_count > 0) { // Return to previous state before #{ ... } sc.ForwardSetState(exitInnerExpression(inner_string_types, inner_expn_brace_counts, inner_string_count, brace_counts)); continue; // skip sc.Forward() at loop end } } } if (!IsASpace(sc.ch) && !IsSpaceEquiv(sc.state)) { chPrevNonWhite = sc.ch; visibleChars++; } sc.Forward(); } sc.Complete(); } static bool IsCommentLine(Sci_Position line, Accessor &styler) { Sci_Position pos = styler.LineStart(line); Sci_Position eol_pos = styler.LineStart(line + 1) - 1; for (Sci_Position i = pos; i < eol_pos; i++) { char ch = styler[i]; if (ch == '#') return true; else if (ch != ' ' && ch != '\t') return false; } return false; } static void FoldCoffeeScriptDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { // A simplified version of FoldPyDoc const Sci_Position maxPos = startPos + length; const Sci_Position maxLines = styler.GetLine(maxPos - 1); // Requested last line const Sci_Position docLines = styler.GetLine(styler.Length() - 1); // Available last line // property fold.coffeescript.comment // Set to 1 to allow folding of comment blocks in CoffeeScript. const bool foldComment = styler.GetPropertyInt("fold.coffeescript.comment") != 0; const bool foldCompact = styler.GetPropertyInt("fold.compact") != 0; // Backtrack to previous non-blank line so we can determine indent level // for any white space lines // and so we can fix any preceding fold level (which is why we go back // at least one line in all cases) int spaceFlags = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int indentCurrent = styler.IndentAmount(lineCurrent, &spaceFlags, NULL); while (lineCurrent > 0) { lineCurrent--; indentCurrent = styler.IndentAmount(lineCurrent, &spaceFlags, NULL); if (!(indentCurrent & SC_FOLDLEVELWHITEFLAG) && !IsCommentLine(lineCurrent, styler)) break; } int indentCurrentLevel = indentCurrent & SC_FOLDLEVELNUMBERMASK; // Set up initial loop state int prevComment = 0; if (lineCurrent >= 1) prevComment = foldComment && IsCommentLine(lineCurrent - 1, styler); // Process all characters to end of requested range // or comment that hangs over the end of the range. Cap processing in all cases // to end of document (in case of comment at end). while ((lineCurrent <= docLines) && ((lineCurrent <= maxLines) || prevComment)) { // Gather info int lev = indentCurrent; Sci_Position lineNext = lineCurrent + 1; int indentNext = indentCurrent; if (lineNext <= docLines) { // Information about next line is only available if not at end of document indentNext = styler.IndentAmount(lineNext, &spaceFlags, NULL); } const int comment = foldComment && IsCommentLine(lineCurrent, styler); const int comment_start = (comment && !prevComment && (lineNext <= docLines) && IsCommentLine(lineNext, styler) && (lev > SC_FOLDLEVELBASE)); const int comment_continue = (comment && prevComment); if (!comment) indentCurrentLevel = indentCurrent & SC_FOLDLEVELNUMBERMASK; if (indentNext & SC_FOLDLEVELWHITEFLAG) indentNext = SC_FOLDLEVELWHITEFLAG | indentCurrentLevel; if (comment_start) { // Place fold point at start of a block of comments lev |= SC_FOLDLEVELHEADERFLAG; } else if (comment_continue) { // Add level to rest of lines in the block lev = lev + 1; } // Skip past any blank lines for next indent level info; we skip also // comments (all comments, not just those starting in column 0) // which effectively folds them into surrounding code rather // than screwing up folding. while ((lineNext < docLines) && ((indentNext & SC_FOLDLEVELWHITEFLAG) || (lineNext <= docLines && IsCommentLine(lineNext, styler)))) { lineNext++; indentNext = styler.IndentAmount(lineNext, &spaceFlags, NULL); } const int levelAfterComments = indentNext & SC_FOLDLEVELNUMBERMASK; const int levelBeforeComments = std::max(indentCurrentLevel,levelAfterComments); // Now set all the indent levels on the lines we skipped // Do this from end to start. Once we encounter one line // which is indented more than the line after the end of // the comment-block, use the level of the block before Sci_Position skipLine = lineNext; int skipLevel = levelAfterComments; while (--skipLine > lineCurrent) { int skipLineIndent = styler.IndentAmount(skipLine, &spaceFlags, NULL); if (foldCompact) { if ((skipLineIndent & SC_FOLDLEVELNUMBERMASK) > levelAfterComments) skipLevel = levelBeforeComments; int whiteFlag = skipLineIndent & SC_FOLDLEVELWHITEFLAG; styler.SetLevel(skipLine, skipLevel | whiteFlag); } else { if ((skipLineIndent & SC_FOLDLEVELNUMBERMASK) > levelAfterComments && !(skipLineIndent & SC_FOLDLEVELWHITEFLAG) && !IsCommentLine(skipLine, styler)) skipLevel = levelBeforeComments; styler.SetLevel(skipLine, skipLevel); } } // Set fold header on non-comment line if (!comment && !(indentCurrent & SC_FOLDLEVELWHITEFLAG)) { if ((indentCurrent & SC_FOLDLEVELNUMBERMASK) < (indentNext & SC_FOLDLEVELNUMBERMASK)) lev |= SC_FOLDLEVELHEADERFLAG; } // Keep track of block comment state of previous line prevComment = comment_start || comment_continue; // Set fold level for this line and move to next line styler.SetLevel(lineCurrent, lev); indentCurrent = indentNext; lineCurrent = lineNext; } } static const char *const csWordLists[] = { "Keywords", "Secondary keywords", "Unused", "Global classes", 0, }; LexerModule lmCoffeeScript(SCLEX_COFFEESCRIPT, ColouriseCoffeeScriptDoc, "coffeescript", FoldCoffeeScriptDoc, csWordLists); lexilla/lexers/LexFortran.cxx0000664000175000017500000006022514647367374015316 0ustar neilneil// Scintilla source code edit control /** @file LexFortran.cxx ** Lexer for Fortran. ** Written by Chuan-jian Shen, Last changed Sep. 2003 **/ // Copyright 1998-2001 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. /***************************************/ #include #include #include #include #include #include #include #include /***************************************/ #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" /***************************************/ using namespace Lexilla; /***********************************************/ static inline bool IsAWordChar(const int ch) { return (ch < 0x80) && (isalnum(ch) || ch == '_' || ch == '%'); } /**********************************************/ static inline bool IsAWordStart(const int ch) { return (ch < 0x80) && (isalnum(ch)); } /***************************************/ static inline bool IsABlank(unsigned int ch) { return (ch == ' ') || (ch == 0x09) || (ch == 0x0b) ; } /***************************************/ static inline bool IsALineEnd(char ch) { return ((ch == '\n') || (ch == '\r')) ; } /***************************************/ static Sci_PositionU GetContinuedPos(Sci_PositionU pos, Accessor &styler) { while (!IsALineEnd(styler.SafeGetCharAt(pos++))) continue; if (styler.SafeGetCharAt(pos) == '\n') pos++; while (IsABlank(styler.SafeGetCharAt(pos++))) continue; char chCur = styler.SafeGetCharAt(pos); if (chCur == '&') { while (IsABlank(styler.SafeGetCharAt(++pos))) continue; return pos; } else { return pos; } } /***************************************/ static void ColouriseFortranDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler, bool isFixFormat) { WordList &keywords = *keywordlists[0]; WordList &keywords2 = *keywordlists[1]; WordList &keywords3 = *keywordlists[2]; /***************************************/ Sci_Position posLineStart = 0; int numNonBlank = 0, prevState = 0; Sci_Position endPos = startPos + length; /***************************************/ // backtrack to the nearest keyword while ((startPos > 1) && (styler.StyleAt(startPos) != SCE_F_WORD)) { startPos--; } startPos = styler.LineStart(styler.GetLine(startPos)); initStyle = styler.StyleAt(startPos - 1); StyleContext sc(startPos, endPos-startPos, initStyle, styler); /***************************************/ for (; sc.More(); sc.Forward()) { // remember the start position of the line if (sc.atLineStart) { posLineStart = sc.currentPos; numNonBlank = 0; sc.SetState(SCE_F_DEFAULT); } if (!IsASpaceOrTab(sc.ch)) numNonBlank ++; /***********************************************/ // Handle the fix format generically Sci_Position toLineStart = sc.currentPos - posLineStart; if (isFixFormat && (toLineStart < 6 || toLineStart >= 72)) { if ((toLineStart == 0 && (tolower(sc.ch) == 'c' || sc.ch == '*')) || sc.ch == '!') { if (sc.MatchIgnoreCase("cdec$") || sc.MatchIgnoreCase("*dec$") || sc.MatchIgnoreCase("!dec$") || sc.MatchIgnoreCase("cdir$") || sc.MatchIgnoreCase("*dir$") || sc.MatchIgnoreCase("!dir$") || sc.MatchIgnoreCase("cms$") || sc.MatchIgnoreCase("*ms$") || sc.MatchIgnoreCase("!ms$") || sc.chNext == '$') { sc.SetState(SCE_F_PREPROCESSOR); } else { sc.SetState(SCE_F_COMMENT); } while (!sc.atLineEnd && sc.More()) sc.Forward(); // Until line end } else if (toLineStart >= 72) { sc.SetState(SCE_F_COMMENT); while (!sc.atLineEnd && sc.More()) sc.Forward(); // Until line end } else if (toLineStart < 5) { if (IsADigit(sc.ch)) sc.SetState(SCE_F_LABEL); else sc.SetState(SCE_F_DEFAULT); } else if (toLineStart == 5) { //if (!IsASpace(sc.ch) && sc.ch != '0') { if (sc.ch != '\r' && sc.ch != '\n') { sc.SetState(SCE_F_CONTINUATION); if (!IsASpace(sc.ch) && sc.ch != '0') sc.ForwardSetState(prevState); } else sc.SetState(SCE_F_DEFAULT); } continue; } /***************************************/ // Handle line continuation generically. if (!isFixFormat && sc.ch == '&' && sc.state != SCE_F_COMMENT) { char chTemp = ' '; Sci_Position j = 1; while (IsABlank(chTemp) && j<132) { chTemp = static_cast(sc.GetRelative(j)); j++; } if (chTemp == '!') { sc.SetState(SCE_F_CONTINUATION); if (sc.chNext == '!') sc.ForwardSetState(SCE_F_COMMENT); } else if (chTemp == '\r' || chTemp == '\n') { int currentState = sc.state; sc.SetState(SCE_F_CONTINUATION); sc.ForwardSetState(SCE_F_DEFAULT); while (IsASpace(sc.ch) && sc.More()) { sc.Forward(); if (sc.atLineStart) numNonBlank = 0; if (!IsASpaceOrTab(sc.ch)) numNonBlank ++; } if (sc.ch == '&') { sc.SetState(SCE_F_CONTINUATION); sc.Forward(); } sc.SetState(currentState); } } /***************************************/ // Hanndle preprocessor directives if (sc.ch == '#' && numNonBlank == 1) { sc.SetState(SCE_F_PREPROCESSOR); while (!sc.atLineEnd && sc.More()) sc.Forward(); // Until line end } /***************************************/ // Determine if the current state should terminate. if (sc.state == SCE_F_OPERATOR) { sc.SetState(SCE_F_DEFAULT); } else if (sc.state == SCE_F_NUMBER) { if (!(IsAWordChar(sc.ch) || sc.ch=='\'' || sc.ch=='\"' || sc.ch=='.')) { sc.SetState(SCE_F_DEFAULT); } } else if (sc.state == SCE_F_IDENTIFIER) { if (!IsAWordChar(sc.ch) || (sc.ch == '%')) { char s[100]; sc.GetCurrentLowered(s, sizeof(s)); if (keywords.InList(s)) { sc.ChangeState(SCE_F_WORD); } else if (keywords2.InList(s)) { sc.ChangeState(SCE_F_WORD2); } else if (keywords3.InList(s)) { sc.ChangeState(SCE_F_WORD3); } sc.SetState(SCE_F_DEFAULT); } } else if (sc.state == SCE_F_COMMENT || sc.state == SCE_F_PREPROCESSOR) { if (sc.ch == '\r' || sc.ch == '\n') { sc.SetState(SCE_F_DEFAULT); } } else if (sc.state == SCE_F_STRING1) { prevState = sc.state; if (sc.ch == '\'') { if (sc.chNext == '\'') { sc.Forward(); } else { sc.ForwardSetState(SCE_F_DEFAULT); prevState = SCE_F_DEFAULT; } } else if (sc.atLineEnd) { sc.ChangeState(SCE_F_STRINGEOL); sc.ForwardSetState(SCE_F_DEFAULT); } } else if (sc.state == SCE_F_STRING2) { prevState = sc.state; if (sc.atLineEnd) { sc.ChangeState(SCE_F_STRINGEOL); sc.ForwardSetState(SCE_F_DEFAULT); } else if (sc.ch == '\"') { if (sc.chNext == '\"') { sc.Forward(); } else { sc.ForwardSetState(SCE_F_DEFAULT); prevState = SCE_F_DEFAULT; } } } else if (sc.state == SCE_F_OPERATOR2) { if (sc.ch == '.') { sc.ForwardSetState(SCE_F_DEFAULT); } } else if (sc.state == SCE_F_CONTINUATION) { sc.SetState(SCE_F_DEFAULT); } else if (sc.state == SCE_F_LABEL) { if (!IsADigit(sc.ch)) { sc.SetState(SCE_F_DEFAULT); } else { if (isFixFormat && sc.currentPos-posLineStart > 4) sc.SetState(SCE_F_DEFAULT); else if (numNonBlank > 5) sc.SetState(SCE_F_DEFAULT); } } /***************************************/ // Determine if a new state should be entered. if (sc.state == SCE_F_DEFAULT) { if (sc.ch == '!') { if (sc.MatchIgnoreCase("!dec$") || sc.MatchIgnoreCase("!dir$") || sc.MatchIgnoreCase("!ms$") || sc.chNext == '$') { sc.SetState(SCE_F_PREPROCESSOR); } else { sc.SetState(SCE_F_COMMENT); } } else if ((!isFixFormat) && IsADigit(sc.ch) && numNonBlank == 1) { sc.SetState(SCE_F_LABEL); } else if (IsADigit(sc.ch) || (sc.ch == '.' && IsADigit(sc.chNext))) { sc.SetState(SCE_F_NUMBER); } else if ((tolower(sc.ch) == 'b' || tolower(sc.ch) == 'o' || tolower(sc.ch) == 'z') && (sc.chNext == '\"' || sc.chNext == '\'')) { sc.SetState(SCE_F_NUMBER); sc.Forward(); } else if (sc.ch == '.' && isalpha(sc.chNext)) { sc.SetState(SCE_F_OPERATOR2); } else if (IsAWordStart(sc.ch)) { sc.SetState(SCE_F_IDENTIFIER); } else if (sc.ch == '\"') { sc.SetState(SCE_F_STRING2); } else if (sc.ch == '\'') { sc.SetState(SCE_F_STRING1); } else if (isoperator(static_cast(sc.ch))) { sc.SetState(SCE_F_OPERATOR); } } } sc.Complete(); } /***************************************/ static void CheckLevelCommentLine(const unsigned int nComL, Sci_Position nComColB[], Sci_Position nComColF[], Sci_Position &nComCur, bool comLineB[], bool comLineF[], bool &comLineCur, int &levelDeltaNext) { levelDeltaNext = 0; if (!comLineCur) { return; } if (!comLineF[0] || nComColF[0] != nComCur) { unsigned int i=0; for (; i= nLineTotal) { return; } for (int i=nComL-2; i>=0; i--) { nComColB[i+1] = nComColB[i]; comLineB[i+1] = comLineB[i]; } nComColB[0] = nComCur; comLineB[0] = comLineCur; nComCur = nComColF[0]; comLineCur = comLineF[0]; for (unsigned int i=0; i+1 0) { lineCurrent--; startPos = styler.LineStart(lineCurrent); isPrevLine = true; } else { isPrevLine = false; } char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); int style = initStyle; int levelDeltaNext = 0; const unsigned int nComL = 3; // defines how many comment lines should be before they are folded Sci_Position nComColB[nComL] = {}; Sci_Position nComColF[nComL] = {}; Sci_Position nComCur = 0; bool comLineB[nComL] = {}; bool comLineF[nComL] = {}; bool comLineCur; Sci_Position nLineTotal = styler.GetLine(styler.Length()-1) + 1; if (foldComment) { for (unsigned int i=0; i= nLineTotal) { comLineF[i] = false; break; } GetIfLineComment(styler, isFixFormat, chL, comLineF[i], nComColF[i]); } GetIfLineComment(styler, isFixFormat, lineCurrent, comLineCur, nComCur); CheckBackComLines(styler, isFixFormat, lineCurrent, nComL, nComColB, nComColF, nComCur, comLineB, comLineF, comLineCur); } int levelCurrent = styler.LevelAt(lineCurrent) & SC_FOLDLEVELNUMBERMASK; /***************************************/ Sci_Position lastStart = 0; char prevWord[32] = ""; /***************************************/ for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); char chNextNonBlank = chNext; bool nextEOL = false; if (IsALineEnd(chNextNonBlank)) { nextEOL = true; } Sci_PositionU j=i+1; while(IsABlank(chNextNonBlank) && j(tolower(styler[lastStart+k])); } s[k] = '\0'; // Handle the forall and where statement and structure. if (strcmp(s, "forall") == 0 || (strcmp(s, "where") == 0 && strcmp(prevWord, "else") != 0)) { if (strcmp(prevWord, "end") != 0) { j = i + 1; char chBrace = '(', chSeek = ')', ch1 = styler.SafeGetCharAt(j); // Find the position of the first ( while (ch1 != chBrace && j 0) && (visibleChars > 0)) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) styler.SetLevel(lineCurrent, lev); lineCurrent++; levelCurrent += levelDeltaNext; levelDeltaNext = 0; visibleChars = 0; strcpy(prevWord, ""); isPrevLine = false; if (foldComment) { StepCommentLine(styler, isFixFormat, lineCurrent, nComL, nComColB, nComColF, nComCur, comLineB, comLineF, comLineCur); } } /***************************************/ if (!isspacechar(ch)) visibleChars++; } /***************************************/ } /***************************************/ static const char * const FortranWordLists[] = { "Primary keywords and identifiers", "Intrinsic functions", "Extended and user defined functions", 0, }; /***************************************/ static void ColouriseFortranDocFreeFormat(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { ColouriseFortranDoc(startPos, length, initStyle, keywordlists, styler, false); } /***************************************/ static void ColouriseFortranDocFixFormat(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { ColouriseFortranDoc(startPos, length, initStyle, keywordlists, styler, true); } /***************************************/ static void FoldFortranDocFreeFormat(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *[], Accessor &styler) { FoldFortranDoc(startPos, length, initStyle,styler, false); } /***************************************/ static void FoldFortranDocFixFormat(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *[], Accessor &styler) { FoldFortranDoc(startPos, length, initStyle,styler, true); } /***************************************/ LexerModule lmFortran(SCLEX_FORTRAN, ColouriseFortranDocFreeFormat, "fortran", FoldFortranDocFreeFormat, FortranWordLists); LexerModule lmF77(SCLEX_F77, ColouriseFortranDocFixFormat, "f77", FoldFortranDocFixFormat, FortranWordLists); lexilla/lexers/LexTAL.cxx0000664000175000017500000002567514647367374014335 0ustar neilneil// Scintilla source code edit control /** @file LexTAL.cxx ** Lexer for TAL ** Based on LexPascal.cxx ** Written by Laurent le Tynevez ** Updated by Simon Steele September 2002 ** Updated by Mathias Rauen May 2003 (Delphi adjustments) ** Updated by Rod Falck, Aug 2006 Converted to TAL **/ #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; inline bool isTALoperator(char ch) { return ch == '\'' || ch == '@' || ch == '#' || isoperator(ch); } inline bool isTALwordchar(char ch) { return ch == '$' || ch == '^' || iswordchar(ch); } inline bool isTALwordstart(char ch) { return ch == '$' || ch == '^' || iswordstart(ch); } static void getRange(Sci_PositionU start, Sci_PositionU end, Accessor &styler, char *s, Sci_PositionU len) { Sci_PositionU i = 0; while ((i < end - start + 1) && (i < len-1)) { s[i] = static_cast(tolower(styler[start + i])); i++; } s[i] = '\0'; } static bool IsStreamCommentStyle(int style) { return style == SCE_C_COMMENT || style == SCE_C_COMMENTDOC || style == SCE_C_COMMENTDOCKEYWORD || style == SCE_C_COMMENTDOCKEYWORDERROR; } static void ColourTo(Accessor &styler, Sci_PositionU end, unsigned int attr, bool bInAsm) { if ((bInAsm) && (attr == SCE_C_OPERATOR || attr == SCE_C_NUMBER || attr == SCE_C_DEFAULT || attr == SCE_C_WORD || attr == SCE_C_IDENTIFIER)) { styler.ColourTo(end, SCE_C_REGEX); } else styler.ColourTo(end, attr); } // returns 1 if the item starts a class definition, and -1 if the word is "end", and 2 if the word is "asm" static int classifyWordTAL(Sci_PositionU start, Sci_PositionU end, /*WordList &keywords*/WordList *keywordlists[], Accessor &styler, bool bInAsm) { int ret = 0; WordList& keywords = *keywordlists[0]; WordList& builtins = *keywordlists[1]; WordList& nonreserved_keywords = *keywordlists[2]; char s[100]; getRange(start, end, styler, s, sizeof(s)); char chAttr = SCE_C_IDENTIFIER; if (isdigit(s[0]) || (s[0] == '.')) { chAttr = SCE_C_NUMBER; } else { if (keywords.InList(s)) { chAttr = SCE_C_WORD; if (strcmp(s, "asm") == 0) { ret = 2; } else if (strcmp(s, "end") == 0) { ret = -1; } } else if (s[0] == '$' || builtins.InList(s)) { chAttr = SCE_C_WORD2; } else if (nonreserved_keywords.InList(s)) { chAttr = SCE_C_UUID; } } ColourTo(styler, end, chAttr, (bInAsm && ret != -1)); return ret; } static int classifyFoldPointTAL(const char* s) { int lev = 0; if (!(isdigit(s[0]) || (s[0] == '.'))) { if (strcmp(s, "begin") == 0 || strcmp(s, "block") == 0) { lev=1; } else if (strcmp(s, "end") == 0) { lev=-1; } } return lev; } static void ColouriseTALDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { styler.StartAt(startPos); int state = initStyle; if (state == SCE_C_CHARACTER) // Does not leak onto next line state = SCE_C_DEFAULT; char chPrev = ' '; char chNext = styler[startPos]; Sci_PositionU lengthDoc = startPos + length; bool bInClassDefinition; Sci_Position currentLine = styler.GetLine(startPos); if (currentLine > 0) { styler.SetLineState(currentLine, styler.GetLineState(currentLine-1)); bInClassDefinition = (styler.GetLineState(currentLine) == 1); } else { styler.SetLineState(currentLine, 0); bInClassDefinition = false; } bool bInAsm = (state == SCE_C_REGEX); if (bInAsm) state = SCE_C_DEFAULT; styler.StartSegment(startPos); int visibleChars = 0; for (Sci_PositionU i = startPos; i < lengthDoc; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); if ((ch == '\r' && chNext != '\n') || (ch == '\n')) { // Trigger on CR only (Mac style) or either on LF from CR+LF (Dos/Win) or on LF alone (Unix) // Avoid triggering two times on Dos/Win // End of line if (state == SCE_C_CHARACTER) { ColourTo(styler, i, state, bInAsm); state = SCE_C_DEFAULT; } visibleChars = 0; currentLine++; styler.SetLineState(currentLine, (bInClassDefinition ? 1 : 0)); } if (styler.IsLeadByte(ch)) { chNext = styler.SafeGetCharAt(i + 2); chPrev = ' '; i += 1; continue; } if (state == SCE_C_DEFAULT) { if (isTALwordstart(ch)) { ColourTo(styler, i-1, state, bInAsm); state = SCE_C_IDENTIFIER; } else if (ch == '!' && chNext != '*') { ColourTo(styler, i-1, state, bInAsm); state = SCE_C_COMMENT; } else if (ch == '!' && chNext == '*') { ColourTo(styler, i-1, state, bInAsm); state = SCE_C_COMMENTDOC; } else if (ch == '-' && chNext == '-') { ColourTo(styler, i-1, state, bInAsm); state = SCE_C_COMMENTLINE; } else if (ch == '"') { ColourTo(styler, i-1, state, bInAsm); state = SCE_C_STRING; } else if (ch == '?' && visibleChars == 0) { ColourTo(styler, i-1, state, bInAsm); state = SCE_C_PREPROCESSOR; } else if (isTALoperator(ch)) { ColourTo(styler, i-1, state, bInAsm); ColourTo(styler, i, SCE_C_OPERATOR, bInAsm); } } else if (state == SCE_C_IDENTIFIER) { if (!isTALwordchar(ch)) { int lStateChange = classifyWordTAL(styler.GetStartSegment(), i - 1, keywordlists, styler, bInAsm); if(lStateChange == 1) { styler.SetLineState(currentLine, 1); bInClassDefinition = true; } else if(lStateChange == 2) { bInAsm = true; } else if(lStateChange == -1) { styler.SetLineState(currentLine, 0); bInClassDefinition = false; bInAsm = false; } state = SCE_C_DEFAULT; chNext = styler.SafeGetCharAt(i + 1); if (ch == '!' && chNext != '*') { state = SCE_C_COMMENT; } else if (ch == '!' && chNext == '*') { ColourTo(styler, i-1, state, bInAsm); state = SCE_C_COMMENTDOC; } else if (ch == '-' && chNext == '-') { state = SCE_C_COMMENTLINE; } else if (ch == '"') { state = SCE_C_STRING; } else if (isTALoperator(ch)) { ColourTo(styler, i, SCE_C_OPERATOR, bInAsm); } } } else { if (state == SCE_C_PREPROCESSOR) { if ((ch == '\r' || ch == '\n') && !(chPrev == '\\' || chPrev == '\r')) { ColourTo(styler, i-1, state, bInAsm); state = SCE_C_DEFAULT; } } else if (state == SCE_C_COMMENT) { if (ch == '!' || (ch == '\r' || ch == '\n') ) { ColourTo(styler, i, state, bInAsm); state = SCE_C_DEFAULT; } } else if (state == SCE_C_COMMENTDOC) { if (ch == '!' || (ch == '\r' || ch == '\n')) { if (((i > styler.GetStartSegment() + 2) || ( (initStyle == SCE_C_COMMENTDOC) && (styler.GetStartSegment() == static_cast(startPos))))) { ColourTo(styler, i, state, bInAsm); state = SCE_C_DEFAULT; } } } else if (state == SCE_C_COMMENTLINE) { if (ch == '\r' || ch == '\n') { ColourTo(styler, i-1, state, bInAsm); state = SCE_C_DEFAULT; } } else if (state == SCE_C_STRING) { if (ch == '"') { ColourTo(styler, i, state, bInAsm); state = SCE_C_DEFAULT; } } } if (!isspacechar(ch)) visibleChars++; chPrev = ch; } ColourTo(styler, lengthDoc - 1, state, bInAsm); } static void FoldTALDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *[], Accessor &styler) { bool foldComment = styler.GetPropertyInt("fold.comment") != 0; bool foldPreprocessor = styler.GetPropertyInt("fold.preprocessor") != 0; bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelPrev = styler.LevelAt(lineCurrent) & SC_FOLDLEVELNUMBERMASK; int levelCurrent = levelPrev; char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); int style = initStyle; bool was_end = false; bool section = false; Sci_Position lastStart = 0; for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); int stylePrev = style; style = styleNext; styleNext = styler.StyleAt(i + 1); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (stylePrev == SCE_C_DEFAULT && (style == SCE_C_WORD || style == SCE_C_UUID || style == SCE_C_PREPROCESSOR)) { // Store last word start point. lastStart = i; } if (stylePrev == SCE_C_WORD || style == SCE_C_UUID || stylePrev == SCE_C_PREPROCESSOR) { if(isTALwordchar(ch) && !isTALwordchar(chNext)) { char s[100]; getRange(lastStart, i, styler, s, sizeof(s)); if (stylePrev == SCE_C_PREPROCESSOR && strcmp(s, "?section") == 0) { section = true; levelCurrent = 1; levelPrev = 0; } else if (stylePrev == SCE_C_WORD || stylePrev == SCE_C_UUID) { if (strcmp(s, "block") == 0) { // block keyword is ignored immediately after end keyword if (!was_end) levelCurrent++; } else levelCurrent += classifyFoldPointTAL(s); if (strcmp(s, "end") == 0) { was_end = true; } else { was_end = false; } } } } if (foldComment && (style == SCE_C_COMMENTLINE)) { if ((ch == '/') && (chNext == '/')) { char chNext2 = styler.SafeGetCharAt(i + 2); if (chNext2 == '{') { levelCurrent++; } else if (chNext2 == '}') { levelCurrent--; } } } if (foldPreprocessor && (style == SCE_C_PREPROCESSOR)) { if (ch == '{' && chNext == '$') { Sci_PositionU j=i+2; // skip {$ while ((j levelPrev || section) && (visibleChars > 0)) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelPrev = levelCurrent; visibleChars = 0; section = false; } if (!isspacechar(ch)) visibleChars++; } // Fill in the real level of the next line, keeping the current flags as they will be filled in later int flagsNext = styler.LevelAt(lineCurrent) & ~SC_FOLDLEVELNUMBERMASK; styler.SetLevel(lineCurrent, levelPrev | flagsNext); } static const char * const TALWordListDesc[] = { "Keywords", "Builtins", 0 }; LexerModule lmTAL(SCLEX_TAL, ColouriseTALDoc, "TAL", FoldTALDoc, TALWordListDesc); lexilla/lexers/LexAPDL.cxx0000664000175000017500000001705014647367374014421 0ustar neilneil// Scintilla source code edit control /** @file LexAPDL.cxx ** Lexer for APDL. Based on the lexer for Assembler by The Black Horus. ** By Hadar Raz. **/ // Copyright 1998-2003 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static inline bool IsAWordChar(const int ch) { return (ch < 0x80 && (isalnum(ch) || ch == '_')); } static inline bool IsAnOperator(char ch) { // '.' left out as it is used to make up numbers if (ch == '*' || ch == '/' || ch == '-' || ch == '+' || ch == '(' || ch == ')' || ch == '=' || ch == '^' || ch == '[' || ch == ']' || ch == '<' || ch == '&' || ch == '>' || ch == ',' || ch == '|' || ch == '~' || ch == '$' || ch == ':' || ch == '%') return true; return false; } static void ColouriseAPDLDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { int stringStart = ' '; WordList &processors = *keywordlists[0]; WordList &commands = *keywordlists[1]; WordList &slashcommands = *keywordlists[2]; WordList &starcommands = *keywordlists[3]; WordList &arguments = *keywordlists[4]; WordList &functions = *keywordlists[5]; // Do not leak onto next line initStyle = SCE_APDL_DEFAULT; StyleContext sc(startPos, length, initStyle, styler); for (; sc.More(); sc.Forward()) { // Determine if the current state should terminate. if (sc.state == SCE_APDL_NUMBER) { if (!(IsADigit(sc.ch) || sc.ch == '.' || (sc.ch == 'e' || sc.ch == 'E') || ((sc.ch == '+' || sc.ch == '-') && (sc.chPrev == 'e' || sc.chPrev == 'E')))) { sc.SetState(SCE_APDL_DEFAULT); } } else if (sc.state == SCE_APDL_COMMENT) { if (sc.atLineEnd) { sc.SetState(SCE_APDL_DEFAULT); } } else if (sc.state == SCE_APDL_COMMENTBLOCK) { if (sc.atLineEnd) { if (sc.ch == '\r') { sc.Forward(); } sc.ForwardSetState(SCE_APDL_DEFAULT); } } else if (sc.state == SCE_APDL_STRING) { if (sc.atLineEnd) { sc.SetState(SCE_APDL_DEFAULT); } else if ((sc.ch == '\'' && stringStart == '\'') || (sc.ch == '\"' && stringStart == '\"')) { sc.ForwardSetState(SCE_APDL_DEFAULT); } } else if (sc.state == SCE_APDL_WORD) { if (!IsAWordChar(sc.ch)) { char s[100]; sc.GetCurrentLowered(s, sizeof(s)); if (processors.InList(s)) { sc.ChangeState(SCE_APDL_PROCESSOR); } else if (slashcommands.InList(s)) { sc.ChangeState(SCE_APDL_SLASHCOMMAND); } else if (starcommands.InList(s)) { sc.ChangeState(SCE_APDL_STARCOMMAND); } else if (commands.InList(s)) { sc.ChangeState(SCE_APDL_COMMAND); } else if (arguments.InList(s)) { sc.ChangeState(SCE_APDL_ARGUMENT); } else if (functions.InList(s)) { sc.ChangeState(SCE_APDL_FUNCTION); } sc.SetState(SCE_APDL_DEFAULT); } } else if (sc.state == SCE_APDL_OPERATOR) { if (!IsAnOperator(static_cast(sc.ch))) { sc.SetState(SCE_APDL_DEFAULT); } } // Determine if a new state should be entered. if (sc.state == SCE_APDL_DEFAULT) { if (sc.ch == '!' && sc.chNext == '!') { sc.SetState(SCE_APDL_COMMENTBLOCK); } else if (sc.ch == '!') { sc.SetState(SCE_APDL_COMMENT); } else if (IsADigit(sc.ch) || (sc.ch == '.' && IsADigit(sc.chNext))) { sc.SetState(SCE_APDL_NUMBER); } else if (sc.ch == '\'' || sc.ch == '\"') { sc.SetState(SCE_APDL_STRING); stringStart = sc.ch; } else if (IsAWordChar(sc.ch) || ((sc.ch == '*' || sc.ch == '/') && !isgraph(sc.chPrev))) { sc.SetState(SCE_APDL_WORD); } else if (IsAnOperator(static_cast(sc.ch))) { sc.SetState(SCE_APDL_OPERATOR); } } } sc.Complete(); } //------------------------------------------------------------------------------ // 06-27-07 Sergio Lucato // - Included code folding for Ansys APDL lexer // - Copyied from LexBasic.cxx and modified for APDL //------------------------------------------------------------------------------ /* Bits: * 1 - whitespace * 2 - operator * 4 - identifier * 8 - decimal digit * 16 - hex digit * 32 - bin digit */ static int character_classification[128] = { 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 1, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 2, 0, 2, 2, 2, 2, 2, 2, 2, 6, 2, 2, 2, 10, 6, 60, 60, 28, 28, 28, 28, 28, 28, 28, 28, 2, 2, 2, 2, 2, 2, 2, 20, 20, 20, 20, 20, 20, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 2, 2, 2, 2, 4, 2, 20, 20, 20, 20, 20, 20, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 2, 2, 2, 2, 0 }; static bool IsSpace(int c) { return c < 128 && (character_classification[c] & 1); } static bool IsIdentifier(int c) { return c < 128 && (character_classification[c] & 4); } static int LowerCase(int c) { if (c >= 'A' && c <= 'Z') return 'a' + c - 'A'; return c; } static int CheckAPDLFoldPoint(char const *token, int &level) { if (!strcmp(token, "*if") || !strcmp(token, "*do") || !strcmp(token, "*dowhile") ) { level |= SC_FOLDLEVELHEADERFLAG; return 1; } if (!strcmp(token, "*endif") || !strcmp(token, "*enddo") ) { return -1; } return 0; } static void FoldAPDLDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { Sci_Position line = styler.GetLine(startPos); int level = styler.LevelAt(line); int go = 0, done = 0; Sci_Position endPos = startPos + length; char word[256]; int wordlen = 0; Sci_Position i; bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; // Scan for tokens at the start of the line (they may include // whitespace, for tokens like "End Function" for (i = startPos; i < endPos; i++) { int c = styler.SafeGetCharAt(i); if (!done && !go) { if (wordlen) { // are we scanning a token already? word[wordlen] = static_cast(LowerCase(c)); if (!IsIdentifier(c)) { // done with token word[wordlen] = '\0'; go = CheckAPDLFoldPoint(word, level); if (!go) { // Treat any whitespace as single blank, for // things like "End Function". if (IsSpace(c) && IsIdentifier(word[wordlen - 1])) { word[wordlen] = ' '; if (wordlen < 255) wordlen++; } else // done with this line done = 1; } } else if (wordlen < 255) { wordlen++; } } else { // start scanning at first non-whitespace character if (!IsSpace(c)) { if (IsIdentifier(c)) { word[0] = static_cast(LowerCase(c)); wordlen = 1; } else // done with this line done = 1; } } } if (c == '\n') { // line end if (!done && wordlen == 0 && foldCompact) // line was only space level |= SC_FOLDLEVELWHITEFLAG; if (level != styler.LevelAt(line)) styler.SetLevel(line, level); level += go; line++; // reset state wordlen = 0; level &= ~SC_FOLDLEVELHEADERFLAG; level &= ~SC_FOLDLEVELWHITEFLAG; go = 0; done = 0; } } } static const char * const apdlWordListDesc[] = { "processors", "commands", "slashommands", "starcommands", "arguments", "functions", 0 }; LexerModule lmAPDL(SCLEX_APDL, ColouriseAPDLDoc, "apdl", FoldAPDLDoc, apdlWordListDesc); lexilla/lexers/LexJSON.cxx0000664000175000017500000003305514647367374014455 0ustar neilneil// Scintilla source code edit control /** * @file LexJSON.cxx * @date February 19, 2016 * @brief Lexer for JSON and JSON-LD formats * @author nkmathew * * The License.txt file describes the conditions under which this software may * be distributed. * */ #include #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" #include "OptionSet.h" #include "DefaultLexer.h" using namespace Scintilla; using namespace Lexilla; static const char *const JSONWordListDesc[] = { "JSON Keywords", "JSON-LD Keywords", 0 }; /** * Used to detect compact IRI/URLs in JSON-LD without first looking ahead for the * colon separating the prefix and suffix * * https://www.w3.org/TR/json-ld/#dfn-compact-iri */ struct CompactIRI { int colonCount; bool foundInvalidChar; CharacterSet setCompactIRI; CompactIRI() { colonCount = 0; foundInvalidChar = false; setCompactIRI = CharacterSet(CharacterSet::setAlpha, "$_-"); } void resetState() { colonCount = 0; foundInvalidChar = false; } void checkChar(int ch) { if (ch == ':') { colonCount++; } else { foundInvalidChar |= !setCompactIRI.Contains(ch); } } bool shouldHighlight() const { return !foundInvalidChar && colonCount == 1; } }; /** * Keeps track of escaped characters in strings as per: * * https://tools.ietf.org/html/rfc7159#section-7 */ struct EscapeSequence { int digitsLeft; CharacterSet setHexDigits; CharacterSet setEscapeChars; EscapeSequence() { digitsLeft = 0; setHexDigits = CharacterSet(CharacterSet::setDigits, "ABCDEFabcdef"); setEscapeChars = CharacterSet(CharacterSet::setNone, "\\\"tnbfru/"); } // Returns true if the following character is a valid escaped character bool newSequence(int nextChar) { digitsLeft = 0; if (nextChar == 'u') { digitsLeft = 5; } else if (!setEscapeChars.Contains(nextChar)) { return false; } return true; } bool atEscapeEnd() const { return digitsLeft <= 0; } bool isInvalidChar(int currChar) const { return !setHexDigits.Contains(currChar); } }; struct OptionsJSON { bool foldCompact; bool fold; bool allowComments; bool escapeSequence; OptionsJSON() { foldCompact = false; fold = false; allowComments = false; escapeSequence = false; } }; struct OptionSetJSON : public OptionSet { OptionSetJSON() { DefineProperty("lexer.json.escape.sequence", &OptionsJSON::escapeSequence, "Set to 1 to enable highlighting of escape sequences in strings"); DefineProperty("lexer.json.allow.comments", &OptionsJSON::allowComments, "Set to 1 to enable highlighting of line/block comments in JSON"); DefineProperty("fold.compact", &OptionsJSON::foldCompact); DefineProperty("fold", &OptionsJSON::fold); DefineWordListSets(JSONWordListDesc); } }; class LexerJSON : public DefaultLexer { OptionsJSON options; OptionSetJSON optSetJSON; EscapeSequence escapeSeq; WordList keywordsJSON; WordList keywordsJSONLD; CharacterSet setOperators; CharacterSet setURL; CharacterSet setKeywordJSONLD; CharacterSet setKeywordJSON; CompactIRI compactIRI; static bool IsNextNonWhitespace(LexAccessor &styler, Sci_Position start, char ch) { Sci_Position i = 0; while (i < 50) { i++; char curr = styler.SafeGetCharAt(start+i, '\0'); char next = styler.SafeGetCharAt(start+i+1, '\0'); bool atEOL = (curr == '\r' && next != '\n') || (curr == '\n'); if (curr == ch) { return true; } else if (!isspacechar(curr) || atEOL) { return false; } } return false; } /** * Looks for the colon following the end quote * * Assumes property names of lengths no longer than a 100 characters. * The colon is also expected to be less than 50 spaces after the end * quote for the string to be considered a property name */ static bool AtPropertyName(LexAccessor &styler, Sci_Position start) { Sci_Position i = 0; bool escaped = false; while (i < 100) { i++; char curr = styler.SafeGetCharAt(start+i, '\0'); if (escaped) { escaped = false; continue; } escaped = curr == '\\'; if (curr == '"') { return IsNextNonWhitespace(styler, start+i, ':'); } else if (!curr) { return false; } } return false; } static bool IsNextWordInList(WordList &keywordList, CharacterSet wordSet, StyleContext &context, LexAccessor &styler) { char word[51]; Sci_Position currPos = (Sci_Position) context.currentPos; int i = 0; while (i < 50) { char ch = styler.SafeGetCharAt(currPos + i); if (!wordSet.Contains(ch)) { break; } word[i] = ch; i++; } word[i] = '\0'; return keywordList.InList(word); } public: LexerJSON() : DefaultLexer("json", SCLEX_JSON), setOperators(CharacterSet::setNone, "[{}]:,"), setURL(CharacterSet::setAlphaNum, "-._~:/?#[]@!$&'()*+,),="), setKeywordJSONLD(CharacterSet::setAlpha, ":@"), setKeywordJSON(CharacterSet::setAlpha, "$_") { } virtual ~LexerJSON() {} int SCI_METHOD Version() const override { return lvRelease5; } void SCI_METHOD Release() override { delete this; } const char *SCI_METHOD PropertyNames() override { return optSetJSON.PropertyNames(); } int SCI_METHOD PropertyType(const char *name) override { return optSetJSON.PropertyType(name); } const char *SCI_METHOD DescribeProperty(const char *name) override { return optSetJSON.DescribeProperty(name); } Sci_Position SCI_METHOD PropertySet(const char *key, const char *val) override { if (optSetJSON.PropertySet(&options, key, val)) { return 0; } return -1; } const char * SCI_METHOD PropertyGet(const char *key) override { return optSetJSON.PropertyGet(key); } Sci_Position SCI_METHOD WordListSet(int n, const char *wl) override { WordList *wordListN = 0; switch (n) { case 0: wordListN = &keywordsJSON; break; case 1: wordListN = &keywordsJSONLD; break; } Sci_Position firstModification = -1; if (wordListN) { if (wordListN->Set(wl)) { firstModification = 0; } } return firstModification; } void *SCI_METHOD PrivateCall(int, void *) override { return 0; } static ILexer5 *LexerFactoryJSON() { return new LexerJSON; } const char *SCI_METHOD DescribeWordListSets() override { return optSetJSON.DescribeWordListSets(); } void SCI_METHOD Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void SCI_METHOD Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; }; void SCI_METHOD LexerJSON::Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { LexAccessor styler(pAccess); StyleContext context(startPos, length, initStyle, styler); int stringStyleBefore = SCE_JSON_STRING; while (context.More()) { switch (context.state) { case SCE_JSON_BLOCKCOMMENT: if (context.Match("*/")) { context.Forward(); context.ForwardSetState(SCE_JSON_DEFAULT); } break; case SCE_JSON_LINECOMMENT: if (context.MatchLineEnd()) { context.SetState(SCE_JSON_DEFAULT); } break; case SCE_JSON_STRINGEOL: if (context.atLineStart) { context.SetState(SCE_JSON_DEFAULT); } break; case SCE_JSON_ESCAPESEQUENCE: escapeSeq.digitsLeft--; if (!escapeSeq.atEscapeEnd()) { if (escapeSeq.isInvalidChar(context.ch)) { context.SetState(SCE_JSON_ERROR); } break; } if (context.ch == '"') { context.SetState(stringStyleBefore); context.ForwardSetState(SCE_JSON_DEFAULT); } else if (context.ch == '\\') { if (!escapeSeq.newSequence(context.chNext)) { context.SetState(SCE_JSON_ERROR); } context.Forward(); } else { context.SetState(stringStyleBefore); if (context.atLineEnd) { context.ChangeState(SCE_JSON_STRINGEOL); } } break; case SCE_JSON_PROPERTYNAME: case SCE_JSON_STRING: if (context.ch == '"') { if (compactIRI.shouldHighlight()) { context.ChangeState(SCE_JSON_COMPACTIRI); context.ForwardSetState(SCE_JSON_DEFAULT); compactIRI.resetState(); } else { context.ForwardSetState(SCE_JSON_DEFAULT); } } else if (context.atLineEnd) { context.ChangeState(SCE_JSON_STRINGEOL); } else if (context.ch == '\\') { stringStyleBefore = context.state; if (options.escapeSequence) { context.SetState(SCE_JSON_ESCAPESEQUENCE); if (!escapeSeq.newSequence(context.chNext)) { context.SetState(SCE_JSON_ERROR); } } context.Forward(); } else if (context.Match("https://") || context.Match("http://") || context.Match("ssh://") || context.Match("git://") || context.Match("svn://") || context.Match("ftp://") || context.Match("mailto:")) { // Handle most common URI schemes only stringStyleBefore = context.state; context.SetState(SCE_JSON_URI); } else if (context.ch == '@') { // https://www.w3.org/TR/json-ld/#dfn-keyword if (IsNextWordInList(keywordsJSONLD, setKeywordJSONLD, context, styler)) { stringStyleBefore = context.state; context.SetState(SCE_JSON_LDKEYWORD); } } else { compactIRI.checkChar(context.ch); } break; case SCE_JSON_LDKEYWORD: case SCE_JSON_URI: if ((!setKeywordJSONLD.Contains(context.ch) && (context.state == SCE_JSON_LDKEYWORD)) || (!setURL.Contains(context.ch))) { context.SetState(stringStyleBefore); } if (context.ch == '"') { context.ForwardSetState(SCE_JSON_DEFAULT); } else if (context.atLineEnd) { context.ChangeState(SCE_JSON_STRINGEOL); } break; case SCE_JSON_OPERATOR: case SCE_JSON_NUMBER: context.SetState(SCE_JSON_DEFAULT); break; case SCE_JSON_ERROR: if (context.MatchLineEnd()) { context.SetState(SCE_JSON_DEFAULT); } break; case SCE_JSON_KEYWORD: if (!setKeywordJSON.Contains(context.ch)) { context.SetState(SCE_JSON_DEFAULT); } break; } if (context.state == SCE_JSON_DEFAULT) { if (context.ch == '"') { compactIRI.resetState(); context.SetState(SCE_JSON_STRING); Sci_Position currPos = static_cast(context.currentPos); if (AtPropertyName(styler, currPos)) { context.SetState(SCE_JSON_PROPERTYNAME); } } else if (setOperators.Contains(context.ch)) { context.SetState(SCE_JSON_OPERATOR); } else if (options.allowComments && context.Match("/*")) { context.SetState(SCE_JSON_BLOCKCOMMENT); context.Forward(); } else if (options.allowComments && context.Match("//")) { context.SetState(SCE_JSON_LINECOMMENT); } else if (setKeywordJSON.Contains(context.ch)) { if (IsNextWordInList(keywordsJSON, setKeywordJSON, context, styler)) { context.SetState(SCE_JSON_KEYWORD); } } bool numberStart = IsADigit(context.ch) && (context.chPrev == '+'|| context.chPrev == '-' || context.atLineStart || IsASpace(context.chPrev) || setOperators.Contains(context.chPrev)); bool exponentPart = tolower(context.ch) == 'e' && IsADigit(context.chPrev) && (IsADigit(context.chNext) || context.chNext == '+' || context.chNext == '-'); bool signPart = (context.ch == '-' || context.ch == '+') && ((tolower(context.chPrev) == 'e' && IsADigit(context.chNext)) || ((IsASpace(context.chPrev) || setOperators.Contains(context.chPrev)) && IsADigit(context.chNext))); bool adjacentDigit = IsADigit(context.ch) && IsADigit(context.chPrev); bool afterExponent = IsADigit(context.ch) && tolower(context.chPrev) == 'e'; bool dotPart = context.ch == '.' && IsADigit(context.chPrev) && IsADigit(context.chNext); bool afterDot = IsADigit(context.ch) && context.chPrev == '.'; if (numberStart || exponentPart || signPart || adjacentDigit || dotPart || afterExponent || afterDot) { context.SetState(SCE_JSON_NUMBER); } else if (context.state == SCE_JSON_DEFAULT && !IsASpace(context.ch)) { context.SetState(SCE_JSON_ERROR); } } context.Forward(); } context.Complete(); } void SCI_METHOD LexerJSON::Fold(Sci_PositionU startPos, Sci_Position length, int, IDocument *pAccess) { if (!options.fold) { return; } LexAccessor styler(pAccess); Sci_PositionU currLine = styler.GetLine(startPos); Sci_PositionU endPos = startPos + length; int currLevel = SC_FOLDLEVELBASE; if (currLine > 0) currLevel = styler.LevelAt(currLine - 1) >> 16; int nextLevel = currLevel; int visibleChars = 0; for (Sci_PositionU i = startPos; i < endPos; i++) { char curr = styler.SafeGetCharAt(i); char next = styler.SafeGetCharAt(i+1); bool atEOL = (curr == '\r' && next != '\n') || (curr == '\n'); if (styler.StyleAt(i) == SCE_JSON_OPERATOR) { if (curr == '{' || curr == '[') { nextLevel++; } else if (curr == '}' || curr == ']') { nextLevel--; } } if (atEOL || i == (endPos-1)) { int level = currLevel | nextLevel << 16; if (!visibleChars && options.foldCompact) { level |= SC_FOLDLEVELWHITEFLAG; } else if (nextLevel > currLevel) { level |= SC_FOLDLEVELHEADERFLAG; } if (level != styler.LevelAt(currLine)) { styler.SetLevel(currLine, level); } currLine++; currLevel = nextLevel; visibleChars = 0; } if (!isspacechar(curr)) { visibleChars++; } } } LexerModule lmJSON(SCLEX_JSON, LexerJSON::LexerFactoryJSON, "json", JSONWordListDesc); lexilla/lexers/LexFlagship.cxx0000664000175000017500000003006014647367374015432 0ustar neilneil// Scintilla source code edit control /** @file LexFlagship.cxx ** Lexer for Harbour and FlagShip. ** (Syntactically compatible to other xBase dialects, like Clipper, dBase, Clip, FoxPro etc.) **/ // Copyright 2005 by Randy Butler // Copyright 2010 by Xavi (Harbour) // Copyright 1998-2003 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; // Extended to accept accented characters static inline bool IsAWordChar(int ch) { return ch >= 0x80 || (isalnum(ch) || ch == '_'); } static void ColouriseFlagShipDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { WordList &keywords = *keywordlists[0]; WordList &keywords2 = *keywordlists[1]; WordList &keywords3 = *keywordlists[2]; WordList &keywords4 = *keywordlists[3]; WordList &keywords5 = *keywordlists[4]; // property lexer.flagship.styling.within.preprocessor // For Harbour code, determines whether all preprocessor code is styled in the preprocessor style (0) or only from the // initial # to the end of the command word(1, the default). It also determines how to present text, dump, and disabled code. bool stylingWithinPreprocessor = styler.GetPropertyInt("lexer.flagship.styling.within.preprocessor", 1) != 0; CharacterSet setDoxygen(CharacterSet::setAlpha, "$@\\&<>#{}[]"); int visibleChars = 0; int closeStringChar = 0; int styleBeforeDCKeyword = SCE_FS_DEFAULT; bool bEnableCode = initStyle < SCE_FS_DISABLEDCODE; StyleContext sc(startPos, length, initStyle, styler); for (; sc.More(); sc.Forward()) { // Determine if the current state should terminate. switch (sc.state) { case SCE_FS_OPERATOR: case SCE_FS_OPERATOR_C: case SCE_FS_WORDOPERATOR: sc.SetState(bEnableCode ? SCE_FS_DEFAULT : SCE_FS_DEFAULT_C); break; case SCE_FS_IDENTIFIER: case SCE_FS_IDENTIFIER_C: if (!IsAWordChar(sc.ch)) { char s[64]; sc.GetCurrentLowered(s, sizeof(s)); if (keywords.InList(s)) { sc.ChangeState(bEnableCode ? SCE_FS_KEYWORD : SCE_FS_KEYWORD_C); } else if (keywords2.InList(s)) { sc.ChangeState(bEnableCode ? SCE_FS_KEYWORD2 : SCE_FS_KEYWORD2_C); } else if (bEnableCode && keywords3.InList(s)) { sc.ChangeState(SCE_FS_KEYWORD3); } else if (bEnableCode && keywords4.InList(s)) { sc.ChangeState(SCE_FS_KEYWORD4); }// Else, it is really an identifier... sc.SetState(bEnableCode ? SCE_FS_DEFAULT : SCE_FS_DEFAULT_C); } break; case SCE_FS_NUMBER: if (!IsAWordChar(sc.ch) && !(sc.ch == '.' && IsADigit(sc.chNext))) { sc.SetState(SCE_FS_DEFAULT); } break; case SCE_FS_NUMBER_C: if (!IsAWordChar(sc.ch) && sc.ch != '.') { sc.SetState(SCE_FS_DEFAULT_C); } break; case SCE_FS_CONSTANT: if (!IsAWordChar(sc.ch)) { sc.SetState(SCE_FS_DEFAULT); } break; case SCE_FS_STRING: case SCE_FS_STRING_C: if (sc.ch == closeStringChar) { sc.ForwardSetState(bEnableCode ? SCE_FS_DEFAULT : SCE_FS_DEFAULT_C); } else if (sc.atLineEnd) { sc.ChangeState(bEnableCode ? SCE_FS_STRINGEOL : SCE_FS_STRINGEOL_C); } break; case SCE_FS_STRINGEOL: case SCE_FS_STRINGEOL_C: if (sc.atLineStart) { sc.SetState(bEnableCode ? SCE_FS_DEFAULT : SCE_FS_DEFAULT_C); } break; case SCE_FS_COMMENTDOC: case SCE_FS_COMMENTDOC_C: if (sc.Match('*', '/')) { sc.Forward(); sc.ForwardSetState(bEnableCode ? SCE_FS_DEFAULT : SCE_FS_DEFAULT_C); } else if (sc.ch == '@' || sc.ch == '\\') { // JavaDoc and Doxygen support // Verify that we have the conditions to mark a comment-doc-keyword if ((IsASpace(sc.chPrev) || sc.chPrev == '*') && (!IsASpace(sc.chNext))) { styleBeforeDCKeyword = bEnableCode ? SCE_FS_COMMENTDOC : SCE_FS_COMMENTDOC_C; sc.SetState(SCE_FS_COMMENTDOCKEYWORD); } } break; case SCE_FS_COMMENT: case SCE_FS_COMMENTLINE: if (sc.atLineStart) { sc.SetState(SCE_FS_DEFAULT); } break; case SCE_FS_COMMENTLINEDOC: case SCE_FS_COMMENTLINEDOC_C: if (sc.atLineStart) { sc.SetState(bEnableCode ? SCE_FS_DEFAULT : SCE_FS_DEFAULT_C); } else if (sc.ch == '@' || sc.ch == '\\') { // JavaDoc and Doxygen support // Verify that we have the conditions to mark a comment-doc-keyword if ((IsASpace(sc.chPrev) || sc.chPrev == '/' || sc.chPrev == '!') && (!IsASpace(sc.chNext))) { styleBeforeDCKeyword = bEnableCode ? SCE_FS_COMMENTLINEDOC : SCE_FS_COMMENTLINEDOC_C; sc.SetState(SCE_FS_COMMENTDOCKEYWORD); } } break; case SCE_FS_COMMENTDOCKEYWORD: if ((styleBeforeDCKeyword == SCE_FS_COMMENTDOC || styleBeforeDCKeyword == SCE_FS_COMMENTDOC_C) && sc.Match('*', '/')) { sc.ChangeState(SCE_FS_COMMENTDOCKEYWORDERROR); sc.Forward(); sc.ForwardSetState(bEnableCode ? SCE_FS_DEFAULT : SCE_FS_DEFAULT_C); } else if (!setDoxygen.Contains(sc.ch)) { char s[64]; sc.GetCurrentLowered(s, sizeof(s)); if (!IsASpace(sc.ch) || !keywords5.InList(s + 1)) { sc.ChangeState(SCE_FS_COMMENTDOCKEYWORDERROR); } sc.SetState(styleBeforeDCKeyword); } break; case SCE_FS_PREPROCESSOR: case SCE_FS_PREPROCESSOR_C: if (sc.atLineEnd) { if (!(sc.chPrev == ';' || sc.GetRelative(-2) == ';')) { sc.SetState(bEnableCode ? SCE_FS_DEFAULT : SCE_FS_DEFAULT_C); } } else if (stylingWithinPreprocessor) { if (IsASpaceOrTab(sc.ch)) { sc.SetState(bEnableCode ? SCE_FS_DEFAULT : SCE_FS_DEFAULT_C); } } else if (sc.Match('/', '*') || sc.Match('/', '/') || sc.Match('&', '&')) { sc.SetState(bEnableCode ? SCE_FS_DEFAULT : SCE_FS_DEFAULT_C); } break; case SCE_FS_DISABLEDCODE: if (sc.ch == '#' && visibleChars == 0) { sc.SetState(bEnableCode ? SCE_FS_PREPROCESSOR : SCE_FS_PREPROCESSOR_C); do { // Skip whitespace between # and preprocessor word sc.Forward(); } while (IsASpaceOrTab(sc.ch) && sc.More()); if (sc.MatchIgnoreCase("pragma")) { sc.Forward(6); do { // Skip more whitespace until keyword sc.Forward(); } while (IsASpaceOrTab(sc.ch) && sc.More()); if (sc.MatchIgnoreCase("enddump") || sc.MatchIgnoreCase("__endtext")) { bEnableCode = true; sc.SetState(SCE_FS_DISABLEDCODE); sc.Forward(sc.ch == '_' ? 8 : 6); sc.ForwardSetState(SCE_FS_DEFAULT); } else { sc.ChangeState(SCE_FS_DISABLEDCODE); } } else { sc.ChangeState(SCE_FS_DISABLEDCODE); } } break; case SCE_FS_DATE: if (sc.ch == '}') { sc.ForwardSetState(SCE_FS_DEFAULT); } else if (sc.atLineEnd) { sc.ChangeState(SCE_FS_STRINGEOL); } } // Determine if a new state should be entered. if (sc.state == SCE_FS_DEFAULT || sc.state == SCE_FS_DEFAULT_C) { if (bEnableCode && (sc.MatchIgnoreCase(".and.") || sc.MatchIgnoreCase(".not."))) { sc.SetState(SCE_FS_WORDOPERATOR); sc.Forward(4); } else if (bEnableCode && sc.MatchIgnoreCase(".or.")) { sc.SetState(SCE_FS_WORDOPERATOR); sc.Forward(3); } else if (bEnableCode && (sc.MatchIgnoreCase(".t.") || sc.MatchIgnoreCase(".f.") || (!IsAWordChar(sc.GetRelative(3)) && sc.MatchIgnoreCase("nil")))) { sc.SetState(SCE_FS_CONSTANT); sc.Forward(2); } else if (sc.Match('/', '*')) { sc.SetState(bEnableCode ? SCE_FS_COMMENTDOC : SCE_FS_COMMENTDOC_C); sc.Forward(); } else if (bEnableCode && sc.Match('&', '&')) { sc.SetState(SCE_FS_COMMENTLINE); sc.Forward(); } else if (sc.Match('/', '/')) { sc.SetState(bEnableCode ? SCE_FS_COMMENTLINEDOC : SCE_FS_COMMENTLINEDOC_C); sc.Forward(); } else if (bEnableCode && sc.ch == '*' && visibleChars == 0) { sc.SetState(SCE_FS_COMMENT); } else if (sc.ch == '\"' || sc.ch == '\'') { sc.SetState(bEnableCode ? SCE_FS_STRING : SCE_FS_STRING_C); closeStringChar = sc.ch; } else if (closeStringChar == '>' && sc.ch == '<') { sc.SetState(bEnableCode ? SCE_FS_STRING : SCE_FS_STRING_C); } else if (sc.ch == '#' && visibleChars == 0) { sc.SetState(bEnableCode ? SCE_FS_PREPROCESSOR : SCE_FS_PREPROCESSOR_C); do { // Skip whitespace between # and preprocessor word sc.Forward(); } while (IsASpaceOrTab(sc.ch) && sc.More()); if (sc.atLineEnd) { sc.SetState(bEnableCode ? SCE_FS_DEFAULT : SCE_FS_DEFAULT_C); } else if (sc.MatchIgnoreCase("include")) { if (stylingWithinPreprocessor) { closeStringChar = '>'; } } else if (sc.MatchIgnoreCase("pragma")) { sc.Forward(6); do { // Skip more whitespace until keyword sc.Forward(); } while (IsASpaceOrTab(sc.ch) && sc.More()); if (sc.MatchIgnoreCase("begindump") || sc.MatchIgnoreCase("__cstream")) { bEnableCode = false; if (stylingWithinPreprocessor) { sc.SetState(SCE_FS_DISABLEDCODE); sc.Forward(8); sc.ForwardSetState(SCE_FS_DEFAULT_C); } else { sc.SetState(SCE_FS_DISABLEDCODE); } } else if (sc.MatchIgnoreCase("enddump") || sc.MatchIgnoreCase("__endtext")) { bEnableCode = true; sc.SetState(SCE_FS_DISABLEDCODE); sc.Forward(sc.ch == '_' ? 8 : 6); sc.ForwardSetState(SCE_FS_DEFAULT); } } } else if (bEnableCode && sc.ch == '{') { Sci_Position p = 0; int chSeek; Sci_PositionU endPos(startPos + length); do { // Skip whitespace chSeek = sc.GetRelative(++p); } while (IsASpaceOrTab(chSeek) && (sc.currentPos + p < endPos)); if (chSeek == '^') { sc.SetState(SCE_FS_DATE); } else { sc.SetState(SCE_FS_OPERATOR); } } else if (IsADigit(sc.ch) || (sc.ch == '.' && IsADigit(sc.chNext))) { sc.SetState(bEnableCode ? SCE_FS_NUMBER : SCE_FS_NUMBER_C); } else if (IsAWordChar(sc.ch)) { sc.SetState(bEnableCode ? SCE_FS_IDENTIFIER : SCE_FS_IDENTIFIER_C); } else if (isoperator(static_cast(sc.ch)) || (bEnableCode && sc.ch == '@')) { sc.SetState(bEnableCode ? SCE_FS_OPERATOR : SCE_FS_OPERATOR_C); } } if (sc.atLineEnd) { visibleChars = 0; closeStringChar = 0; } if (!IsASpace(sc.ch)) { visibleChars++; } } sc.Complete(); } static void FoldFlagShipDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { Sci_Position endPos = startPos + length; // Backtrack to previous line in case need to fix its fold status Sci_Position lineCurrent = styler.GetLine(startPos); if (startPos > 0 && lineCurrent > 0) { lineCurrent--; startPos = styler.LineStart(lineCurrent); } int spaceFlags = 0; int indentCurrent = styler.IndentAmount(lineCurrent, &spaceFlags); char chNext = styler[startPos]; for (Sci_Position i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); if ((ch == '\r' && chNext != '\n') || (ch == '\n') || (i == endPos-1)) { int lev = indentCurrent; int indentNext = styler.IndentAmount(lineCurrent + 1, &spaceFlags); if (!(indentCurrent & SC_FOLDLEVELWHITEFLAG)) { if ((indentCurrent & SC_FOLDLEVELNUMBERMASK) < (indentNext & SC_FOLDLEVELNUMBERMASK)) { lev |= SC_FOLDLEVELHEADERFLAG; } else if (indentNext & SC_FOLDLEVELWHITEFLAG) { int spaceFlags2 = 0; int indentNext2 = styler.IndentAmount(lineCurrent + 2, &spaceFlags2); if ((indentCurrent & SC_FOLDLEVELNUMBERMASK) < (indentNext2 & SC_FOLDLEVELNUMBERMASK)) { lev |= SC_FOLDLEVELHEADERFLAG; } } } indentCurrent = indentNext; styler.SetLevel(lineCurrent, lev); lineCurrent++; } } } static const char * const FSWordListDesc[] = { "Keywords Commands", "Std Library Functions", "Procedure, return, exit", "Class (oop)", "Doxygen keywords", 0 }; LexerModule lmFlagShip(SCLEX_FLAGSHIP, ColouriseFlagShipDoc, "flagship", FoldFlagShipDoc, FSWordListDesc); lexilla/lexers/LexCIL.cxx0000664000175000017500000002762114647367374014315 0ustar neilneil// Scintilla source code edit control /** @file LexCIL.cxx ** Lexer for Common Intermediate Language ** Written by Jad Altahan (github.com/xv) ** CIL manual: https://www.ecma-international.org/publications/standards/Ecma-335.htm **/ // Copyright 1998-2001 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "StringCopy.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" #include "OptionSet.h" #include "DefaultLexer.h" using namespace Scintilla; using namespace Lexilla; namespace { // Use an unnamed namespace to protect the functions and classes from name conflicts bool IsAWordChar(const int ch) { return (ch < 0x80) && (isalnum(ch) || ch == '_' || ch == '.'); } bool IsOperator(const int ch) { if ((ch < 0x80) && (isalnum(ch))) return false; if (strchr("!%&*+-/<=>@^|~()[]{}", ch)) { return true; } return false; } constexpr bool IsStreamCommentStyle(const int style) noexcept { return style == SCE_CIL_COMMENT; } struct OptionsCIL { bool fold; bool foldComment; bool foldCommentMultiline; bool foldCompact; OptionsCIL() { fold = true; foldComment = false; foldCommentMultiline = true; foldCompact = true; } }; static const char *const cilWordListDesc[] = { "Primary CIL keywords", "Metadata", "Opcode instructions", 0 }; struct OptionSetCIL : public OptionSet { OptionSetCIL() { DefineProperty("fold", &OptionsCIL::fold); DefineProperty("fold.comment", &OptionsCIL::foldComment); DefineProperty("fold.cil.comment.multiline", &OptionsCIL::foldCommentMultiline, "Set this property to 0 to disable folding multi-line comments when fold.comment=1."); DefineProperty("fold.compact", &OptionsCIL::foldCompact); DefineWordListSets(cilWordListDesc); } }; LexicalClass lexicalClasses[] = { // Lexer CIL SCLEX_CIL SCE_CIL_: 0, "SCE_CIL_DEFAULT", "default", "White space", 1, "SCE_CIL_COMMENT", "comment", "Multi-line comment", 2, "SCE_CIL_COMMENTLINE", "comment line", "Line comment", 3, "SCE_CIL_WORD", "keyword", "Keyword 1", 4, "SCE_CIL_WORD2", "keyword", "Keyword 2", 5, "SCE_CIL_WORD3", "keyword", "Keyword 3", 6, "SCE_CIL_STRING", "literal string", "Double quoted string", 7, "SCE_CIL_LABEL", "label", "Code label", 8, "SCE_CIL_OPERATOR", "operator", "Operators", 9, "SCE_CIL_STRINGEOL", "error literal string", "String is not closed", 10, "SCE_CIL_IDENTIFIER", "identifier", "Identifiers", }; } class LexerCIL : public DefaultLexer { WordList keywords, keywords2, keywords3; OptionsCIL options; OptionSetCIL osCIL; public: LexerCIL() : DefaultLexer("cil", SCLEX_CIL, lexicalClasses, ELEMENTS(lexicalClasses)) { } virtual ~LexerCIL() { } void SCI_METHOD Release() override { delete this; } int SCI_METHOD Version() const override { return lvRelease5; } const char * SCI_METHOD PropertyNames() override { return osCIL.PropertyNames(); } int SCI_METHOD PropertyType(const char *name) override { return osCIL.PropertyType(name); } const char * SCI_METHOD DescribeProperty(const char *name) override { return osCIL.DescribeProperty(name); } Sci_Position SCI_METHOD PropertySet(const char *key, const char *val) override; const char * SCI_METHOD PropertyGet(const char* key) override { return osCIL.PropertyGet(key); } const char * SCI_METHOD DescribeWordListSets() override { return osCIL.DescribeWordListSets(); } Sci_Position SCI_METHOD WordListSet(int n, const char *wl) override; void SCI_METHOD Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void SCI_METHOD Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void * SCI_METHOD PrivateCall(int, void *) override { return 0; } int SCI_METHOD LineEndTypesSupported() override { return SC_LINE_END_TYPE_UNICODE; } int SCI_METHOD PrimaryStyleFromStyle(int style) override { return style; } static ILexer5 *LexerFactoryCIL() { return new LexerCIL(); } }; Sci_Position SCI_METHOD LexerCIL::PropertySet(const char *key, const char *val) { if (osCIL.PropertySet(&options, key, val)) { return 0; } return -1; } Sci_Position SCI_METHOD LexerCIL::WordListSet(int n, const char *wl) { WordList *wordListN = 0; switch (n) { case 0: wordListN = &keywords; break; case 1: wordListN = &keywords2; break; case 2: wordListN = &keywords3; break; } Sci_Position firstModification = -1; if (wordListN) { WordList wlNew; wlNew.Set(wl); if (*wordListN != wlNew) { wordListN->Set(wl); firstModification = 0; } } return firstModification; } void SCI_METHOD LexerCIL::Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { if (initStyle == SCE_CIL_STRINGEOL) { initStyle = SCE_CIL_DEFAULT; } Accessor styler(pAccess, NULL); StyleContext sc(startPos, length, initStyle, styler); bool identAtLineStart = false, // Checks if an identifier is at line start (ignoring spaces) canStyleLabels = false; // Checks if conditions are met to style SCE_CIL_LABEL for (; sc.More(); sc.Forward()) { if (sc.atLineStart) { if (sc.state == SCE_CIL_STRING) { sc.SetState(SCE_CIL_STRING); } identAtLineStart = true; } // Handle string line continuation if (sc.ch == '\\' && (sc.chNext == '\n' || sc.chNext == '\r') && (sc.state == SCE_CIL_STRING)) { sc.Forward(); if (sc.ch == '\r' && sc.chNext == '\n') { sc.Forward(); } continue; } switch (sc.state) { case SCE_CIL_OPERATOR: sc.SetState(SCE_CIL_DEFAULT); break; case SCE_CIL_IDENTIFIER: if (!IsAWordChar(sc.ch)) { if (canStyleLabels && (sc.ch == ':' && sc.chNext != ':')) { sc.ChangeState(SCE_CIL_LABEL); sc.ForwardSetState(SCE_CIL_DEFAULT); } else { char kwSize[100]; sc.GetCurrent(kwSize, sizeof(kwSize)); int style = SCE_CIL_IDENTIFIER; if (keywords.InList(kwSize)) { style = SCE_CIL_WORD; } else if (keywords2.InList(kwSize)) { style = SCE_CIL_WORD2; } else if (keywords3.InList(kwSize)) { style = SCE_CIL_WORD3; } sc.ChangeState(style); sc.SetState(SCE_CIL_DEFAULT); } } break; case SCE_CIL_COMMENT: if (sc.Match('*', '/')) { sc.Forward(); sc.ForwardSetState(SCE_CIL_DEFAULT); } break; case SCE_CIL_COMMENTLINE: if (sc.atLineStart) { sc.SetState(SCE_CIL_DEFAULT); } break; case SCE_CIL_STRING: if (sc.ch == '\\') { if (sc.chNext == '"' || sc.chNext == '\\') { sc.Forward(); } } else if (sc.ch == '"') { sc.ForwardSetState(SCE_CIL_DEFAULT); } else if (sc.atLineEnd) { sc.ChangeState(SCE_CIL_STRINGEOL); sc.ForwardSetState(SCE_CIL_DEFAULT); } break; } if (sc.state == SCE_CIL_DEFAULT) { // String if (sc.ch == '"') { sc.SetState(SCE_CIL_STRING); } // Keyword else if (IsAWordChar(sc.ch)) { // Allow setting SCE_CIL_LABEL style only if the label is the // first token in the line and does not start with a dot or a digit canStyleLabels = identAtLineStart && !(sc.ch == '.' || IsADigit(sc.ch)); sc.SetState(SCE_CIL_IDENTIFIER); } // Multi-line comment else if (sc.Match('/', '*')) { sc.SetState(SCE_CIL_COMMENT); sc.Forward(); } // Line comment else if (sc.Match('/', '/')) { sc.SetState(SCE_CIL_COMMENTLINE); } // Operators else if (IsOperator(sc.ch)) { sc.SetState(SCE_CIL_OPERATOR); } } if (!IsASpace(sc.ch)) { identAtLineStart = false; } } sc.Complete(); } void SCI_METHOD LexerCIL::Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { if (!options.fold) { return; } LexAccessor styler(pAccess); const Sci_PositionU endPos = startPos + length; Sci_Position lineCurrent = styler.GetLine(startPos); int levelCurrent = SC_FOLDLEVELBASE; if (lineCurrent > 0) levelCurrent = styler.LevelAt(lineCurrent - 1) >> 16; int style = initStyle; int styleNext = styler.StyleAt(startPos); int levelNext = levelCurrent; int visibleChars = 0; char chNext = styler[startPos]; for (Sci_PositionU i = startPos; i < endPos; i++) { const char ch = chNext; int stylePrev = style; chNext = styler.SafeGetCharAt(i + 1); style = styleNext; styleNext = styler.StyleAt(i + 1); const bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (options.foldComment && options.foldCommentMultiline && IsStreamCommentStyle(style)) { if (!IsStreamCommentStyle(stylePrev)) { levelNext++; } else if (!IsStreamCommentStyle(styleNext) && !atEOL) { levelNext--; } } if (style == SCE_CIL_OPERATOR) { if (ch == '{') { levelNext++; } else if (ch == '}') { levelNext--; } } if (!IsASpace(ch)) { visibleChars++; } if (atEOL || (i == endPos - 1)) { int lev = levelCurrent | levelNext << 16; if (visibleChars == 0 && options.foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if (levelCurrent < levelNext) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelCurrent = levelNext; if (options.foldCompact && i == static_cast(styler.Length() - 1)) { styler.SetLevel(lineCurrent, lev | SC_FOLDLEVELWHITEFLAG); } visibleChars = 0; } } } LexerModule lmCIL(SCLEX_CIL, LexerCIL::LexerFactoryCIL, "cil", cilWordListDesc);lexilla/lexers/LexHex.cxx0000664000175000017500000007061014647367374014426 0ustar neilneil// Scintilla source code edit control /** @file LexHex.cxx ** Lexers for Motorola S-Record, Intel HEX and Tektronix extended HEX. ** ** Written by Markus Heidelberg **/ // Copyright 1998-2001 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. /* * Motorola S-Record * =============================== * * Each record (line) is built as follows: * * field digits states * * +----------+ * | start | 1 ('S') SCE_HEX_RECSTART * +----------+ * | type | 1 SCE_HEX_RECTYPE, (SCE_HEX_RECTYPE_UNKNOWN) * +----------+ * | count | 2 SCE_HEX_BYTECOUNT, SCE_HEX_BYTECOUNT_WRONG * +----------+ * | address | 4/6/8 SCE_HEX_NOADDRESS, SCE_HEX_DATAADDRESS, SCE_HEX_RECCOUNT, SCE_HEX_STARTADDRESS, (SCE_HEX_ADDRESSFIELD_UNKNOWN) * +----------+ * | data | 0..504/502/500 SCE_HEX_DATA_ODD, SCE_HEX_DATA_EVEN, SCE_HEX_DATA_EMPTY, (SCE_HEX_DATA_UNKNOWN) * +----------+ * | checksum | 2 SCE_HEX_CHECKSUM, SCE_HEX_CHECKSUM_WRONG * +----------+ * * * Intel HEX * =============================== * * Each record (line) is built as follows: * * field digits states * * +----------+ * | start | 1 (':') SCE_HEX_RECSTART * +----------+ * | count | 2 SCE_HEX_BYTECOUNT, SCE_HEX_BYTECOUNT_WRONG * +----------+ * | address | 4 SCE_HEX_NOADDRESS, SCE_HEX_DATAADDRESS, (SCE_HEX_ADDRESSFIELD_UNKNOWN) * +----------+ * | type | 2 SCE_HEX_RECTYPE, (SCE_HEX_RECTYPE_UNKNOWN) * +----------+ * | data | 0..510 SCE_HEX_DATA_ODD, SCE_HEX_DATA_EVEN, SCE_HEX_DATA_EMPTY, SCE_HEX_EXTENDEDADDRESS, SCE_HEX_STARTADDRESS, (SCE_HEX_DATA_UNKNOWN) * +----------+ * | checksum | 2 SCE_HEX_CHECKSUM, SCE_HEX_CHECKSUM_WRONG * +----------+ * * * Folding: * * Data records (type 0x00), which follow an extended address record (type * 0x02 or 0x04), can be folded. The extended address record is the fold * point at fold level 0, the corresponding data records are set to level 1. * * Any record, which is not a data record, sets the fold level back to 0. * Any line, which is not a record (blank lines and lines starting with a * character other than ':'), leaves the fold level unchanged. * * * Tektronix extended HEX * =============================== * * Each record (line) is built as follows: * * field digits states * * +----------+ * | start | 1 ('%') SCE_HEX_RECSTART * +----------+ * | length | 2 SCE_HEX_BYTECOUNT, SCE_HEX_BYTECOUNT_WRONG * +----------+ * | type | 1 SCE_HEX_RECTYPE, (SCE_HEX_RECTYPE_UNKNOWN) * +----------+ * | checksum | 2 SCE_HEX_CHECKSUM, SCE_HEX_CHECKSUM_WRONG * +----------+ * | address | 9 SCE_HEX_DATAADDRESS, SCE_HEX_STARTADDRESS, (SCE_HEX_ADDRESSFIELD_UNKNOWN) * +----------+ * | data | 0..241 SCE_HEX_DATA_ODD, SCE_HEX_DATA_EVEN * +----------+ * * * General notes for all lexers * =============================== * * - Depending on where the helper functions are invoked, some of them have to * read beyond the current position. In case of malformed data (record too * short), it has to be ensured that this either does not have bad influence * or will be captured deliberately. * * - States in parentheses in the upper format descriptions indicate that they * should not appear in a valid hex file. * * - State SCE_HEX_GARBAGE means garbage data after the intended end of the * record, the line is too long then. This state is used in all lexers. */ #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; // prototypes for general helper functions static inline bool IsNewline(const int ch); static int GetHexaNibble(char hd); static int GetHexaChar(char hd1, char hd2); static int GetHexaChar(Sci_PositionU pos, Accessor &styler); static bool ForwardWithinLine(StyleContext &sc, Sci_Position nb = 1); static bool PosInSameRecord(Sci_PositionU pos1, Sci_PositionU pos2, Accessor &styler); static Sci_Position CountByteCount(Sci_PositionU startPos, Sci_Position uncountedDigits, Accessor &styler); static int CalcChecksum(Sci_PositionU startPos, Sci_Position cnt, bool twosCompl, Accessor &styler); // prototypes for file format specific helper functions static Sci_PositionU GetSrecRecStartPosition(Sci_PositionU pos, Accessor &styler); static int GetSrecByteCount(Sci_PositionU recStartPos, Accessor &styler); static Sci_Position CountSrecByteCount(Sci_PositionU recStartPos, Accessor &styler); static int GetSrecAddressFieldSize(Sci_PositionU recStartPos, Accessor &styler); static int GetSrecAddressFieldType(Sci_PositionU recStartPos, Accessor &styler); static int GetSrecDataFieldType(Sci_PositionU recStartPos, Accessor &styler); static Sci_Position GetSrecRequiredDataFieldSize(Sci_PositionU recStartPos, Accessor &styler); static int GetSrecChecksum(Sci_PositionU recStartPos, Accessor &styler); static int CalcSrecChecksum(Sci_PositionU recStartPos, Accessor &styler); static Sci_PositionU GetIHexRecStartPosition(Sci_PositionU pos, Accessor &styler); static int GetIHexByteCount(Sci_PositionU recStartPos, Accessor &styler); static Sci_Position CountIHexByteCount(Sci_PositionU recStartPos, Accessor &styler); static int GetIHexAddressFieldType(Sci_PositionU recStartPos, Accessor &styler); static int GetIHexDataFieldType(Sci_PositionU recStartPos, Accessor &styler); static int GetIHexRequiredDataFieldSize(Sci_PositionU recStartPos, Accessor &styler); static int GetIHexChecksum(Sci_PositionU recStartPos, Accessor &styler); static int CalcIHexChecksum(Sci_PositionU recStartPos, Accessor &styler); static int GetTEHexDigitCount(Sci_PositionU recStartPos, Accessor &styler); static Sci_Position CountTEHexDigitCount(Sci_PositionU recStartPos, Accessor &styler); static int GetTEHexAddressFieldType(Sci_PositionU recStartPos, Accessor &styler); static int GetTEHexChecksum(Sci_PositionU recStartPos, Accessor &styler); static int CalcTEHexChecksum(Sci_PositionU recStartPos, Accessor &styler); static inline bool IsNewline(const int ch) { return (ch == '\n' || ch == '\r'); } static int GetHexaNibble(char hd) { int hexValue = 0; if (hd >= '0' && hd <= '9') { hexValue += hd - '0'; } else if (hd >= 'A' && hd <= 'F') { hexValue += hd - 'A' + 10; } else if (hd >= 'a' && hd <= 'f') { hexValue += hd - 'a' + 10; } else { return -1; } return hexValue; } static int GetHexaChar(char hd1, char hd2) { int hexValue = 0; if (hd1 >= '0' && hd1 <= '9') { hexValue += 16 * (hd1 - '0'); } else if (hd1 >= 'A' && hd1 <= 'F') { hexValue += 16 * (hd1 - 'A' + 10); } else if (hd1 >= 'a' && hd1 <= 'f') { hexValue += 16 * (hd1 - 'a' + 10); } else { return -1; } if (hd2 >= '0' && hd2 <= '9') { hexValue += hd2 - '0'; } else if (hd2 >= 'A' && hd2 <= 'F') { hexValue += hd2 - 'A' + 10; } else if (hd2 >= 'a' && hd2 <= 'f') { hexValue += hd2 - 'a' + 10; } else { return -1; } return hexValue; } static int GetHexaChar(Sci_PositionU pos, Accessor &styler) { char highNibble, lowNibble; highNibble = styler.SafeGetCharAt(pos); lowNibble = styler.SafeGetCharAt(pos + 1); return GetHexaChar(highNibble, lowNibble); } // Forward characters, but abort (and return false) if hitting the line // end. Return true if forwarding within the line was possible. // Avoids influence on highlighting of the subsequent line if the current line // is malformed (too short). static bool ForwardWithinLine(StyleContext &sc, Sci_Position nb) { for (Sci_Position i = 0; i < nb; i++) { if (sc.atLineEnd) { // line is too short sc.SetState(SCE_HEX_DEFAULT); sc.Forward(); return false; } else { sc.Forward(); } } return true; } // Checks whether the given positions are in the same record. static bool PosInSameRecord(Sci_PositionU pos1, Sci_PositionU pos2, Accessor &styler) { return styler.GetLine(pos1) == styler.GetLine(pos2); } // Count the number of digit pairs from till end of record, ignoring // digits. // If the record is too short, a negative count may be returned. static Sci_Position CountByteCount(Sci_PositionU startPos, Sci_Position uncountedDigits, Accessor &styler) { Sci_Position cnt; Sci_PositionU pos; pos = startPos; while (!IsNewline(styler.SafeGetCharAt(pos, '\n'))) { pos++; } // number of digits in this line minus number of digits of uncounted fields cnt = static_cast(pos - startPos) - uncountedDigits; // Prepare round up if odd (digit pair incomplete), this way the byte // count is considered to be valid if the checksum is incomplete. if (cnt >= 0) { cnt++; } // digit pairs cnt /= 2; return cnt; } // Calculate the checksum of the record. // is the position of the first character of the starting digit // pair, is the number of digit pairs. static int CalcChecksum(Sci_PositionU startPos, Sci_Position cnt, bool twosCompl, Accessor &styler) { int cs = 0; for (Sci_PositionU pos = startPos; pos < startPos + cnt; pos += 2) { int val = GetHexaChar(pos, styler); if (val < 0) { return val; } // overflow does not matter cs += val; } if (twosCompl) { // low byte of two's complement return -cs & 0xFF; } else { // low byte of one's complement return ~cs & 0xFF; } } // Get the position of the record "start" field (first character in line) in // the record around position . static Sci_PositionU GetSrecRecStartPosition(Sci_PositionU pos, Accessor &styler) { while (styler.SafeGetCharAt(pos) != 'S') { pos--; } return pos; } // Get the value of the "byte count" field, it counts the number of bytes in // the subsequent fields ("address", "data" and "checksum" fields). static int GetSrecByteCount(Sci_PositionU recStartPos, Accessor &styler) { int val; val = GetHexaChar(recStartPos + 2, styler); if (val < 0) { val = 0; } return val; } // Count the number of digit pairs for the "address", "data" and "checksum" // fields in this record. Has to be equal to the "byte count" field value. // If the record is too short, a negative count may be returned. static Sci_Position CountSrecByteCount(Sci_PositionU recStartPos, Accessor &styler) { return CountByteCount(recStartPos, 4, styler); } // Get the size of the "address" field. static int GetSrecAddressFieldSize(Sci_PositionU recStartPos, Accessor &styler) { switch (styler.SafeGetCharAt(recStartPos + 1)) { case '0': case '1': case '5': case '9': return 2; // 16 bit case '2': case '6': case '8': return 3; // 24 bit case '3': case '7': return 4; // 32 bit default: return 0; } } // Get the type of the "address" field content. static int GetSrecAddressFieldType(Sci_PositionU recStartPos, Accessor &styler) { switch (styler.SafeGetCharAt(recStartPos + 1)) { case '0': return SCE_HEX_NOADDRESS; case '1': case '2': case '3': return SCE_HEX_DATAADDRESS; case '5': case '6': return SCE_HEX_RECCOUNT; case '7': case '8': case '9': return SCE_HEX_STARTADDRESS; default: // handle possible format extension in the future return SCE_HEX_ADDRESSFIELD_UNKNOWN; } } // Get the type of the "data" field content. static int GetSrecDataFieldType(Sci_PositionU recStartPos, Accessor &styler) { switch (styler.SafeGetCharAt(recStartPos + 1)) { case '0': case '1': case '2': case '3': return SCE_HEX_DATA_ODD; case '5': case '6': case '7': case '8': case '9': return SCE_HEX_DATA_EMPTY; default: // handle possible format extension in the future return SCE_HEX_DATA_UNKNOWN; } } // Get the required size of the "data" field. Useless for block header and // ordinary data records (type S0, S1, S2, S3), return the value calculated // from the "byte count" and "address field" size in this case. static Sci_Position GetSrecRequiredDataFieldSize(Sci_PositionU recStartPos, Accessor &styler) { switch (styler.SafeGetCharAt(recStartPos + 1)) { case '5': case '6': case '7': case '8': case '9': return 0; default: return GetSrecByteCount(recStartPos, styler) - GetSrecAddressFieldSize(recStartPos, styler) - 1; // -1 for checksum field } } // Get the value of the "checksum" field. static int GetSrecChecksum(Sci_PositionU recStartPos, Accessor &styler) { int byteCount; byteCount = GetSrecByteCount(recStartPos, styler); return GetHexaChar(recStartPos + 2 + byteCount * 2, styler); } // Calculate the checksum of the record. static int CalcSrecChecksum(Sci_PositionU recStartPos, Accessor &styler) { Sci_Position byteCount; byteCount = GetSrecByteCount(recStartPos, styler); // sum over "byte count", "address" and "data" fields (6..510 digits) return CalcChecksum(recStartPos + 2, byteCount * 2, false, styler); } // Get the position of the record "start" field (first character in line) in // the record around position . static Sci_PositionU GetIHexRecStartPosition(Sci_PositionU pos, Accessor &styler) { while (styler.SafeGetCharAt(pos) != ':') { pos--; } return pos; } // Get the value of the "byte count" field, it counts the number of bytes in // the "data" field. static int GetIHexByteCount(Sci_PositionU recStartPos, Accessor &styler) { int val; val = GetHexaChar(recStartPos + 1, styler); if (val < 0) { val = 0; } return val; } // Count the number of digit pairs for the "data" field in this record. Has to // be equal to the "byte count" field value. // If the record is too short, a negative count may be returned. static Sci_Position CountIHexByteCount(Sci_PositionU recStartPos, Accessor &styler) { return CountByteCount(recStartPos, 11, styler); } // Get the type of the "address" field content. static int GetIHexAddressFieldType(Sci_PositionU recStartPos, Accessor &styler) { if (!PosInSameRecord(recStartPos, recStartPos + 7, styler)) { // malformed (record too short) // type cannot be determined return SCE_HEX_ADDRESSFIELD_UNKNOWN; } switch (GetHexaChar(recStartPos + 7, styler)) { case 0x00: return SCE_HEX_DATAADDRESS; case 0x01: case 0x02: case 0x03: case 0x04: case 0x05: return SCE_HEX_NOADDRESS; default: // handle possible format extension in the future return SCE_HEX_ADDRESSFIELD_UNKNOWN; } } // Get the type of the "data" field content. static int GetIHexDataFieldType(Sci_PositionU recStartPos, Accessor &styler) { switch (GetHexaChar(recStartPos + 7, styler)) { case 0x00: return SCE_HEX_DATA_ODD; case 0x01: return SCE_HEX_DATA_EMPTY; case 0x02: case 0x04: return SCE_HEX_EXTENDEDADDRESS; case 0x03: case 0x05: return SCE_HEX_STARTADDRESS; default: // handle possible format extension in the future return SCE_HEX_DATA_UNKNOWN; } } // Get the required size of the "data" field. Useless for an ordinary data // record (type 00), return the "byte count" in this case. static int GetIHexRequiredDataFieldSize(Sci_PositionU recStartPos, Accessor &styler) { switch (GetHexaChar(recStartPos + 7, styler)) { case 0x01: return 0; case 0x02: case 0x04: return 2; case 0x03: case 0x05: return 4; default: return GetIHexByteCount(recStartPos, styler); } } // Get the value of the "checksum" field. static int GetIHexChecksum(Sci_PositionU recStartPos, Accessor &styler) { int byteCount; byteCount = GetIHexByteCount(recStartPos, styler); return GetHexaChar(recStartPos + 9 + byteCount * 2, styler); } // Calculate the checksum of the record. static int CalcIHexChecksum(Sci_PositionU recStartPos, Accessor &styler) { int byteCount; byteCount = GetIHexByteCount(recStartPos, styler); // sum over "byte count", "address", "type" and "data" fields (8..518 digits) return CalcChecksum(recStartPos + 1, 8 + byteCount * 2, true, styler); } // Get the value of the "record length" field, it counts the number of digits in // the record excluding the percent. static int GetTEHexDigitCount(Sci_PositionU recStartPos, Accessor &styler) { int val = GetHexaChar(recStartPos + 1, styler); if (val < 0) val = 0; return val; } // Count the number of digits in this record. Has to // be equal to the "record length" field value. static Sci_Position CountTEHexDigitCount(Sci_PositionU recStartPos, Accessor &styler) { Sci_PositionU pos; pos = recStartPos+1; while (!IsNewline(styler.SafeGetCharAt(pos, '\n'))) { pos++; } return static_cast(pos - (recStartPos+1)); } // Get the type of the "address" field content. static int GetTEHexAddressFieldType(Sci_PositionU recStartPos, Accessor &styler) { switch (styler.SafeGetCharAt(recStartPos + 3)) { case '6': return SCE_HEX_DATAADDRESS; case '8': return SCE_HEX_STARTADDRESS; default: // handle possible format extension in the future return SCE_HEX_ADDRESSFIELD_UNKNOWN; } } // Get the value of the "checksum" field. static int GetTEHexChecksum(Sci_PositionU recStartPos, Accessor &styler) { return GetHexaChar(recStartPos+4, styler); } // Calculate the checksum of the record (excluding the checksum field). static int CalcTEHexChecksum(Sci_PositionU recStartPos, Accessor &styler) { Sci_PositionU pos = recStartPos +1; Sci_PositionU length = GetTEHexDigitCount(recStartPos, styler); int cs = GetHexaNibble(styler.SafeGetCharAt(pos++));//length cs += GetHexaNibble(styler.SafeGetCharAt(pos++));//length cs += GetHexaNibble(styler.SafeGetCharAt(pos++));//type pos += 2;// jump over CS field for (; pos <= recStartPos + length; ++pos) { int val = GetHexaNibble(styler.SafeGetCharAt(pos)); if (val < 0) { return val; } // overflow does not matter cs += val; } // low byte return cs & 0xFF; } static void ColouriseSrecDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *[], Accessor &styler) { StyleContext sc(startPos, length, initStyle, styler); while (sc.More()) { Sci_PositionU recStartPos; Sci_Position reqByteCount; Sci_Position dataFieldSize; int byteCount, addrFieldSize, addrFieldType, dataFieldType; int cs1, cs2; switch (sc.state) { case SCE_HEX_DEFAULT: if (sc.atLineStart && sc.Match('S')) { sc.SetState(SCE_HEX_RECSTART); } ForwardWithinLine(sc); break; case SCE_HEX_RECSTART: recStartPos = sc.currentPos - 1; addrFieldType = GetSrecAddressFieldType(recStartPos, styler); if (addrFieldType == SCE_HEX_ADDRESSFIELD_UNKNOWN) { sc.SetState(SCE_HEX_RECTYPE_UNKNOWN); } else { sc.SetState(SCE_HEX_RECTYPE); } ForwardWithinLine(sc); break; case SCE_HEX_RECTYPE: case SCE_HEX_RECTYPE_UNKNOWN: recStartPos = sc.currentPos - 2; byteCount = GetSrecByteCount(recStartPos, styler); reqByteCount = GetSrecAddressFieldSize(recStartPos, styler) + GetSrecRequiredDataFieldSize(recStartPos, styler) + 1; // +1 for checksum field if (byteCount == CountSrecByteCount(recStartPos, styler) && byteCount == reqByteCount) { sc.SetState(SCE_HEX_BYTECOUNT); } else { sc.SetState(SCE_HEX_BYTECOUNT_WRONG); } ForwardWithinLine(sc, 2); break; case SCE_HEX_BYTECOUNT: case SCE_HEX_BYTECOUNT_WRONG: recStartPos = sc.currentPos - 4; addrFieldSize = GetSrecAddressFieldSize(recStartPos, styler); addrFieldType = GetSrecAddressFieldType(recStartPos, styler); sc.SetState(addrFieldType); ForwardWithinLine(sc, addrFieldSize * 2); break; case SCE_HEX_NOADDRESS: case SCE_HEX_DATAADDRESS: case SCE_HEX_RECCOUNT: case SCE_HEX_STARTADDRESS: case SCE_HEX_ADDRESSFIELD_UNKNOWN: recStartPos = GetSrecRecStartPosition(sc.currentPos, styler); dataFieldType = GetSrecDataFieldType(recStartPos, styler); // Using the required size here if possible has the effect that the // checksum is highlighted at a fixed position after this field for // specific record types, independent on the "byte count" value. dataFieldSize = GetSrecRequiredDataFieldSize(recStartPos, styler); sc.SetState(dataFieldType); if (dataFieldType == SCE_HEX_DATA_ODD) { for (int i = 0; i < dataFieldSize * 2; i++) { if ((i & 0x3) == 0) { sc.SetState(SCE_HEX_DATA_ODD); } else if ((i & 0x3) == 2) { sc.SetState(SCE_HEX_DATA_EVEN); } if (!ForwardWithinLine(sc)) { break; } } } else { ForwardWithinLine(sc, dataFieldSize * 2); } break; case SCE_HEX_DATA_ODD: case SCE_HEX_DATA_EVEN: case SCE_HEX_DATA_EMPTY: case SCE_HEX_DATA_UNKNOWN: recStartPos = GetSrecRecStartPosition(sc.currentPos, styler); cs1 = CalcSrecChecksum(recStartPos, styler); cs2 = GetSrecChecksum(recStartPos, styler); if (cs1 != cs2 || cs1 < 0 || cs2 < 0) { sc.SetState(SCE_HEX_CHECKSUM_WRONG); } else { sc.SetState(SCE_HEX_CHECKSUM); } ForwardWithinLine(sc, 2); break; case SCE_HEX_CHECKSUM: case SCE_HEX_CHECKSUM_WRONG: case SCE_HEX_GARBAGE: // record finished or line too long sc.SetState(SCE_HEX_GARBAGE); ForwardWithinLine(sc); break; default: // prevent endless loop in faulty state sc.SetState(SCE_HEX_DEFAULT); break; } } sc.Complete(); } static void ColouriseIHexDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *[], Accessor &styler) { StyleContext sc(startPos, length, initStyle, styler); while (sc.More()) { Sci_PositionU recStartPos; int byteCount, addrFieldType, dataFieldSize, dataFieldType; int cs1, cs2; switch (sc.state) { case SCE_HEX_DEFAULT: if (sc.atLineStart && sc.Match(':')) { sc.SetState(SCE_HEX_RECSTART); } ForwardWithinLine(sc); break; case SCE_HEX_RECSTART: recStartPos = sc.currentPos - 1; byteCount = GetIHexByteCount(recStartPos, styler); dataFieldSize = GetIHexRequiredDataFieldSize(recStartPos, styler); if (byteCount == CountIHexByteCount(recStartPos, styler) && byteCount == dataFieldSize) { sc.SetState(SCE_HEX_BYTECOUNT); } else { sc.SetState(SCE_HEX_BYTECOUNT_WRONG); } ForwardWithinLine(sc, 2); break; case SCE_HEX_BYTECOUNT: case SCE_HEX_BYTECOUNT_WRONG: recStartPos = sc.currentPos - 3; addrFieldType = GetIHexAddressFieldType(recStartPos, styler); sc.SetState(addrFieldType); ForwardWithinLine(sc, 4); break; case SCE_HEX_NOADDRESS: case SCE_HEX_DATAADDRESS: case SCE_HEX_ADDRESSFIELD_UNKNOWN: recStartPos = sc.currentPos - 7; addrFieldType = GetIHexAddressFieldType(recStartPos, styler); if (addrFieldType == SCE_HEX_ADDRESSFIELD_UNKNOWN) { sc.SetState(SCE_HEX_RECTYPE_UNKNOWN); } else { sc.SetState(SCE_HEX_RECTYPE); } ForwardWithinLine(sc, 2); break; case SCE_HEX_RECTYPE: case SCE_HEX_RECTYPE_UNKNOWN: recStartPos = sc.currentPos - 9; dataFieldType = GetIHexDataFieldType(recStartPos, styler); // Using the required size here if possible has the effect that the // checksum is highlighted at a fixed position after this field for // specific record types, independent on the "byte count" value. dataFieldSize = GetIHexRequiredDataFieldSize(recStartPos, styler); sc.SetState(dataFieldType); if (dataFieldType == SCE_HEX_DATA_ODD) { for (int i = 0; i < dataFieldSize * 2; i++) { if ((i & 0x3) == 0) { sc.SetState(SCE_HEX_DATA_ODD); } else if ((i & 0x3) == 2) { sc.SetState(SCE_HEX_DATA_EVEN); } if (!ForwardWithinLine(sc)) { break; } } } else { ForwardWithinLine(sc, dataFieldSize * 2); } break; case SCE_HEX_DATA_ODD: case SCE_HEX_DATA_EVEN: case SCE_HEX_DATA_EMPTY: case SCE_HEX_EXTENDEDADDRESS: case SCE_HEX_STARTADDRESS: case SCE_HEX_DATA_UNKNOWN: recStartPos = GetIHexRecStartPosition(sc.currentPos, styler); cs1 = CalcIHexChecksum(recStartPos, styler); cs2 = GetIHexChecksum(recStartPos, styler); if (cs1 != cs2 || cs1 < 0 || cs2 < 0) { sc.SetState(SCE_HEX_CHECKSUM_WRONG); } else { sc.SetState(SCE_HEX_CHECKSUM); } ForwardWithinLine(sc, 2); break; case SCE_HEX_CHECKSUM: case SCE_HEX_CHECKSUM_WRONG: case SCE_HEX_GARBAGE: // record finished or line too long sc.SetState(SCE_HEX_GARBAGE); ForwardWithinLine(sc); break; default: // prevent endless loop in faulty state sc.SetState(SCE_HEX_DEFAULT); break; } } sc.Complete(); } static void FoldIHexDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { Sci_PositionU endPos = startPos + length; Sci_Position lineCurrent = styler.GetLine(startPos); int levelCurrent = SC_FOLDLEVELBASE; if (lineCurrent > 0) levelCurrent = styler.LevelAt(lineCurrent - 1); Sci_PositionU lineStartNext = styler.LineStart(lineCurrent + 1); int levelNext = SC_FOLDLEVELBASE; // default if no specific line found for (Sci_PositionU i = startPos; i < endPos; i++) { bool atEOL = i == (lineStartNext - 1); int style = styler.StyleAt(i); // search for specific lines if (style == SCE_HEX_EXTENDEDADDRESS) { // extended addres record levelNext = SC_FOLDLEVELBASE | SC_FOLDLEVELHEADERFLAG; } else if (style == SCE_HEX_DATAADDRESS || (style == SCE_HEX_DEFAULT && i == (Sci_PositionU)styler.LineStart(lineCurrent))) { // data record or no record start code at all if (levelCurrent & SC_FOLDLEVELHEADERFLAG) { levelNext = SC_FOLDLEVELBASE + 1; } else { // continue level 0 or 1, no fold point levelNext = levelCurrent; } } if (atEOL || (i == endPos - 1)) { styler.SetLevel(lineCurrent, levelNext); lineCurrent++; lineStartNext = styler.LineStart(lineCurrent + 1); levelCurrent = levelNext; levelNext = SC_FOLDLEVELBASE; } } } static void ColouriseTEHexDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *[], Accessor &styler) { StyleContext sc(startPos, length, initStyle, styler); while (sc.More()) { Sci_PositionU recStartPos; int digitCount, addrFieldType; int cs1, cs2; switch (sc.state) { case SCE_HEX_DEFAULT: if (sc.atLineStart && sc.Match('%')) { sc.SetState(SCE_HEX_RECSTART); } ForwardWithinLine(sc); break; case SCE_HEX_RECSTART: recStartPos = sc.currentPos - 1; if (GetTEHexDigitCount(recStartPos, styler) == CountTEHexDigitCount(recStartPos, styler)) { sc.SetState(SCE_HEX_BYTECOUNT); } else { sc.SetState(SCE_HEX_BYTECOUNT_WRONG); } ForwardWithinLine(sc, 2); break; case SCE_HEX_BYTECOUNT: case SCE_HEX_BYTECOUNT_WRONG: recStartPos = sc.currentPos - 3; addrFieldType = GetTEHexAddressFieldType(recStartPos, styler); if (addrFieldType == SCE_HEX_ADDRESSFIELD_UNKNOWN) { sc.SetState(SCE_HEX_RECTYPE_UNKNOWN); } else { sc.SetState(SCE_HEX_RECTYPE); } ForwardWithinLine(sc); break; case SCE_HEX_RECTYPE: case SCE_HEX_RECTYPE_UNKNOWN: recStartPos = sc.currentPos - 4; cs1 = CalcTEHexChecksum(recStartPos, styler); cs2 = GetTEHexChecksum(recStartPos, styler); if (cs1 != cs2 || cs1 < 0 || cs2 < 0) { sc.SetState(SCE_HEX_CHECKSUM_WRONG); } else { sc.SetState(SCE_HEX_CHECKSUM); } ForwardWithinLine(sc, 2); break; case SCE_HEX_CHECKSUM: case SCE_HEX_CHECKSUM_WRONG: recStartPos = sc.currentPos - 6; addrFieldType = GetTEHexAddressFieldType(recStartPos, styler); sc.SetState(addrFieldType); ForwardWithinLine(sc, 9); break; case SCE_HEX_DATAADDRESS: case SCE_HEX_STARTADDRESS: case SCE_HEX_ADDRESSFIELD_UNKNOWN: recStartPos = sc.currentPos - 15; digitCount = GetTEHexDigitCount(recStartPos, styler) - 14; sc.SetState(SCE_HEX_DATA_ODD); for (int i = 0; i < digitCount; i++) { if ((i & 0x3) == 0) { sc.SetState(SCE_HEX_DATA_ODD); } else if ((i & 0x3) == 2) { sc.SetState(SCE_HEX_DATA_EVEN); } if (!ForwardWithinLine(sc)) { break; } } break; case SCE_HEX_DATA_ODD: case SCE_HEX_DATA_EVEN: case SCE_HEX_GARBAGE: // record finished or line too long sc.SetState(SCE_HEX_GARBAGE); ForwardWithinLine(sc); break; default: // prevent endless loop in faulty state sc.SetState(SCE_HEX_DEFAULT); break; } } sc.Complete(); } LexerModule lmSrec(SCLEX_SREC, ColouriseSrecDoc, "srec", 0, NULL); LexerModule lmIHex(SCLEX_IHEX, ColouriseIHexDoc, "ihex", FoldIHexDoc, NULL); LexerModule lmTEHex(SCLEX_TEHEX, ColouriseTEHexDoc, "tehex", 0, NULL); lexilla/lexers/LexProps.cxx0000664000175000017500000001220514647367374015001 0ustar neilneil// Scintilla source code edit control /** @file LexProps.cxx ** Lexer for properties files. **/ // Copyright 1998-2001 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; namespace { bool AtEOL(Accessor &styler, Sci_PositionU i) { return (styler[i] == '\n') || ((styler[i] == '\r') && (styler.SafeGetCharAt(i + 1) != '\n')); } constexpr bool isAssignChar(char ch) noexcept { return (ch == '=') || (ch == ':'); } void ColourisePropsLine( const char *lineBuffer, Sci_PositionU lengthLine, Sci_PositionU startLine, Sci_PositionU endPos, Accessor &styler, bool allowInitialSpaces) { Sci_PositionU i = 0; if (allowInitialSpaces) { while ((i < lengthLine) && isspacechar(lineBuffer[i])) // Skip initial spaces i++; } else { if (isspacechar(lineBuffer[i])) // don't allow initial spaces i = lengthLine; } if (i < lengthLine) { if (lineBuffer[i] == '#' || lineBuffer[i] == '!' || lineBuffer[i] == ';') { styler.ColourTo(endPos, SCE_PROPS_COMMENT); } else if (lineBuffer[i] == '[') { styler.ColourTo(endPos, SCE_PROPS_SECTION); } else if (lineBuffer[i] == '@') { styler.ColourTo(startLine + i, SCE_PROPS_DEFVAL); if (isAssignChar(lineBuffer[i++])) styler.ColourTo(startLine + i, SCE_PROPS_ASSIGNMENT); styler.ColourTo(endPos, SCE_PROPS_DEFAULT); } else { // Search for the '=' character while ((i < lengthLine) && !isAssignChar(lineBuffer[i])) i++; if ((i < lengthLine) && isAssignChar(lineBuffer[i])) { styler.ColourTo(startLine + i - 1, SCE_PROPS_KEY); styler.ColourTo(startLine + i, SCE_PROPS_ASSIGNMENT); styler.ColourTo(endPos, SCE_PROPS_DEFAULT); } else { styler.ColourTo(endPos, SCE_PROPS_DEFAULT); } } } else { styler.ColourTo(endPos, SCE_PROPS_DEFAULT); } } void ColourisePropsDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { std::string lineBuffer; styler.StartAt(startPos); styler.StartSegment(startPos); Sci_PositionU startLine = startPos; // property lexer.props.allow.initial.spaces // For properties files, set to 0 to style all lines that start with whitespace in the default style. // This is not suitable for SciTE .properties files which use indentation for flow control but // can be used for RFC2822 text where indentation is used for continuation lines. const bool allowInitialSpaces = styler.GetPropertyInt("lexer.props.allow.initial.spaces", 1) != 0; for (Sci_PositionU i = startPos; i < startPos + length; i++) { lineBuffer.push_back(styler[i]); if (AtEOL(styler, i)) { // End of line (or of line buffer) met, colourise it ColourisePropsLine(lineBuffer.c_str(), lineBuffer.length(), startLine, i, styler, allowInitialSpaces); lineBuffer.clear(); startLine = i + 1; } } if (lineBuffer.length() > 0) { // Last line does not have ending characters ColourisePropsLine(lineBuffer.c_str(), lineBuffer.length(), startLine, startPos + length - 1, styler, allowInitialSpaces); } } // adaption by ksc, using the "} else {" trick of 1.53 // 030721 void FoldPropsDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { const bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; const Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); char chNext = styler[startPos]; bool headerPoint = false; int levelPrevious = (lineCurrent > 0) ? styler.LevelAt(lineCurrent - 1) : SC_FOLDLEVELBASE; for (Sci_PositionU i = startPos; i < endPos; i++) { const char ch = chNext; chNext = styler[i+1]; const int style = styler.StyleIndexAt(i); const bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (style == SCE_PROPS_SECTION) { headerPoint = true; } if (atEOL) { int lev = levelPrevious & SC_FOLDLEVELNUMBERMASK; if (headerPoint) { lev = SC_FOLDLEVELBASE | SC_FOLDLEVELHEADERFLAG; if (levelPrevious & SC_FOLDLEVELHEADERFLAG) { // previous section is empty styler.SetLevel(lineCurrent - 1, SC_FOLDLEVELBASE); } } else if (levelPrevious & SC_FOLDLEVELHEADERFLAG) { lev += 1; } if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; visibleChars = 0; headerPoint = false; levelPrevious = lev; } if (!isspacechar(ch)) visibleChars++; } int level = levelPrevious & SC_FOLDLEVELNUMBERMASK; if (levelPrevious & SC_FOLDLEVELHEADERFLAG) { level += 1; } const int flagsNext = styler.LevelAt(lineCurrent); styler.SetLevel(lineCurrent, level | (flagsNext & ~SC_FOLDLEVELNUMBERMASK)); } const char *const emptyWordListDesc[] = { nullptr }; } LexerModule lmProps(SCLEX_PROPERTIES, ColourisePropsDoc, "props", FoldPropsDoc, emptyWordListDesc); lexilla/lexers/LexR.cxx0000664000175000017500000002267014647367374014106 0ustar neilneil// Scintilla source code edit control /** @file LexR.cxx ** Lexer for R, S, SPlus Statistics Program (Heavily derived from CPP Lexer). ** **/ // Copyright 1998-2002 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; namespace { inline bool IsAWordChar(int ch) noexcept { return (ch < 0x80) && (isalnum(ch) || ch == '.' || ch == '_'); } inline bool IsAWordStart(int ch) noexcept { return (ch < 0x80) && (isalnum(ch) || ch == '_'); } constexpr bool IsAnOperator(int ch) noexcept { // '.' left out as it is used to make up numbers if (ch == '-' || ch == '+' || ch == '!' || ch == '~' || ch == '?' || ch == ':' || ch == '*' || ch == '/' || ch == '^' || ch == '<' || ch == '>' || ch == '=' || ch == '&' || ch == '|' || ch == '$' || ch == '(' || ch == ')' || ch == '}' || ch == '{' || ch == '[' || ch == ']') return true; return false; } constexpr bool IsOctalOrHex(int ch, bool hex) noexcept { return IsAnOctalDigit(ch) || (hex && IsAHeXDigit(ch)); } // https://search.r-project.org/R/refmans/base/html/Quotes.html struct EscapeSequence { int outerState = SCE_R_DEFAULT; int digitsLeft = 0; bool hex = false; bool brace = false; // highlight any character as escape sequence, unrecognized escape sequence is syntax error. void resetEscapeState(int state, int chNext) noexcept { outerState = state; digitsLeft = 1; hex = true; brace = false; if (chNext == 'x') { digitsLeft = 3; } else if (chNext == 'u') { digitsLeft = 5; } else if (chNext == 'U') { digitsLeft = 9; } else if (IsAnOctalDigit(chNext)) { digitsLeft = 3; hex = false; } } bool atEscapeEnd(int ch) noexcept { --digitsLeft; return digitsLeft <= 0 || !IsOctalOrHex(ch, hex); } }; int CheckRawString(LexAccessor &styler, Sci_Position pos, int &dashCount) { dashCount = 0; while (true) { const char ch = styler.SafeGetCharAt(pos++); switch (ch) { case '-': ++dashCount; break; case '(': return ')'; case '[': return ']'; case '{': return '}'; default: dashCount = 0; return 0; } } } void ColouriseRDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { const WordList &keywords = *keywordlists[0]; const WordList &keywords2 = *keywordlists[1]; const WordList &keywords3 = *keywordlists[2]; // state for raw string int matchingDelimiter = 0; int dashCount = 0; // property lexer.r.escape.sequence // Set to 1 to enable highlighting of escape sequences in strings. const bool escapeSequence = styler.GetPropertyInt("lexer.r.escape.sequence", 0) != 0; EscapeSequence escapeSeq; StyleContext sc(startPos, length, initStyle, styler); if (sc.currentLine > 0) { const int lineState = styler.GetLineState(sc.currentLine - 1); matchingDelimiter = lineState & 0xff; dashCount = lineState >> 8; } while (sc.More()) { // Determine if the current state should terminate. switch (sc.state) { case SCE_R_OPERATOR: sc.SetState(SCE_R_DEFAULT); break; case SCE_R_NUMBER: // https://cran.r-project.org/doc/manuals/r-release/R-lang.html#Literal-constants if (AnyOf(sc.ch, 'e', 'E', 'p', 'P') && (IsADigit(sc.chNext) || sc.chNext == '+' || sc.chNext == '-')) { sc.Forward(); // exponent part } else if (!(IsAHeXDigit(sc.ch) || (sc.ch == '.' && IsADigit(sc.chNext)))) { if (AnyOf(sc.ch, 'L', 'i')) { sc.Forward(); // integer and complex qualifier } sc.SetState(SCE_R_DEFAULT); } break; case SCE_R_IDENTIFIER: if (!IsAWordChar(sc.ch)) { char s[100]; sc.GetCurrent(s, sizeof(s)); if (keywords.InList(s)) { sc.ChangeState(SCE_R_KWORD); } else if (keywords2.InList(s)) { sc.ChangeState(SCE_R_BASEKWORD); } else if (keywords3.InList(s)) { sc.ChangeState(SCE_R_OTHERKWORD); } sc.SetState(SCE_R_DEFAULT); } break; case SCE_R_COMMENT: if (sc.MatchLineEnd()) { sc.SetState(SCE_R_DEFAULT); } break; case SCE_R_STRING: case SCE_R_STRING2: case SCE_R_BACKTICKS: if (sc.ch == '\\') { if (escapeSequence) { escapeSeq.resetEscapeState(sc.state, sc.chNext); sc.SetState(SCE_R_ESCAPESEQUENCE); sc.Forward(); if (sc.chNext == '{' && AnyOf(sc.ch, 'u', 'U')) { escapeSeq.brace = true; sc.Forward(); } else if (sc.MatchLineEnd()) { // don't highlight line ending as escape sequence: // escapeSeq.outerState is lost when editing on next line. sc.SetState(escapeSeq.outerState); } } else { sc.Forward(); // Skip all characters after the backslash } } else if ((sc.state == SCE_R_STRING && sc.ch == '\"') || (sc.state == SCE_R_STRING2 && sc.ch == '\'') || (sc.state == SCE_R_BACKTICKS && sc.ch == '`')) { sc.ForwardSetState(SCE_R_DEFAULT); } break; case SCE_R_ESCAPESEQUENCE: if (escapeSeq.atEscapeEnd(sc.ch)) { if (escapeSeq.brace && sc.ch == '}') { sc.Forward(); } sc.SetState(escapeSeq.outerState); continue; } break; case SCE_R_RAWSTRING: case SCE_R_RAWSTRING2: while (sc.ch == matchingDelimiter) { sc.Forward(); int count = dashCount; while (count != 0 && sc.ch == '-') { --count; sc.Forward(); } if (count == 0 && sc.ch == ((sc.state == SCE_R_RAWSTRING) ? '\"' : '\'')) { matchingDelimiter = 0; dashCount = 0; sc.ForwardSetState(SCE_R_DEFAULT); break; } } break; case SCE_R_INFIX: if (sc.ch == '%') { sc.ForwardSetState(SCE_R_DEFAULT); } else if (sc.atLineEnd) { sc.ChangeState(SCE_R_INFIXEOL); } break; case SCE_R_INFIXEOL: if (sc.atLineStart) { sc.SetState(SCE_R_DEFAULT); } break; } // Determine if a new state should be entered. if (sc.state == SCE_R_DEFAULT) { if (IsADigit(sc.ch) || (sc.ch == '.' && IsADigit(sc.chNext))) { sc.SetState(SCE_R_NUMBER); if (sc.ch == '0' && AnyOf(sc.chNext, 'x', 'X')) { sc.Forward(); } } else if (AnyOf(sc.ch, 'r', 'R') && AnyOf(sc.chNext, '\"', '\'')) { const int chNext = sc.chNext; matchingDelimiter = CheckRawString(styler, sc.currentPos + 2, dashCount); if (matchingDelimiter) { sc.SetState((chNext == '\"') ? SCE_R_RAWSTRING : SCE_R_RAWSTRING2); sc.Forward(dashCount + 2); } else { // syntax error sc.SetState(SCE_R_IDENTIFIER); sc.ForwardSetState((chNext == '\"') ? SCE_R_STRING : SCE_R_STRING2); } } else if (IsAWordStart(sc.ch) ) { sc.SetState(SCE_R_IDENTIFIER); } else if (sc.Match('#')) { sc.SetState(SCE_R_COMMENT); } else if (sc.ch == '\"') { sc.SetState(SCE_R_STRING); } else if (sc.ch == '%') { sc.SetState(SCE_R_INFIX); } else if (sc.ch == '\'') { sc.SetState(SCE_R_STRING2); } else if (sc.ch == '`') { sc.SetState(SCE_R_BACKTICKS); } else if (IsAnOperator(sc.ch)) { sc.SetState(SCE_R_OPERATOR); } } if (sc.atLineEnd) { const int lineState = matchingDelimiter | (dashCount << 8); styler.SetLineState(sc.currentLine, lineState); } sc.Forward(); } sc.Complete(); } // Store both the current line's fold level and the next lines in the // level store to make it easy to pick up with each increment // and to make it possible to fiddle the current level for "} else {". void FoldRDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { const bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; const bool foldAtElse = styler.GetPropertyInt("fold.at.else", 0) != 0; const Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelCurrent = SC_FOLDLEVELBASE; if (lineCurrent > 0) levelCurrent = styler.LevelAt(lineCurrent-1) >> 16; int levelMinCurrent = levelCurrent; int levelNext = levelCurrent; char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); for (Sci_PositionU i = startPos; i < endPos; i++) { const char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); const int style = styleNext; styleNext = styler.StyleAt(i + 1); const bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (style == SCE_R_OPERATOR) { if (ch == '{') { // Measure the minimum before a '{' to allow // folding on "} else {" if (levelMinCurrent > levelNext) { levelMinCurrent = levelNext; } levelNext++; } else if (ch == '}') { levelNext--; } } if (atEOL) { int levelUse = levelCurrent; if (foldAtElse) { levelUse = levelMinCurrent; } int lev = levelUse | levelNext << 16; if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if (levelUse < levelNext) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelCurrent = levelNext; levelMinCurrent = levelCurrent; visibleChars = 0; } if (!isspacechar(ch)) visibleChars++; } } const char * const RWordLists[] = { "Language Keywords", "Base / Default package function", "Other Package Functions", "Unused", "Unused", nullptr, }; } LexerModule lmR(SCLEX_R, ColouriseRDoc, "r", FoldRDoc, RWordLists); lexilla/lexers/LexSQL.cxx0000664000175000017500000007532314647367374014347 0ustar neilneil//-*- coding: utf-8 -*- // Scintilla source code edit control /** @file LexSQL.cxx ** Lexer for SQL, including PL/SQL and SQL*Plus. ** Improved by Jérôme LAFORGE from 2010 to 2012. **/ // Copyright 1998-2012 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" #include "OptionSet.h" #include "SparseState.h" #include "DefaultLexer.h" using namespace Scintilla; using namespace Lexilla; namespace { bool IsAWordChar(int ch, bool sqlAllowDottedWord) noexcept { if (!sqlAllowDottedWord) return (ch < 0x80) && (isalnum(ch) || ch == '_'); else return (ch < 0x80) && (isalnum(ch) || ch == '_' || ch == '.'); } bool IsAWordStart(int ch) noexcept { return (ch < 0x80) && (isalpha(ch) || ch == '_'); } bool IsADoxygenChar(int ch) noexcept { return (islower(ch) || ch == '$' || ch == '@' || ch == '\\' || ch == '&' || ch == '<' || ch == '>' || ch == '#' || ch == '{' || ch == '}' || ch == '[' || ch == ']'); } bool IsANumberChar(int ch, int chPrev) noexcept { // Not exactly following number definition (several dots are seen as OK, etc.) // but probably enough in most cases. return (ch < 0x80) && (isdigit(ch) || toupper(ch) == 'E' || ch == '.' || ((ch == '-' || ch == '+') && chPrev < 0x80 && toupper(chPrev) == 'E')); } typedef unsigned int sql_state_t; class SQLStates { public : void Set(Sci_Position lineNumber, unsigned short int sqlStatesLine) { sqlStatement.Set(lineNumber, sqlStatesLine); } sql_state_t IgnoreWhen (sql_state_t sqlStatesLine, bool enable) { if (enable) sqlStatesLine |= MASK_IGNORE_WHEN; else sqlStatesLine &= ~MASK_IGNORE_WHEN; return sqlStatesLine; } sql_state_t IntoCondition (sql_state_t sqlStatesLine, bool enable) { if (enable) sqlStatesLine |= MASK_INTO_CONDITION; else sqlStatesLine &= ~MASK_INTO_CONDITION; return sqlStatesLine; } sql_state_t IntoExceptionBlock (sql_state_t sqlStatesLine, bool enable) { if (enable) sqlStatesLine |= MASK_INTO_EXCEPTION; else sqlStatesLine &= ~MASK_INTO_EXCEPTION; return sqlStatesLine; } sql_state_t IntoDeclareBlock (sql_state_t sqlStatesLine, bool enable) { if (enable) sqlStatesLine |= MASK_INTO_DECLARE; else sqlStatesLine &= ~MASK_INTO_DECLARE; return sqlStatesLine; } sql_state_t IntoMergeStatement (sql_state_t sqlStatesLine, bool enable) { if (enable) sqlStatesLine |= MASK_MERGE_STATEMENT; else sqlStatesLine &= ~MASK_MERGE_STATEMENT; return sqlStatesLine; } sql_state_t CaseMergeWithoutWhenFound (sql_state_t sqlStatesLine, bool found) { if (found) sqlStatesLine |= MASK_CASE_MERGE_WITHOUT_WHEN_FOUND; else sqlStatesLine &= ~MASK_CASE_MERGE_WITHOUT_WHEN_FOUND; return sqlStatesLine; } sql_state_t IntoSelectStatementOrAssignment (sql_state_t sqlStatesLine, bool found) { if (found) sqlStatesLine |= MASK_INTO_SELECT_STATEMENT_OR_ASSIGNEMENT; else sqlStatesLine &= ~MASK_INTO_SELECT_STATEMENT_OR_ASSIGNEMENT; return sqlStatesLine; } sql_state_t BeginCaseBlock (sql_state_t sqlStatesLine) { if ((sqlStatesLine & MASK_NESTED_CASES) < MASK_NESTED_CASES) { sqlStatesLine++; } return sqlStatesLine; } sql_state_t EndCaseBlock (sql_state_t sqlStatesLine) { if ((sqlStatesLine & MASK_NESTED_CASES) > 0) { sqlStatesLine--; } return sqlStatesLine; } sql_state_t IntoCreateStatement (sql_state_t sqlStatesLine, bool enable) { if (enable) sqlStatesLine |= MASK_INTO_CREATE; else sqlStatesLine &= ~MASK_INTO_CREATE; return sqlStatesLine; } sql_state_t IntoCreateViewStatement (sql_state_t sqlStatesLine, bool enable) { if (enable) sqlStatesLine |= MASK_INTO_CREATE_VIEW; else sqlStatesLine &= ~MASK_INTO_CREATE_VIEW; return sqlStatesLine; } sql_state_t IntoCreateViewAsStatement (sql_state_t sqlStatesLine, bool enable) { if (enable) sqlStatesLine |= MASK_INTO_CREATE_VIEW_AS_STATEMENT; else sqlStatesLine &= ~MASK_INTO_CREATE_VIEW_AS_STATEMENT; return sqlStatesLine; } bool IsIgnoreWhen (sql_state_t sqlStatesLine) { return (sqlStatesLine & MASK_IGNORE_WHEN) != 0; } bool IsIntoCondition (sql_state_t sqlStatesLine) { return (sqlStatesLine & MASK_INTO_CONDITION) != 0; } bool IsIntoCaseBlock (sql_state_t sqlStatesLine) { return (sqlStatesLine & MASK_NESTED_CASES) != 0; } bool IsIntoExceptionBlock (sql_state_t sqlStatesLine) { return (sqlStatesLine & MASK_INTO_EXCEPTION) != 0; } bool IsIntoSelectStatementOrAssignment (sql_state_t sqlStatesLine) { return (sqlStatesLine & MASK_INTO_SELECT_STATEMENT_OR_ASSIGNEMENT) != 0; } bool IsCaseMergeWithoutWhenFound (sql_state_t sqlStatesLine) { return (sqlStatesLine & MASK_CASE_MERGE_WITHOUT_WHEN_FOUND) != 0; } bool IsIntoDeclareBlock (sql_state_t sqlStatesLine) { return (sqlStatesLine & MASK_INTO_DECLARE) != 0; } bool IsIntoMergeStatement (sql_state_t sqlStatesLine) { return (sqlStatesLine & MASK_MERGE_STATEMENT) != 0; } bool IsIntoCreateStatement (sql_state_t sqlStatesLine) { return (sqlStatesLine & MASK_INTO_CREATE) != 0; } bool IsIntoCreateViewStatement (sql_state_t sqlStatesLine) { return (sqlStatesLine & MASK_INTO_CREATE_VIEW) != 0; } bool IsIntoCreateViewAsStatement (sql_state_t sqlStatesLine) { return (sqlStatesLine & MASK_INTO_CREATE_VIEW_AS_STATEMENT) != 0; } sql_state_t ForLine(Sci_Position lineNumber) { return sqlStatement.ValueAt(lineNumber); } SQLStates() {} private : SparseState sqlStatement; enum { MASK_NESTED_CASES = 0x0001FF, MASK_INTO_SELECT_STATEMENT_OR_ASSIGNEMENT = 0x000200, MASK_CASE_MERGE_WITHOUT_WHEN_FOUND = 0x000400, MASK_MERGE_STATEMENT = 0x000800, MASK_INTO_DECLARE = 0x001000, MASK_INTO_EXCEPTION = 0x002000, MASK_INTO_CONDITION = 0x004000, MASK_IGNORE_WHEN = 0x008000, MASK_INTO_CREATE = 0x010000, MASK_INTO_CREATE_VIEW = 0x020000, MASK_INTO_CREATE_VIEW_AS_STATEMENT = 0x040000 }; }; // Options used for LexerSQL struct OptionsSQL { bool fold; bool foldAtElse; bool foldComment; bool foldCompact; bool foldOnlyBegin; bool sqlBackticksIdentifier; bool sqlNumbersignComment; bool sqlBackslashEscapes; bool sqlAllowDottedWord; OptionsSQL() { fold = false; foldAtElse = false; foldComment = false; foldCompact = false; foldOnlyBegin = false; sqlBackticksIdentifier = false; sqlNumbersignComment = false; sqlBackslashEscapes = false; sqlAllowDottedWord = false; } }; const char * const sqlWordListDesc[] = { "Keywords", "Database Objects", "PLDoc", "SQL*Plus", "User Keywords 1", "User Keywords 2", "User Keywords 3", "User Keywords 4", nullptr }; struct OptionSetSQL : public OptionSet { OptionSetSQL() { DefineProperty("fold", &OptionsSQL::fold); DefineProperty("fold.sql.at.else", &OptionsSQL::foldAtElse, "This option enables SQL folding on a \"ELSE\" and \"ELSIF\" line of an IF statement."); DefineProperty("fold.comment", &OptionsSQL::foldComment); DefineProperty("fold.compact", &OptionsSQL::foldCompact); DefineProperty("fold.sql.only.begin", &OptionsSQL::foldOnlyBegin, "Set to 1 to only fold on 'begin' but not other keywords."); DefineProperty("lexer.sql.backticks.identifier", &OptionsSQL::sqlBackticksIdentifier, "Recognise backtick quoting of identifiers."); DefineProperty("lexer.sql.numbersign.comment", &OptionsSQL::sqlNumbersignComment, "If \"lexer.sql.numbersign.comment\" property is set to 0 a line beginning with '#' will not be a comment."); DefineProperty("sql.backslash.escapes", &OptionsSQL::sqlBackslashEscapes, "Enables backslash as an escape character in SQL."); DefineProperty("lexer.sql.allow.dotted.word", &OptionsSQL::sqlAllowDottedWord, "Set to 1 to colourise recognized words with dots " "(recommended for Oracle PL/SQL objects)."); DefineWordListSets(sqlWordListDesc); } }; class LexerSQL : public DefaultLexer { public : LexerSQL() : DefaultLexer("sql", SCLEX_SQL) {} virtual ~LexerSQL() {} int SCI_METHOD Version () const override { return lvRelease5; } void SCI_METHOD Release() override { delete this; } const char * SCI_METHOD PropertyNames() override { return osSQL.PropertyNames(); } int SCI_METHOD PropertyType(const char *name) override { return osSQL.PropertyType(name); } const char * SCI_METHOD DescribeProperty(const char *name) override { return osSQL.DescribeProperty(name); } Sci_Position SCI_METHOD PropertySet(const char *key, const char *val) override { if (osSQL.PropertySet(&options, key, val)) { return 0; } return -1; } const char * SCI_METHOD PropertyGet(const char *key) override { return osSQL.PropertyGet(key); } const char * SCI_METHOD DescribeWordListSets() override { return osSQL.DescribeWordListSets(); } Sci_Position SCI_METHOD WordListSet(int n, const char *wl) override; void SCI_METHOD Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void SCI_METHOD Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void * SCI_METHOD PrivateCall(int, void *) override { return 0; } static ILexer5 *LexerFactorySQL() { return new LexerSQL(); } private: bool IsStreamCommentStyle(int style) { return style == SCE_SQL_COMMENT || style == SCE_SQL_COMMENTDOC || style == SCE_SQL_COMMENTDOCKEYWORD || style == SCE_SQL_COMMENTDOCKEYWORDERROR; } bool IsCommentStyle (int style) { switch (style) { case SCE_SQL_COMMENT : case SCE_SQL_COMMENTDOC : case SCE_SQL_COMMENTLINE : case SCE_SQL_COMMENTLINEDOC : case SCE_SQL_COMMENTDOCKEYWORD : case SCE_SQL_COMMENTDOCKEYWORDERROR : return true; default : return false; } } bool IsCommentLine (Sci_Position line, LexAccessor &styler) { const Sci_Position pos = styler.LineStart(line); const Sci_Position eol_pos = styler.LineStart(line + 1) - 1; for (Sci_Position i = pos; i + 1 < eol_pos; i++) { const int style = styler.StyleAt(i); // MySQL needs -- comments to be followed by space or control char if (style == SCE_SQL_COMMENTLINE && styler.Match(i, "--")) return true; else if (!IsASpaceOrTab(styler[i])) return false; } return false; } OptionsSQL options; OptionSetSQL osSQL; SQLStates sqlStates; WordList keywords1; WordList keywords2; WordList kw_pldoc; WordList kw_sqlplus; WordList kw_user1; WordList kw_user2; WordList kw_user3; WordList kw_user4; }; Sci_Position SCI_METHOD LexerSQL::WordListSet(int n, const char *wl) { WordList *wordListN = 0; switch (n) { case 0: wordListN = &keywords1; break; case 1: wordListN = &keywords2; break; case 2: wordListN = &kw_pldoc; break; case 3: wordListN = &kw_sqlplus; break; case 4: wordListN = &kw_user1; break; case 5: wordListN = &kw_user2; break; case 6: wordListN = &kw_user3; break; case 7: wordListN = &kw_user4; } Sci_Position firstModification = -1; if (wordListN) { if (wordListN->Set(wl)) { firstModification = 0; } } return firstModification; } void SCI_METHOD LexerSQL::Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { LexAccessor styler(pAccess); StyleContext sc(startPos, length, initStyle, styler); int styleBeforeDCKeyword = SCE_SQL_DEFAULT; for (; sc.More(); sc.Forward()) { // Determine if the current state should terminate. switch (sc.state) { case SCE_SQL_OPERATOR: sc.SetState(SCE_SQL_DEFAULT); break; case SCE_SQL_NUMBER: // We stop the number definition on non-numerical non-dot non-eE non-sign char if (!IsANumberChar(sc.ch, sc.chPrev)) { sc.SetState(SCE_SQL_DEFAULT); } break; case SCE_SQL_IDENTIFIER: if (!IsAWordChar(sc.ch, options.sqlAllowDottedWord)) { int nextState = SCE_SQL_DEFAULT; char s[1000]; sc.GetCurrentLowered(s, sizeof(s)); if (keywords1.InList(s)) { sc.ChangeState(SCE_SQL_WORD); } else if (keywords2.InList(s)) { sc.ChangeState(SCE_SQL_WORD2); } else if (kw_sqlplus.InListAbbreviated(s, '~')) { sc.ChangeState(SCE_SQL_SQLPLUS); if (strncmp(s, "rem", 3) == 0) { nextState = SCE_SQL_SQLPLUS_COMMENT; } else if (strncmp(s, "pro", 3) == 0) { nextState = SCE_SQL_SQLPLUS_PROMPT; } } else if (kw_user1.InList(s)) { sc.ChangeState(SCE_SQL_USER1); } else if (kw_user2.InList(s)) { sc.ChangeState(SCE_SQL_USER2); } else if (kw_user3.InList(s)) { sc.ChangeState(SCE_SQL_USER3); } else if (kw_user4.InList(s)) { sc.ChangeState(SCE_SQL_USER4); } sc.SetState(nextState); } break; case SCE_SQL_QUOTEDIDENTIFIER: if (sc.ch == 0x60) { if (sc.chNext == 0x60) { sc.Forward(); // Ignore it } else { sc.ForwardSetState(SCE_SQL_DEFAULT); } } break; case SCE_SQL_COMMENT: if (sc.Match('*', '/')) { sc.Forward(); sc.ForwardSetState(SCE_SQL_DEFAULT); } break; case SCE_SQL_COMMENTDOC: if (sc.Match('*', '/')) { sc.Forward(); sc.ForwardSetState(SCE_SQL_DEFAULT); } else if (sc.ch == '@' || sc.ch == '\\') { // Doxygen support // Verify that we have the conditions to mark a comment-doc-keyword if ((IsASpace(sc.chPrev) || sc.chPrev == '*') && (!IsASpace(sc.chNext))) { styleBeforeDCKeyword = SCE_SQL_COMMENTDOC; sc.SetState(SCE_SQL_COMMENTDOCKEYWORD); } } break; case SCE_SQL_COMMENTLINE: case SCE_SQL_COMMENTLINEDOC: case SCE_SQL_SQLPLUS_COMMENT: case SCE_SQL_SQLPLUS_PROMPT: if (sc.atLineStart) { sc.SetState(SCE_SQL_DEFAULT); } break; case SCE_SQL_COMMENTDOCKEYWORD: if ((styleBeforeDCKeyword == SCE_SQL_COMMENTDOC) && sc.Match('*', '/')) { sc.ChangeState(SCE_SQL_COMMENTDOCKEYWORDERROR); sc.Forward(); sc.ForwardSetState(SCE_SQL_DEFAULT); } else if (!IsADoxygenChar(sc.ch)) { char s[100]; sc.GetCurrentLowered(s, sizeof(s)); if (!isspace(sc.ch) || !kw_pldoc.InList(s + 1)) { sc.ChangeState(SCE_SQL_COMMENTDOCKEYWORDERROR); } sc.SetState(styleBeforeDCKeyword); } break; case SCE_SQL_CHARACTER: if (options.sqlBackslashEscapes && sc.ch == '\\') { sc.Forward(); } else if (sc.ch == '\'') { if (sc.chNext == '\'') { sc.Forward(); } else { sc.ForwardSetState(SCE_SQL_DEFAULT); } } break; case SCE_SQL_STRING: if (options.sqlBackslashEscapes && sc.ch == '\\') { // Escape sequence sc.Forward(); } else if (sc.ch == '\"') { if (sc.chNext == '\"') { sc.Forward(); } else { sc.ForwardSetState(SCE_SQL_DEFAULT); } } break; case SCE_SQL_QOPERATOR: // Locate the unique Q operator character sc.Complete(); char qOperator = 0x00; for (Sci_Position styleStartPos = sc.currentPos; styleStartPos > 0; --styleStartPos) { if (styler.StyleAt(styleStartPos - 1) != SCE_SQL_QOPERATOR) { qOperator = styler.SafeGetCharAt(styleStartPos + 2); break; } } char qComplement = 0x00; if (qOperator == '<') { qComplement = '>'; } else if (qOperator == '(') { qComplement = ')'; } else if (qOperator == '{') { qComplement = '}'; } else if (qOperator == '[') { qComplement = ']'; } else { qComplement = qOperator; } if (sc.Match(qComplement, '\'')) { sc.Forward(); sc.ForwardSetState(SCE_SQL_DEFAULT); } break; } // Determine if a new state should be entered. if (sc.state == SCE_SQL_DEFAULT) { if (sc.Match('q', '\'') || sc.Match('Q', '\'')) { sc.SetState(SCE_SQL_QOPERATOR); sc.Forward(); } else if (IsADigit(sc.ch) || (sc.ch == '.' && IsADigit(sc.chNext)) || ((sc.ch == '-' || sc.ch == '+') && IsADigit(sc.chNext) && !IsADigit(sc.chPrev))) { sc.SetState(SCE_SQL_NUMBER); } else if (IsAWordStart(sc.ch)) { sc.SetState(SCE_SQL_IDENTIFIER); } else if (sc.ch == 0x60 && options.sqlBackticksIdentifier) { sc.SetState(SCE_SQL_QUOTEDIDENTIFIER); } else if (sc.Match('/', '*')) { if (sc.Match("/**") || sc.Match("/*!")) { // Support of Doxygen doc. style sc.SetState(SCE_SQL_COMMENTDOC); } else { sc.SetState(SCE_SQL_COMMENT); } sc.Forward(); // Eat the * so it isn't used for the end of the comment } else if (sc.Match('-', '-')) { // MySQL requires a space or control char after -- // http://dev.mysql.com/doc/mysql/en/ansi-diff-comments.html // Perhaps we should enforce that with proper property: //~ } else if (sc.Match("-- ")) { sc.SetState(SCE_SQL_COMMENTLINE); } else if (sc.ch == '#' && options.sqlNumbersignComment) { sc.SetState(SCE_SQL_COMMENTLINEDOC); } else if (sc.ch == '\'') { sc.SetState(SCE_SQL_CHARACTER); } else if (sc.ch == '\"') { sc.SetState(SCE_SQL_STRING); } else if (isoperator(sc.ch)) { sc.SetState(SCE_SQL_OPERATOR); } } } sc.Complete(); } void SCI_METHOD LexerSQL::Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { if (!options.fold) return; LexAccessor styler(pAccess); Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelCurrent = SC_FOLDLEVELBASE; if (lineCurrent > 0) { // Backtrack to previous line in case need to fix its fold status for folding block of single-line comments (i.e. '--'). Sci_Position lastNLPos = -1; // And keep going back until we find an operator ';' followed // by white-space and/or comments. This will improve folding. while (--startPos > 0) { const char ch = styler[startPos]; if (ch == '\n' || (ch == '\r' && styler[startPos + 1] != '\n')) { lastNLPos = startPos; } else if (ch == ';' && styler.StyleAt(startPos) == SCE_SQL_OPERATOR) { bool isAllClear = true; for (Sci_Position tempPos = startPos + 1; tempPos < lastNLPos; ++tempPos) { const int tempStyle = styler.StyleAt(tempPos); if (!IsCommentStyle(tempStyle) && tempStyle != SCE_SQL_DEFAULT) { isAllClear = false; break; } } if (isAllClear) { startPos = lastNLPos + 1; break; } } } lineCurrent = styler.GetLine(startPos); if (lineCurrent > 0) levelCurrent = styler.LevelAt(lineCurrent - 1) >> 16; } // And because folding ends at ';', keep going until we find one // Otherwise if create ... view ... as is split over multiple // lines the folding won't always update immediately. const Sci_PositionU docLength = styler.Length(); for (; endPos < docLength; ++endPos) { if (styler.SafeGetCharAt(endPos) == ';') { break; } } int levelNext = levelCurrent; char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); int style = initStyle; bool endFound = false; bool isUnfoldingIgnored = false; // this statementFound flag avoids to fold when the statement is on only one line by ignoring ELSE or ELSIF // eg. "IF condition1 THEN ... ELSIF condition2 THEN ... ELSE ... END IF;" bool statementFound = false; sql_state_t sqlStatesCurrentLine = 0; if (!options.foldOnlyBegin) { sqlStatesCurrentLine = sqlStates.ForLine(lineCurrent); } for (Sci_PositionU i = startPos; i < endPos; i++) { const char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); const int stylePrev = style; style = styleNext; styleNext = styler.StyleAt(i + 1); const bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (atEOL || (!IsCommentStyle(style) && ch == ';')) { if (endFound) { //Maybe this is the end of "EXCEPTION" BLOCK (eg. "BEGIN ... EXCEPTION ... END;") sqlStatesCurrentLine = sqlStates.IntoExceptionBlock(sqlStatesCurrentLine, false); } // set endFound and isUnfoldingIgnored to false if EOL is reached or ';' is found endFound = false; isUnfoldingIgnored = false; } if ((!IsCommentStyle(style) && ch == ';')) { if (sqlStates.IsIntoMergeStatement(sqlStatesCurrentLine)) { // This is the end of "MERGE" statement. if (!sqlStates.IsCaseMergeWithoutWhenFound(sqlStatesCurrentLine)) levelNext--; sqlStatesCurrentLine = sqlStates.IntoMergeStatement(sqlStatesCurrentLine, false); levelNext--; } if (sqlStates.IsIntoSelectStatementOrAssignment(sqlStatesCurrentLine)) sqlStatesCurrentLine = sqlStates.IntoSelectStatementOrAssignment(sqlStatesCurrentLine, false); if (sqlStates.IsIntoCreateStatement(sqlStatesCurrentLine)) { if (sqlStates.IsIntoCreateViewStatement(sqlStatesCurrentLine)) { if (sqlStates.IsIntoCreateViewAsStatement(sqlStatesCurrentLine)) { levelNext--; sqlStatesCurrentLine = sqlStates.IntoCreateViewAsStatement(sqlStatesCurrentLine, false); } sqlStatesCurrentLine = sqlStates.IntoCreateViewStatement(sqlStatesCurrentLine, false); } sqlStatesCurrentLine = sqlStates.IntoCreateStatement(sqlStatesCurrentLine, false); } } if (ch == ':' && chNext == '=' && !IsCommentStyle(style)) sqlStatesCurrentLine = sqlStates.IntoSelectStatementOrAssignment(sqlStatesCurrentLine, true); if (options.foldComment && IsStreamCommentStyle(style)) { if (!IsStreamCommentStyle(stylePrev)) { levelNext++; } else if (!IsStreamCommentStyle(styleNext) && !atEOL) { // Comments don't end at end of line and the next character may be unstyled. levelNext--; } } if (options.foldComment && (style == SCE_SQL_COMMENTLINE)) { // MySQL needs -- comments to be followed by space or control char if ((ch == '-') && (chNext == '-')) { const char chNext2 = styler.SafeGetCharAt(i + 2); const char chNext3 = styler.SafeGetCharAt(i + 3); if (chNext2 == '{' || chNext3 == '{') { levelNext++; } else if (chNext2 == '}' || chNext3 == '}') { levelNext--; } } } // Fold block of single-line comments (i.e. '--'). if (options.foldComment && atEOL && IsCommentLine(lineCurrent, styler)) { if (!IsCommentLine(lineCurrent - 1, styler) && IsCommentLine(lineCurrent + 1, styler)) levelNext++; else if (IsCommentLine(lineCurrent - 1, styler) && !IsCommentLine(lineCurrent + 1, styler)) levelNext--; } if (style == SCE_SQL_OPERATOR) { if (ch == '(') { if (levelCurrent > levelNext) levelCurrent--; levelNext++; } else if (ch == ')') { levelNext--; } else if ((!options.foldOnlyBegin) && ch == ';') { sqlStatesCurrentLine = sqlStates.IgnoreWhen(sqlStatesCurrentLine, false); } } // If new keyword (cannot trigger on elseif or nullif, does less tests) if (style == SCE_SQL_WORD && stylePrev != SCE_SQL_WORD) { constexpr int MAX_KW_LEN = 9; // Maximum length of folding keywords char s[MAX_KW_LEN + 2]; unsigned int j = 0; for (; j < MAX_KW_LEN + 1; j++) { if (!iswordchar(styler[i + j])) { break; } s[j] = static_cast(tolower(styler[i + j])); } if (j == MAX_KW_LEN + 1) { // Keyword too long, don't test it s[0] = '\0'; } else { s[j] = '\0'; } if (!options.foldOnlyBegin && strcmp(s, "select") == 0) { sqlStatesCurrentLine = sqlStates.IntoSelectStatementOrAssignment(sqlStatesCurrentLine, true); } else if (strcmp(s, "if") == 0) { if (endFound) { endFound = false; if (options.foldOnlyBegin && !isUnfoldingIgnored) { // this end isn't for begin block, but for if block ("end if;") // so ignore previous "end" by increment levelNext. levelNext++; } } else { if (!options.foldOnlyBegin) sqlStatesCurrentLine = sqlStates.IntoCondition(sqlStatesCurrentLine, true); if (levelCurrent > levelNext) { // doesn't include this line into the folding block // because doesn't hide IF (eg "END; IF") levelCurrent = levelNext; } } } else if (!options.foldOnlyBegin && strcmp(s, "then") == 0 && sqlStates.IsIntoCondition(sqlStatesCurrentLine)) { sqlStatesCurrentLine = sqlStates.IntoCondition(sqlStatesCurrentLine, false); if (!options.foldOnlyBegin) { if (levelCurrent > levelNext) { levelCurrent = levelNext; } if (!statementFound) levelNext++; statementFound = true; } else if (levelCurrent > levelNext) { // doesn't include this line into the folding block // because doesn't hide LOOP or CASE (eg "END; LOOP" or "END; CASE") levelCurrent = levelNext; } } else if (strcmp(s, "loop") == 0 || strcmp(s, "case") == 0) { if (endFound) { endFound = false; if (options.foldOnlyBegin && !isUnfoldingIgnored) { // this end isn't for begin block, but for loop block ("end loop;") or case block ("end case;") // so ignore previous "end" by increment levelNext. levelNext++; } if ((!options.foldOnlyBegin) && strcmp(s, "case") == 0) { sqlStatesCurrentLine = sqlStates.EndCaseBlock(sqlStatesCurrentLine); if (!sqlStates.IsCaseMergeWithoutWhenFound(sqlStatesCurrentLine)) levelNext--; //again for the "end case;" and block when } } else if (!options.foldOnlyBegin) { if (strcmp(s, "case") == 0) { sqlStatesCurrentLine = sqlStates.BeginCaseBlock(sqlStatesCurrentLine); sqlStatesCurrentLine = sqlStates.CaseMergeWithoutWhenFound(sqlStatesCurrentLine, true); } if (levelCurrent > levelNext) levelCurrent = levelNext; if (!statementFound) levelNext++; statementFound = true; } else if (levelCurrent > levelNext) { // doesn't include this line into the folding block // because doesn't hide LOOP or CASE (eg "END; LOOP" or "END; CASE") levelCurrent = levelNext; } } else if ((!options.foldOnlyBegin) && ( // folding for ELSE and ELSIF block only if foldAtElse is set // and IF or CASE aren't on only one line with ELSE or ELSIF (with flag statementFound) options.foldAtElse && !statementFound) && strcmp(s, "elsif") == 0) { sqlStatesCurrentLine = sqlStates.IntoCondition(sqlStatesCurrentLine, true); levelCurrent--; levelNext--; } else if ((!options.foldOnlyBegin) && ( // folding for ELSE and ELSIF block only if foldAtElse is set // and IF or CASE aren't on only one line with ELSE or ELSIF (with flag statementFound) options.foldAtElse && !statementFound) && strcmp(s, "else") == 0) { // prevent also ELSE is on the same line (eg. "ELSE ... END IF;") statementFound = true; if (sqlStates.IsIntoCaseBlock(sqlStatesCurrentLine) && sqlStates.IsCaseMergeWithoutWhenFound(sqlStatesCurrentLine)) { sqlStatesCurrentLine = sqlStates.CaseMergeWithoutWhenFound(sqlStatesCurrentLine, false); levelNext++; } else { // we are in same case "} ELSE {" in C language levelCurrent--; } } else if (strcmp(s, "begin") == 0) { levelNext++; sqlStatesCurrentLine = sqlStates.IntoDeclareBlock(sqlStatesCurrentLine, false); } else if ((strcmp(s, "end") == 0) || // SQL Anywhere permits IF ... ELSE ... ENDIF // will only be active if "endif" appears in the // keyword list. (strcmp(s, "endif") == 0)) { endFound = true; levelNext--; if (sqlStates.IsIntoSelectStatementOrAssignment(sqlStatesCurrentLine) && !sqlStates.IsCaseMergeWithoutWhenFound(sqlStatesCurrentLine)) levelNext--; if (levelNext < SC_FOLDLEVELBASE) { levelNext = SC_FOLDLEVELBASE; isUnfoldingIgnored = true; } } else if ((!options.foldOnlyBegin) && strcmp(s, "when") == 0 && !sqlStates.IsIgnoreWhen(sqlStatesCurrentLine) && !sqlStates.IsIntoExceptionBlock(sqlStatesCurrentLine) && ( sqlStates.IsIntoCaseBlock(sqlStatesCurrentLine) || sqlStates.IsIntoMergeStatement(sqlStatesCurrentLine) ) ) { sqlStatesCurrentLine = sqlStates.IntoCondition(sqlStatesCurrentLine, true); // Don't foldind when CASE and WHEN are on the same line (with flag statementFound) (eg. "CASE selector WHEN expression1 THEN sequence_of_statements1;\n") // and same way for MERGE statement. if (!statementFound) { if (!sqlStates.IsCaseMergeWithoutWhenFound(sqlStatesCurrentLine)) { levelCurrent--; levelNext--; } sqlStatesCurrentLine = sqlStates.CaseMergeWithoutWhenFound(sqlStatesCurrentLine, false); } } else if ((!options.foldOnlyBegin) && strcmp(s, "exit") == 0) { sqlStatesCurrentLine = sqlStates.IgnoreWhen(sqlStatesCurrentLine, true); } else if ((!options.foldOnlyBegin) && !sqlStates.IsIntoDeclareBlock(sqlStatesCurrentLine) && strcmp(s, "exception") == 0) { sqlStatesCurrentLine = sqlStates.IntoExceptionBlock(sqlStatesCurrentLine, true); } else if ((!options.foldOnlyBegin) && (strcmp(s, "declare") == 0 || strcmp(s, "function") == 0 || strcmp(s, "procedure") == 0 || strcmp(s, "package") == 0)) { sqlStatesCurrentLine = sqlStates.IntoDeclareBlock(sqlStatesCurrentLine, true); } else if ((!options.foldOnlyBegin) && strcmp(s, "merge") == 0) { sqlStatesCurrentLine = sqlStates.IntoMergeStatement(sqlStatesCurrentLine, true); sqlStatesCurrentLine = sqlStates.CaseMergeWithoutWhenFound(sqlStatesCurrentLine, true); levelNext++; statementFound = true; } else if ((!options.foldOnlyBegin) && strcmp(s, "create") == 0) { sqlStatesCurrentLine = sqlStates.IntoCreateStatement(sqlStatesCurrentLine, true); } else if ((!options.foldOnlyBegin) && strcmp(s, "view") == 0 && sqlStates.IsIntoCreateStatement(sqlStatesCurrentLine)) { sqlStatesCurrentLine = sqlStates.IntoCreateViewStatement(sqlStatesCurrentLine, true); } else if ((!options.foldOnlyBegin) && strcmp(s, "as") == 0 && sqlStates.IsIntoCreateViewStatement(sqlStatesCurrentLine) && ! sqlStates.IsIntoCreateViewAsStatement(sqlStatesCurrentLine)) { sqlStatesCurrentLine = sqlStates.IntoCreateViewAsStatement(sqlStatesCurrentLine, true); levelNext++; } } if (atEOL) { const int levelUse = levelCurrent; int lev = levelUse | levelNext << 16; if (visibleChars == 0 && options.foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if (levelUse < levelNext) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelCurrent = levelNext; visibleChars = 0; statementFound = false; if (!options.foldOnlyBegin) sqlStates.Set(lineCurrent, sqlStatesCurrentLine); } if (!isspacechar(ch)) { visibleChars++; } } } } LexerModule lmSQL(SCLEX_SQL, LexerSQL::LexerFactorySQL, "sql", sqlWordListDesc); lexilla/lexers/LexTADS3.cxx0000664000175000017500000011121514647367374014515 0ustar neilneil// Scintilla source code edit control /** @file LexTADS3.cxx ** Lexer for TADS3. **/ // Copyright 1998-2006 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. /* * TADS3 is a language designed by Michael J. Roberts for the writing of text * based games. TADS comes from Text Adventure Development System. It has good * support for the processing and outputting of formatted text and much of a * TADS program listing consists of strings. * * TADS has two types of strings, those enclosed in single quotes (') and those * enclosed in double quotes ("). These strings have different symantics and * can be given different highlighting if desired. * * There can be embedded within both types of strings html tags * ( ), library directives ( <.directive> ), and message * parameters ( {The doctor's/his} ). * * Double quoted strings can also contain interpolated expressions * ( << rug.moved ? ' and a hole in the floor. ' : nil >> ). These expressions * may themselves contain single or double quoted strings, although the double * quoted strings may not contain interpolated expressions. * * These embedded constructs influence the output and formatting and are an * important part of a program and require highlighting. * * LINKS * http://www.tads.org/ */ #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static const int T3_SINGLE_QUOTE = 1; static const int T3_INT_EXPRESSION = 2; static const int T3_INT_EXPRESSION_IN_TAG = 4; static const int T3_HTML_SQUOTE = 8; static inline bool IsEOL(const int ch, const int chNext) { return (ch == '\r' && chNext != '\n') || (ch == '\n'); } /* * Test the current character to see if it's the START of an EOL sequence; * if so, skip ahead to the last character of the sequence and return true, * and if not just return false. There are a few places where we want to * check to see if a newline sequence occurs at a particular point, but * where a caller expects a subroutine to stop only upon reaching the END * of a newline sequence (in particular, CR-LF on Windows). That's why * IsEOL() above only returns true on CR if the CR isn't followed by an LF * - it doesn't want to admit that there's a newline until reaching the END * of the sequence. We meet both needs by saying that there's a newline * when we see the CR in a CR-LF, but skipping the CR before returning so * that the caller's caller will see that we've stopped at the LF. */ static inline bool IsEOLSkip(StyleContext &sc) { /* test for CR-LF */ if (sc.ch == '\r' && sc.chNext == '\n') { /* got CR-LF - skip the CR and indicate that we're at a newline */ sc.Forward(); return true; } /* * in other cases, we have at most a 1-character newline, so do the * normal IsEOL test */ return IsEOL(sc.ch, sc.chNext); } static inline bool IsATADS3Operator(const int ch) { return ch == '=' || ch == '{' || ch == '}' || ch == '(' || ch == ')' || ch == '[' || ch == ']' || ch == ',' || ch == ':' || ch == ';' || ch == '+' || ch == '-' || ch == '*' || ch == '/' || ch == '%' || ch == '?' || ch == '!' || ch == '<' || ch == '>' || ch == '|' || ch == '@' || ch == '&' || ch == '~'; } static inline bool IsAWordChar(const int ch) { return isalnum(ch) || ch == '_'; } static inline bool IsAWordStart(const int ch) { return isalpha(ch) || ch == '_'; } static inline bool IsAHexDigit(const int ch) { int lch = tolower(ch); return isdigit(lch) || lch == 'a' || lch == 'b' || lch == 'c' || lch == 'd' || lch == 'e' || lch == 'f'; } static inline bool IsAnHTMLChar(int ch) { return isalnum(ch) || ch == '-' || ch == '_' || ch == '.'; } static inline bool IsADirectiveChar(int ch) { return isalnum(ch) || isspace(ch) || ch == '-' || ch == '/'; } static inline bool IsANumberStart(StyleContext &sc) { return isdigit(sc.ch) || (!isdigit(sc.chPrev) && sc.ch == '.' && isdigit(sc.chNext)); } inline static void ColouriseTADS3Operator(StyleContext &sc) { int initState = sc.state; int c = sc.ch; sc.SetState(c == '{' || c == '}' ? SCE_T3_BRACE : SCE_T3_OPERATOR); sc.ForwardSetState(initState); } static void ColouriseTADSHTMLString(StyleContext &sc, int &lineState) { int endState = sc.state; int chQuote = sc.ch; int chString = (lineState & T3_SINGLE_QUOTE) ? '\'' : '"'; if (endState == SCE_T3_HTML_STRING) { if (lineState&T3_SINGLE_QUOTE) { endState = SCE_T3_S_STRING; chString = '\''; } else if (lineState&T3_INT_EXPRESSION) { endState = SCE_T3_X_STRING; chString = '"'; } else { endState = SCE_T3_HTML_DEFAULT; chString = '"'; } chQuote = (lineState & T3_HTML_SQUOTE) ? '\'' : '"'; } else { sc.SetState(SCE_T3_HTML_STRING); sc.Forward(); } if (chQuote == '"') lineState &= ~T3_HTML_SQUOTE; else lineState |= T3_HTML_SQUOTE; while (sc.More()) { if (IsEOL(sc.ch, sc.chNext)) { return; } if (sc.ch == chQuote) { sc.ForwardSetState(endState); return; } if (sc.Match('\\', static_cast(chQuote))) { sc.Forward(2); sc.SetState(endState); return; } if (sc.ch == chString) { sc.SetState(SCE_T3_DEFAULT); return; } if (sc.Match('<', '<')) { lineState |= T3_INT_EXPRESSION | T3_INT_EXPRESSION_IN_TAG; sc.SetState(SCE_T3_X_DEFAULT); sc.Forward(2); return; } if (sc.Match('\\', static_cast(chQuote)) || sc.Match('\\', static_cast(chString)) || sc.Match('\\', '\\')) { sc.Forward(2); } else { sc.Forward(); } } } static void ColouriseTADS3HTMLTagStart(StyleContext &sc) { sc.SetState(SCE_T3_HTML_TAG); sc.Forward(); if (sc.ch == '/') { sc.Forward(); } while (IsAnHTMLChar(sc.ch)) { sc.Forward(); } } static void ColouriseTADS3HTMLTag(StyleContext &sc, int &lineState) { int endState = sc.state; int chQuote = '"'; int chString = '\''; switch (endState) { case SCE_T3_S_STRING: ColouriseTADS3HTMLTagStart(sc); sc.SetState(SCE_T3_HTML_DEFAULT); chQuote = '\''; chString = '"'; break; case SCE_T3_D_STRING: case SCE_T3_X_STRING: ColouriseTADS3HTMLTagStart(sc); sc.SetState(SCE_T3_HTML_DEFAULT); break; case SCE_T3_HTML_DEFAULT: if (lineState&T3_SINGLE_QUOTE) { endState = SCE_T3_S_STRING; chQuote = '\''; chString = '"'; } else if (lineState&T3_INT_EXPRESSION) { endState = SCE_T3_X_STRING; } else { endState = SCE_T3_D_STRING; } break; } while (sc.More()) { if (IsEOL(sc.ch, sc.chNext)) { return; } if (sc.Match('/', '>')) { sc.SetState(SCE_T3_HTML_TAG); sc.Forward(2); sc.SetState(endState); return; } if (sc.ch == '>') { sc.SetState(SCE_T3_HTML_TAG); sc.ForwardSetState(endState); return; } if (sc.ch == chQuote) { sc.SetState(endState); return; } if (sc.Match('\\', static_cast(chQuote))) { sc.Forward(); ColouriseTADSHTMLString(sc, lineState); if (sc.state == SCE_T3_X_DEFAULT) break; } else if (sc.ch == chString) { ColouriseTADSHTMLString(sc, lineState); } else if (sc.ch == '=') { ColouriseTADS3Operator(sc); } else { sc.Forward(); } } } static void ColouriseTADS3Keyword(StyleContext &sc, WordList *keywordlists[], Sci_PositionU endPos) { char s[250]; WordList &keywords = *keywordlists[0]; WordList &userwords1 = *keywordlists[1]; WordList &userwords2 = *keywordlists[2]; WordList &userwords3 = *keywordlists[3]; int initState = sc.state; sc.SetState(SCE_T3_IDENTIFIER); while (sc.More() && (IsAWordChar(sc.ch))) { sc.Forward(); } sc.GetCurrent(s, sizeof(s)); if ( strcmp(s, "is") == 0 || strcmp(s, "not") == 0) { // have to find if "in" is next Sci_Position n = 1; while (n + sc.currentPos < endPos && IsASpaceOrTab(sc.GetRelative(n))) n++; if (sc.GetRelative(n) == 'i' && sc.GetRelative(n+1) == 'n') { sc.Forward(n+2); sc.ChangeState(SCE_T3_KEYWORD); } } else if (keywords.InList(s)) { sc.ChangeState(SCE_T3_KEYWORD); } else if (userwords3.InList(s)) { sc.ChangeState(SCE_T3_USER3); } else if (userwords2.InList(s)) { sc.ChangeState(SCE_T3_USER2); } else if (userwords1.InList(s)) { sc.ChangeState(SCE_T3_USER1); } sc.SetState(initState); } static void ColouriseTADS3MsgParam(StyleContext &sc, int &lineState) { int endState = sc.state; int chQuote = '"'; switch (endState) { case SCE_T3_S_STRING: sc.SetState(SCE_T3_MSG_PARAM); sc.Forward(); chQuote = '\''; break; case SCE_T3_D_STRING: case SCE_T3_X_STRING: sc.SetState(SCE_T3_MSG_PARAM); sc.Forward(); break; case SCE_T3_MSG_PARAM: if (lineState&T3_SINGLE_QUOTE) { endState = SCE_T3_S_STRING; chQuote = '\''; } else if (lineState&T3_INT_EXPRESSION) { endState = SCE_T3_X_STRING; } else { endState = SCE_T3_D_STRING; } break; } while (sc.More() && sc.ch != '}' && sc.ch != chQuote) { if (IsEOL(sc.ch, sc.chNext)) { return; } if (sc.ch == '\\') { sc.Forward(); } sc.Forward(); } if (sc.ch == chQuote) { sc.SetState(endState); } else { sc.ForwardSetState(endState); } } static void ColouriseTADS3LibDirective(StyleContext &sc, int &lineState) { int initState = sc.state; int chQuote = '"'; switch (initState) { case SCE_T3_S_STRING: sc.SetState(SCE_T3_LIB_DIRECTIVE); sc.Forward(2); chQuote = '\''; break; case SCE_T3_D_STRING: sc.SetState(SCE_T3_LIB_DIRECTIVE); sc.Forward(2); break; case SCE_T3_LIB_DIRECTIVE: if (lineState&T3_SINGLE_QUOTE) { initState = SCE_T3_S_STRING; chQuote = '\''; } else { initState = SCE_T3_D_STRING; } break; } while (sc.More() && IsADirectiveChar(sc.ch)) { if (IsEOL(sc.ch, sc.chNext)) { return; } sc.Forward(); }; if (sc.ch == '>' || !sc.More()) { sc.ForwardSetState(initState); } else if (sc.ch == chQuote) { sc.SetState(initState); } else { sc.ChangeState(initState); sc.Forward(); } } static void ColouriseTADS3String(StyleContext &sc, int &lineState) { int chQuote = sc.ch; int endState = sc.state; switch (sc.state) { case SCE_T3_DEFAULT: case SCE_T3_X_DEFAULT: if (chQuote == '"') { if (sc.state == SCE_T3_DEFAULT) { sc.SetState(SCE_T3_D_STRING); } else { sc.SetState(SCE_T3_X_STRING); } lineState &= ~T3_SINGLE_QUOTE; } else { sc.SetState(SCE_T3_S_STRING); lineState |= T3_SINGLE_QUOTE; } sc.Forward(); break; case SCE_T3_S_STRING: chQuote = '\''; endState = lineState&T3_INT_EXPRESSION ? SCE_T3_X_DEFAULT : SCE_T3_DEFAULT; break; case SCE_T3_D_STRING: chQuote = '"'; endState = SCE_T3_DEFAULT; break; case SCE_T3_X_STRING: chQuote = '"'; endState = SCE_T3_X_DEFAULT; break; } while (sc.More()) { if (IsEOL(sc.ch, sc.chNext)) { return; } if (sc.ch == chQuote) { sc.ForwardSetState(endState); return; } if (sc.state == SCE_T3_D_STRING && sc.Match('<', '<')) { lineState |= T3_INT_EXPRESSION; sc.SetState(SCE_T3_X_DEFAULT); sc.Forward(2); return; } if (sc.Match('\\', static_cast(chQuote)) || sc.Match('\\', '\\')) { sc.Forward(2); } else if (sc.ch == '{') { ColouriseTADS3MsgParam(sc, lineState); } else if (sc.Match('<', '.')) { ColouriseTADS3LibDirective(sc, lineState); } else if (sc.ch == '<') { ColouriseTADS3HTMLTag(sc, lineState); if (sc.state == SCE_T3_X_DEFAULT) return; } else { sc.Forward(); } } } static void ColouriseTADS3Comment(StyleContext &sc, int endState) { sc.SetState(SCE_T3_BLOCK_COMMENT); while (sc.More()) { if (IsEOL(sc.ch, sc.chNext)) { return; } if (sc.Match('*', '/')) { sc.Forward(2); sc.SetState(endState); return; } sc.Forward(); } } static void ColouriseToEndOfLine(StyleContext &sc, int initState, int endState) { sc.SetState(initState); while (sc.More()) { if (sc.ch == '\\') { sc.Forward(); if (IsEOLSkip(sc)) { return; } } if (IsEOL(sc.ch, sc.chNext)) { sc.SetState(endState); return; } sc.Forward(); } } static void ColouriseTADS3Number(StyleContext &sc) { int endState = sc.state; bool inHexNumber = false; bool seenE = false; bool seenDot = sc.ch == '.'; sc.SetState(SCE_T3_NUMBER); if (sc.More()) { sc.Forward(); } if (sc.chPrev == '0' && tolower(sc.ch) == 'x') { inHexNumber = true; sc.Forward(); } while (sc.More()) { if (inHexNumber) { if (!IsAHexDigit(sc.ch)) { break; } } else if (!isdigit(sc.ch)) { if (!seenE && tolower(sc.ch) == 'e') { seenE = true; seenDot = true; if (sc.chNext == '+' || sc.chNext == '-') { sc.Forward(); } } else if (!seenDot && sc.ch == '.') { seenDot = true; } else { break; } } sc.Forward(); } sc.SetState(endState); } static void ColouriseTADS3Doc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { int visibleChars = 0; int bracketLevel = 0; int lineState = 0; Sci_PositionU endPos = startPos + length; Sci_Position lineCurrent = styler.GetLine(startPos); if (lineCurrent > 0) { lineState = styler.GetLineState(lineCurrent-1); } StyleContext sc(startPos, length, initStyle, styler); while (sc.More()) { if (IsEOL(sc.ch, sc.chNext)) { styler.SetLineState(lineCurrent, lineState); lineCurrent++; visibleChars = 0; sc.Forward(); if (sc.ch == '\n') { sc.Forward(); } } switch(sc.state) { case SCE_T3_PREPROCESSOR: case SCE_T3_LINE_COMMENT: ColouriseToEndOfLine(sc, sc.state, lineState&T3_INT_EXPRESSION ? SCE_T3_X_DEFAULT : SCE_T3_DEFAULT); break; case SCE_T3_S_STRING: case SCE_T3_D_STRING: case SCE_T3_X_STRING: ColouriseTADS3String(sc, lineState); visibleChars++; break; case SCE_T3_MSG_PARAM: ColouriseTADS3MsgParam(sc, lineState); break; case SCE_T3_LIB_DIRECTIVE: ColouriseTADS3LibDirective(sc, lineState); break; case SCE_T3_HTML_DEFAULT: ColouriseTADS3HTMLTag(sc, lineState); break; case SCE_T3_HTML_STRING: ColouriseTADSHTMLString(sc, lineState); break; case SCE_T3_BLOCK_COMMENT: ColouriseTADS3Comment(sc, lineState&T3_INT_EXPRESSION ? SCE_T3_X_DEFAULT : SCE_T3_DEFAULT); break; case SCE_T3_DEFAULT: case SCE_T3_X_DEFAULT: if (IsASpaceOrTab(sc.ch)) { sc.Forward(); } else if (sc.ch == '#' && visibleChars == 0) { ColouriseToEndOfLine(sc, SCE_T3_PREPROCESSOR, sc.state); } else if (sc.Match('/', '*')) { ColouriseTADS3Comment(sc, sc.state); visibleChars++; } else if (sc.Match('/', '/')) { ColouriseToEndOfLine(sc, SCE_T3_LINE_COMMENT, sc.state); } else if (sc.ch == '"') { bracketLevel = 0; ColouriseTADS3String(sc, lineState); visibleChars++; } else if (sc.ch == '\'') { ColouriseTADS3String(sc, lineState); visibleChars++; } else if (sc.state == SCE_T3_X_DEFAULT && bracketLevel == 0 && sc.Match('>', '>')) { sc.Forward(2); sc.SetState(SCE_T3_D_STRING); if (lineState & T3_INT_EXPRESSION_IN_TAG) sc.SetState(SCE_T3_HTML_STRING); lineState &= ~(T3_SINGLE_QUOTE|T3_INT_EXPRESSION |T3_INT_EXPRESSION_IN_TAG); } else if (IsATADS3Operator(sc.ch)) { if (sc.state == SCE_T3_X_DEFAULT) { if (sc.ch == '(') { bracketLevel++; } else if (sc.ch == ')' && bracketLevel > 0) { bracketLevel--; } } ColouriseTADS3Operator(sc); visibleChars++; } else if (IsANumberStart(sc)) { ColouriseTADS3Number(sc); visibleChars++; } else if (IsAWordStart(sc.ch)) { ColouriseTADS3Keyword(sc, keywordlists, endPos); visibleChars++; } else if (sc.Match("...")) { sc.SetState(SCE_T3_IDENTIFIER); sc.Forward(3); sc.SetState(SCE_T3_DEFAULT); } else { sc.Forward(); visibleChars++; } break; default: sc.SetState(SCE_T3_DEFAULT); sc.Forward(); } } sc.Complete(); } /* TADS3 has two styles of top level block (TLB). Eg // default style silverKey : Key 'small silver key' 'small silver key' "A small key glints in the sunlight. " ; and silverKey : Key { 'small silver key' 'small silver key' "A small key glints in the sunlight. " } Some constructs mandate one or the other, but usually the author has may choose either. T3_SEENSTART is used to indicate that a braceless TLB has been (potentially) seen and is also used to match the closing ';' of the default style. T3_EXPECTINGIDENTIFIER and T3_EXPECTINGPUNCTUATION are used to keep track of what characters may be seen without incrementing the block level. The general pattern is identifier identifier, acceptable punctuation characters are ':', ',', '(' and ')'. No attempt is made to ensure that punctuation characters are syntactically correct, eg parentheses match. A ')' always signifies the start of a block. We just need to check if it is followed by a '{', in which case we let the brace handling code handle the folding level. expectingIdentifier == false && expectingIdentifier == false Before the start of a TLB. expectingIdentifier == true && expectingIdentifier == true Currently in an identifier. Will accept identifier or punctuation. expectingIdentifier == true && expectingIdentifier == false Just seen a punctuation character & now waiting for an identifier to start. expectingIdentifier == false && expectingIdentifier == truee We were in an identifier and have seen space. Now waiting to see a punctuation character Space, comments & preprocessor directives are always acceptable and are equivalent. */ static const int T3_SEENSTART = 1 << 12; static const int T3_EXPECTINGIDENTIFIER = 1 << 13; static const int T3_EXPECTINGPUNCTUATION = 1 << 14; static inline bool IsStringTransition(int s1, int s2) { return s1 != s2 && (s1 == SCE_T3_S_STRING || s1 == SCE_T3_X_STRING || (s1 == SCE_T3_D_STRING && s2 != SCE_T3_X_DEFAULT)) && s2 != SCE_T3_LIB_DIRECTIVE && s2 != SCE_T3_MSG_PARAM && s2 != SCE_T3_HTML_TAG && s2 != SCE_T3_HTML_STRING; } static inline bool IsATADS3Punctuation(const int ch) { return ch == ':' || ch == ',' || ch == '(' || ch == ')'; } static inline bool IsAnIdentifier(const int style) { return style == SCE_T3_IDENTIFIER || style == SCE_T3_USER1 || style == SCE_T3_USER2 || style == SCE_T3_USER3; } static inline bool IsAnOperator(const int style) { return style == SCE_T3_OPERATOR || style == SCE_T3_BRACE; } static inline bool IsSpaceEquivalent(const int ch, const int style) { return isspace(ch) || style == SCE_T3_BLOCK_COMMENT || style == SCE_T3_LINE_COMMENT || style == SCE_T3_PREPROCESSOR; } static char peekAhead(Sci_PositionU startPos, Sci_PositionU endPos, Accessor &styler) { for (Sci_PositionU i = startPos; i < endPos; i++) { int style = styler.StyleAt(i); char ch = styler[i]; if (!IsSpaceEquivalent(ch, style)) { if (IsAnIdentifier(style)) { return 'a'; } if (IsATADS3Punctuation(ch)) { return ':'; } if (ch == '{') { return '{'; } return '*'; } } return ' '; } static void FoldTADS3Doc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *[], Accessor &styler) { Sci_PositionU endPos = startPos + length; Sci_Position lineCurrent = styler.GetLine(startPos); int levelCurrent = SC_FOLDLEVELBASE; if (lineCurrent > 0) levelCurrent = styler.LevelAt(lineCurrent-1) >> 16; int seenStart = levelCurrent & T3_SEENSTART; int expectingIdentifier = levelCurrent & T3_EXPECTINGIDENTIFIER; int expectingPunctuation = levelCurrent & T3_EXPECTINGPUNCTUATION; levelCurrent &= SC_FOLDLEVELNUMBERMASK; int levelMinCurrent = levelCurrent; int levelNext = levelCurrent; char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); int style = initStyle; char ch = chNext; int stylePrev = style; bool redo = false; for (Sci_PositionU i = startPos; i < endPos; i++) { if (redo) { redo = false; i--; } else { ch = chNext; chNext = styler.SafeGetCharAt(i + 1); stylePrev = style; style = styleNext; styleNext = styler.StyleAt(i + 1); } bool atEOL = IsEOL(ch, chNext); if (levelNext == SC_FOLDLEVELBASE) { if (IsSpaceEquivalent(ch, style)) { if (expectingPunctuation) { expectingIdentifier = 0; } if (style == SCE_T3_BLOCK_COMMENT) { levelNext++; } } else if (ch == '{') { levelNext++; seenStart = 0; } else if (ch == '\'' || ch == '"' || ch == '[') { levelNext++; if (seenStart) { redo = true; } } else if (ch == ';') { seenStart = 0; expectingIdentifier = 0; expectingPunctuation = 0; } else if (expectingIdentifier && expectingPunctuation) { if (IsATADS3Punctuation(ch)) { if (ch == ')' && peekAhead(i+1, endPos, styler) != '{') { levelNext++; } else { expectingPunctuation = 0; } } else if (!IsAnIdentifier(style)) { levelNext++; } } else if (expectingIdentifier && !expectingPunctuation) { if (!IsAnIdentifier(style)) { levelNext++; } else { expectingPunctuation = T3_EXPECTINGPUNCTUATION; } } else if (!expectingIdentifier && expectingPunctuation) { if (!IsATADS3Punctuation(ch)) { levelNext++; } else { if (ch == ')' && peekAhead(i+1, endPos, styler) != '{') { levelNext++; } else { expectingIdentifier = T3_EXPECTINGIDENTIFIER; expectingPunctuation = 0; } } } else if (!expectingIdentifier && !expectingPunctuation) { if (IsAnIdentifier(style)) { seenStart = T3_SEENSTART; expectingIdentifier = T3_EXPECTINGIDENTIFIER; expectingPunctuation = T3_EXPECTINGPUNCTUATION; } } if (levelNext != SC_FOLDLEVELBASE && style != SCE_T3_BLOCK_COMMENT) { expectingIdentifier = 0; expectingPunctuation = 0; } } else if (levelNext == SC_FOLDLEVELBASE+1 && seenStart && ch == ';' && IsAnOperator(style)) { levelNext--; seenStart = 0; } else if (style == SCE_T3_BLOCK_COMMENT) { if (stylePrev != SCE_T3_BLOCK_COMMENT) { levelNext++; } else if (styleNext != SCE_T3_BLOCK_COMMENT && !atEOL) { // Comments don't end at end of line and the next character may be unstyled. levelNext--; } } else if (ch == '\'' || ch == '"') { if (IsStringTransition(style, stylePrev)) { if (levelMinCurrent > levelNext) { levelMinCurrent = levelNext; } levelNext++; } else if (IsStringTransition(style, styleNext)) { levelNext--; } } else if (IsAnOperator(style)) { if (ch == '{' || ch == '[') { // Measure the minimum before a '{' to allow // folding on "} else {" if (levelMinCurrent > levelNext) { levelMinCurrent = levelNext; } levelNext++; } else if (ch == '}' || ch == ']') { levelNext--; } } if (atEOL) { if (seenStart && levelNext == SC_FOLDLEVELBASE) { switch (peekAhead(i+1, endPos, styler)) { case ' ': case '{': break; case '*': levelNext++; break; case 'a': if (expectingPunctuation) { levelNext++; } break; case ':': if (expectingIdentifier) { levelNext++; } break; } if (levelNext != SC_FOLDLEVELBASE) { expectingIdentifier = 0; expectingPunctuation = 0; } } int lev = levelMinCurrent | (levelNext | expectingIdentifier | expectingPunctuation | seenStart) << 16; if (levelMinCurrent < levelNext) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelCurrent = levelNext; levelMinCurrent = levelCurrent; } } } static const char * const tads3WordList[] = { "TADS3 Keywords", "User defined 1", "User defined 2", "User defined 3", 0 }; LexerModule lmTADS3(SCLEX_TADS3, ColouriseTADS3Doc, "tads3", FoldTADS3Doc, tads3WordList); lexilla/lexers/LexCSS.cxx0000664000175000017500000004433214647367374014334 0ustar neilneil// Scintilla source code edit control // Encoding: UTF-8 /** @file LexCSS.cxx ** Lexer for Cascading Style Sheets ** Written by Jakub Vrána ** Improved by Philippe Lhoste (CSS2) ** Improved by Ross McKay (SCSS mode; see http://sass-lang.com/ ) **/ // Copyright 1998-2002 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. // TODO: handle SCSS nested properties like font: { weight: bold; size: 1em; } // TODO: handle SCSS interpolation: #{} // TODO: add features for Less if somebody feels like contributing; http://lesscss.org/ // TODO: refactor this monster so that the next poor slob can read it! #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static inline bool IsAWordChar(const unsigned int ch) { /* FIXME: * The CSS spec allows "ISO 10646 characters U+00A1 and higher" to be treated as word chars. * Unfortunately, we are only getting string bytes here, and not full unicode characters. We cannot guarantee * that our byte is between U+0080 - U+00A0 (to return false), so we have to allow all characters U+0080 and higher */ return ch >= 0x80 || isalnum(ch) || ch == '-' || ch == '_'; } inline bool IsCssOperator(const int ch) { if (!((ch < 0x80) && isalnum(ch)) && (ch == '{' || ch == '}' || ch == ':' || ch == ',' || ch == ';' || ch == '.' || ch == '#' || ch == '!' || ch == '@' || /* CSS2 */ ch == '*' || ch == '>' || ch == '+' || ch == '=' || ch == '~' || ch == '|' || ch == '[' || ch == ']' || ch == '(' || ch == ')')) { return true; } return false; } // look behind (from start of document to our start position) to determine current nesting level inline int NestingLevelLookBehind(Sci_PositionU startPos, Accessor &styler) { int ch; int nestingLevel = 0; for (Sci_PositionU i = 0; i < startPos; i++) { ch = styler.SafeGetCharAt(i); if (ch == '{') nestingLevel++; else if (ch == '}') nestingLevel--; } return nestingLevel; } static void ColouriseCssDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { WordList &css1Props = *keywordlists[0]; WordList &pseudoClasses = *keywordlists[1]; WordList &css2Props = *keywordlists[2]; WordList &css3Props = *keywordlists[3]; WordList &pseudoElements = *keywordlists[4]; WordList &exProps = *keywordlists[5]; WordList &exPseudoClasses = *keywordlists[6]; WordList &exPseudoElements = *keywordlists[7]; StyleContext sc(startPos, length, initStyle, styler); int lastState = -1; // before operator int lastStateC = -1; // before comment int lastStateS = -1; // before single-quoted/double-quoted string int lastStateVar = -1; // before variable (SCSS) int lastStateVal = -1; // before value (SCSS) int op = ' '; // last operator int opPrev = ' '; // last operator bool insideParentheses = false; // true if currently in a CSS url() or similar construct // property lexer.css.scss.language // Set to 1 for Sassy CSS (.scss) bool isScssDocument = styler.GetPropertyInt("lexer.css.scss.language") != 0; // property lexer.css.less.language // Set to 1 for Less CSS (.less) bool isLessDocument = styler.GetPropertyInt("lexer.css.less.language") != 0; // property lexer.css.hss.language // Set to 1 for HSS (.hss) bool isHssDocument = styler.GetPropertyInt("lexer.css.hss.language") != 0; // SCSS/LESS/HSS have the concept of variable bool hasVariables = isScssDocument || isLessDocument || isHssDocument; char varPrefix = 0; if (hasVariables) varPrefix = isLessDocument ? '@' : '$'; // SCSS/LESS/HSS support single-line comments typedef enum _CommentModes { eCommentBlock = 0, eCommentLine = 1} CommentMode; CommentMode comment_mode = eCommentBlock; bool hasSingleLineComments = isScssDocument || isLessDocument || isHssDocument; // must keep track of nesting level in document types that support it (SCSS/LESS/HSS) bool hasNesting = false; int nestingLevel = 0; if (isScssDocument || isLessDocument || isHssDocument) { hasNesting = true; nestingLevel = NestingLevelLookBehind(startPos, styler); } // "the loop" for (; sc.More(); sc.Forward()) { if (sc.state == SCE_CSS_COMMENT && ((comment_mode == eCommentBlock && sc.Match('*', '/')) || (comment_mode == eCommentLine && sc.atLineEnd))) { if (lastStateC == -1) { // backtrack to get last state: // comments are like whitespace, so we must return to the previous state Sci_PositionU i = startPos; for (; i > 0; i--) { if ((lastStateC = styler.StyleAt(i-1)) != SCE_CSS_COMMENT) { if (lastStateC == SCE_CSS_OPERATOR) { op = styler.SafeGetCharAt(i-1); opPrev = styler.SafeGetCharAt(i-2); while (--i) { lastState = styler.StyleAt(i-1); if (lastState != SCE_CSS_OPERATOR && lastState != SCE_CSS_COMMENT) break; } if (i == 0) lastState = SCE_CSS_DEFAULT; } break; } } if (i == 0) lastStateC = SCE_CSS_DEFAULT; } if (comment_mode == eCommentBlock) { sc.Forward(); sc.ForwardSetState(lastStateC); } else /* eCommentLine */ { sc.SetState(lastStateC); } } if (sc.state == SCE_CSS_COMMENT) continue; if (sc.state == SCE_CSS_DOUBLESTRING || sc.state == SCE_CSS_SINGLESTRING) { if (sc.ch != (sc.state == SCE_CSS_DOUBLESTRING ? '\"' : '\'')) continue; Sci_PositionU i = sc.currentPos; while (i && styler[i-1] == '\\') i--; if ((sc.currentPos - i) % 2 == 1) continue; sc.ForwardSetState(lastStateS); } if (sc.state == SCE_CSS_OPERATOR) { if (op == ' ') { Sci_PositionU i = startPos; op = styler.SafeGetCharAt(i-1); opPrev = styler.SafeGetCharAt(i-2); while (--i) { lastState = styler.StyleAt(i-1); if (lastState != SCE_CSS_OPERATOR && lastState != SCE_CSS_COMMENT) break; } } switch (op) { case '@': if (lastState == SCE_CSS_DEFAULT || hasNesting) sc.SetState(SCE_CSS_DIRECTIVE); break; case '>': case '+': if (lastState == SCE_CSS_TAG || lastState == SCE_CSS_CLASS || lastState == SCE_CSS_ID || lastState == SCE_CSS_PSEUDOCLASS || lastState == SCE_CSS_EXTENDED_PSEUDOCLASS || lastState == SCE_CSS_UNKNOWN_PSEUDOCLASS) sc.SetState(SCE_CSS_DEFAULT); break; case '[': if (lastState == SCE_CSS_TAG || lastState == SCE_CSS_DEFAULT || lastState == SCE_CSS_CLASS || lastState == SCE_CSS_ID || lastState == SCE_CSS_PSEUDOCLASS || lastState == SCE_CSS_EXTENDED_PSEUDOCLASS || lastState == SCE_CSS_UNKNOWN_PSEUDOCLASS) sc.SetState(SCE_CSS_ATTRIBUTE); break; case ']': if (lastState == SCE_CSS_ATTRIBUTE) sc.SetState(SCE_CSS_TAG); break; case '{': nestingLevel++; switch (lastState) { case SCE_CSS_GROUP_RULE: sc.SetState(SCE_CSS_DEFAULT); break; case SCE_CSS_TAG: case SCE_CSS_DIRECTIVE: sc.SetState(SCE_CSS_IDENTIFIER); break; } break; case '}': if (--nestingLevel < 0) nestingLevel = 0; switch (lastState) { case SCE_CSS_DEFAULT: case SCE_CSS_VALUE: case SCE_CSS_IMPORTANT: case SCE_CSS_IDENTIFIER: case SCE_CSS_IDENTIFIER2: case SCE_CSS_IDENTIFIER3: if (hasNesting) sc.SetState(nestingLevel > 0 ? SCE_CSS_IDENTIFIER : SCE_CSS_DEFAULT); else sc.SetState(SCE_CSS_DEFAULT); break; } break; case '(': if (lastState == SCE_CSS_PSEUDOCLASS) sc.SetState(SCE_CSS_TAG); else if (lastState == SCE_CSS_EXTENDED_PSEUDOCLASS) sc.SetState(SCE_CSS_EXTENDED_PSEUDOCLASS); break; case ')': if (lastState == SCE_CSS_TAG || lastState == SCE_CSS_DEFAULT || lastState == SCE_CSS_CLASS || lastState == SCE_CSS_ID || lastState == SCE_CSS_PSEUDOCLASS || lastState == SCE_CSS_EXTENDED_PSEUDOCLASS || lastState == SCE_CSS_UNKNOWN_PSEUDOCLASS || lastState == SCE_CSS_PSEUDOELEMENT || lastState == SCE_CSS_EXTENDED_PSEUDOELEMENT) sc.SetState(SCE_CSS_TAG); break; case ':': switch (lastState) { case SCE_CSS_TAG: case SCE_CSS_DEFAULT: case SCE_CSS_CLASS: case SCE_CSS_ID: case SCE_CSS_PSEUDOCLASS: case SCE_CSS_EXTENDED_PSEUDOCLASS: case SCE_CSS_UNKNOWN_PSEUDOCLASS: case SCE_CSS_PSEUDOELEMENT: case SCE_CSS_EXTENDED_PSEUDOELEMENT: sc.SetState(SCE_CSS_PSEUDOCLASS); break; case SCE_CSS_IDENTIFIER: case SCE_CSS_IDENTIFIER2: case SCE_CSS_IDENTIFIER3: case SCE_CSS_EXTENDED_IDENTIFIER: case SCE_CSS_UNKNOWN_IDENTIFIER: case SCE_CSS_VARIABLE: sc.SetState(SCE_CSS_VALUE); lastStateVal = lastState; break; } break; case '.': if (lastState == SCE_CSS_TAG || lastState == SCE_CSS_DEFAULT || lastState == SCE_CSS_CLASS || lastState == SCE_CSS_ID || lastState == SCE_CSS_PSEUDOCLASS || lastState == SCE_CSS_EXTENDED_PSEUDOCLASS || lastState == SCE_CSS_UNKNOWN_PSEUDOCLASS) sc.SetState(SCE_CSS_CLASS); break; case '#': if (lastState == SCE_CSS_TAG || lastState == SCE_CSS_DEFAULT || lastState == SCE_CSS_CLASS || lastState == SCE_CSS_ID || lastState == SCE_CSS_PSEUDOCLASS || lastState == SCE_CSS_EXTENDED_PSEUDOCLASS || lastState == SCE_CSS_UNKNOWN_PSEUDOCLASS) sc.SetState(SCE_CSS_ID); break; case ',': case '|': case '~': if (lastState == SCE_CSS_TAG) sc.SetState(SCE_CSS_DEFAULT); break; case ';': switch (lastState) { case SCE_CSS_DIRECTIVE: if (hasNesting) { sc.SetState(nestingLevel > 0 ? SCE_CSS_IDENTIFIER : SCE_CSS_DEFAULT); } else { sc.SetState(SCE_CSS_DEFAULT); } break; case SCE_CSS_VALUE: case SCE_CSS_IMPORTANT: // data URLs can have semicolons; simplistically check for wrapping parentheses and move along if (insideParentheses) { sc.SetState(lastState); } else { if (lastStateVal == SCE_CSS_VARIABLE) { sc.SetState(SCE_CSS_DEFAULT); } else { sc.SetState(SCE_CSS_IDENTIFIER); } } break; case SCE_CSS_VARIABLE: if (lastStateVar == SCE_CSS_VALUE) { // data URLs can have semicolons; simplistically check for wrapping parentheses and move along if (insideParentheses) { sc.SetState(SCE_CSS_VALUE); } else { sc.SetState(SCE_CSS_IDENTIFIER); } } else { sc.SetState(SCE_CSS_DEFAULT); } break; } break; case '!': if (lastState == SCE_CSS_VALUE) sc.SetState(SCE_CSS_IMPORTANT); break; } } if (sc.ch == '*' && sc.state == SCE_CSS_DEFAULT) { sc.SetState(SCE_CSS_TAG); continue; } // check for inside parentheses (whether part of an "operator" or not) if (sc.ch == '(') insideParentheses = true; else if (sc.ch == ')') insideParentheses = false; // SCSS special modes if (hasVariables) { // variable name if (sc.ch == varPrefix) { switch (sc.state) { case SCE_CSS_DEFAULT: if (isLessDocument) // give priority to pseudo elements break; // Falls through. case SCE_CSS_VALUE: lastStateVar = sc.state; sc.SetState(SCE_CSS_VARIABLE); continue; } } if (sc.state == SCE_CSS_VARIABLE) { if (IsAWordChar(sc.ch)) { // still looking at the variable name continue; } if (lastStateVar == SCE_CSS_VALUE) { // not looking at the variable name any more, and it was part of a value sc.SetState(SCE_CSS_VALUE); } } // nested rule parent selector if (sc.ch == '&') { switch (sc.state) { case SCE_CSS_DEFAULT: case SCE_CSS_IDENTIFIER: sc.SetState(SCE_CSS_TAG); continue; } } } // nesting rules that apply to SCSS and Less if (hasNesting) { // check for nested rule selector if (sc.state == SCE_CSS_IDENTIFIER && (IsAWordChar(sc.ch) || sc.ch == ':' || sc.ch == '.' || sc.ch == '#')) { // look ahead to see whether { comes before next ; and } Sci_PositionU endPos = startPos + length; int ch; for (Sci_PositionU i = sc.currentPos; i < endPos; i++) { ch = styler.SafeGetCharAt(i); if (ch == ';' || ch == '}') break; if (ch == '{') { sc.SetState(SCE_CSS_DEFAULT); continue; } } } } if (IsAWordChar(sc.ch)) { if (sc.state == SCE_CSS_DEFAULT) sc.SetState(SCE_CSS_TAG); continue; } if (IsAWordChar(sc.chPrev) && ( sc.state == SCE_CSS_IDENTIFIER || sc.state == SCE_CSS_IDENTIFIER2 || sc.state == SCE_CSS_IDENTIFIER3 || sc.state == SCE_CSS_EXTENDED_IDENTIFIER || sc.state == SCE_CSS_UNKNOWN_IDENTIFIER || sc.state == SCE_CSS_PSEUDOCLASS || sc.state == SCE_CSS_PSEUDOELEMENT || sc.state == SCE_CSS_EXTENDED_PSEUDOCLASS || sc.state == SCE_CSS_EXTENDED_PSEUDOELEMENT || sc.state == SCE_CSS_UNKNOWN_PSEUDOCLASS || sc.state == SCE_CSS_IMPORTANT || sc.state == SCE_CSS_DIRECTIVE )) { char s[100]; sc.GetCurrentLowered(s, sizeof(s)); char *s2 = s; while (*s2 && !IsAWordChar(*s2)) s2++; switch (sc.state) { case SCE_CSS_IDENTIFIER: case SCE_CSS_IDENTIFIER2: case SCE_CSS_IDENTIFIER3: case SCE_CSS_EXTENDED_IDENTIFIER: case SCE_CSS_UNKNOWN_IDENTIFIER: if (css1Props.InList(s2)) sc.ChangeState(SCE_CSS_IDENTIFIER); else if (css2Props.InList(s2)) sc.ChangeState(SCE_CSS_IDENTIFIER2); else if (css3Props.InList(s2)) sc.ChangeState(SCE_CSS_IDENTIFIER3); else if (exProps.InList(s2)) sc.ChangeState(SCE_CSS_EXTENDED_IDENTIFIER); else sc.ChangeState(SCE_CSS_UNKNOWN_IDENTIFIER); break; case SCE_CSS_PSEUDOCLASS: case SCE_CSS_PSEUDOELEMENT: case SCE_CSS_EXTENDED_PSEUDOCLASS: case SCE_CSS_EXTENDED_PSEUDOELEMENT: case SCE_CSS_UNKNOWN_PSEUDOCLASS: if (op == ':' && opPrev != ':' && pseudoClasses.InList(s2)) sc.ChangeState(SCE_CSS_PSEUDOCLASS); else if (opPrev == ':' && pseudoElements.InList(s2)) sc.ChangeState(SCE_CSS_PSEUDOELEMENT); else if ((op == ':' || (op == '(' && lastState == SCE_CSS_EXTENDED_PSEUDOCLASS)) && opPrev != ':' && exPseudoClasses.InList(s2)) sc.ChangeState(SCE_CSS_EXTENDED_PSEUDOCLASS); else if (opPrev == ':' && exPseudoElements.InList(s2)) sc.ChangeState(SCE_CSS_EXTENDED_PSEUDOELEMENT); else sc.ChangeState(SCE_CSS_UNKNOWN_PSEUDOCLASS); break; case SCE_CSS_IMPORTANT: if (strcmp(s2, "important") != 0) sc.ChangeState(SCE_CSS_VALUE); break; case SCE_CSS_DIRECTIVE: if (op == '@' && (strcmp(s2, "media") == 0 || strcmp(s2, "supports") == 0 || strcmp(s2, "document") == 0 || strcmp(s2, "-moz-document") == 0)) sc.ChangeState(SCE_CSS_GROUP_RULE); break; } } if (sc.ch != '.' && sc.ch != ':' && sc.ch != '#' && ( sc.state == SCE_CSS_CLASS || sc.state == SCE_CSS_ID || (sc.ch != '(' && sc.ch != ')' && ( /* This line of the condition makes it possible to extend pseudo-classes with parentheses */ sc.state == SCE_CSS_PSEUDOCLASS || sc.state == SCE_CSS_PSEUDOELEMENT || sc.state == SCE_CSS_EXTENDED_PSEUDOCLASS || sc.state == SCE_CSS_EXTENDED_PSEUDOELEMENT || sc.state == SCE_CSS_UNKNOWN_PSEUDOCLASS )) )) sc.SetState(SCE_CSS_TAG); if (sc.Match('/', '*')) { lastStateC = sc.state; comment_mode = eCommentBlock; sc.SetState(SCE_CSS_COMMENT); sc.Forward(); } else if (hasSingleLineComments && sc.Match('/', '/') && !insideParentheses) { // note that we've had to treat ([...]// as the start of a URL not a comment, e.g. url(http://example.com), url(//example.com) lastStateC = sc.state; comment_mode = eCommentLine; sc.SetState(SCE_CSS_COMMENT); sc.Forward(); } else if ((sc.state == SCE_CSS_VALUE || sc.state == SCE_CSS_ATTRIBUTE) && (sc.ch == '\"' || sc.ch == '\'')) { lastStateS = sc.state; sc.SetState((sc.ch == '\"' ? SCE_CSS_DOUBLESTRING : SCE_CSS_SINGLESTRING)); } else if (IsCssOperator(sc.ch) && (sc.state != SCE_CSS_ATTRIBUTE || sc.ch == ']') && (sc.state != SCE_CSS_VALUE || sc.ch == ';' || sc.ch == '}' || sc.ch == '!') && ((sc.state != SCE_CSS_DIRECTIVE && sc.state != SCE_CSS_GROUP_RULE) || sc.ch == ';' || sc.ch == '{') ) { if (sc.state != SCE_CSS_OPERATOR) lastState = sc.state; sc.SetState(SCE_CSS_OPERATOR); op = sc.ch; opPrev = sc.chPrev; } } sc.Complete(); } static void FoldCSSDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { bool foldComment = styler.GetPropertyInt("fold.comment") != 0; bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelPrev = styler.LevelAt(lineCurrent) & SC_FOLDLEVELNUMBERMASK; int levelCurrent = levelPrev; char chNext = styler[startPos]; bool inComment = (styler.StyleAt(startPos-1) == SCE_CSS_COMMENT); for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); int style = styler.StyleAt(i); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (foldComment) { if (!inComment && (style == SCE_CSS_COMMENT)) levelCurrent++; else if (inComment && (style != SCE_CSS_COMMENT)) levelCurrent--; inComment = (style == SCE_CSS_COMMENT); } if (style == SCE_CSS_OPERATOR) { if (ch == '{') { levelCurrent++; } else if (ch == '}') { levelCurrent--; } } if (atEOL) { int lev = levelPrev; if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if ((levelCurrent > levelPrev) && (visibleChars > 0)) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelPrev = levelCurrent; visibleChars = 0; } if (!isspacechar(ch)) visibleChars++; } // Fill in the real level of the next line, keeping the current flags as they will be filled in later int flagsNext = styler.LevelAt(lineCurrent) & ~SC_FOLDLEVELNUMBERMASK; styler.SetLevel(lineCurrent, levelPrev | flagsNext); } static const char * const cssWordListDesc[] = { "CSS1 Properties", "Pseudo-classes", "CSS2 Properties", "CSS3 Properties", "Pseudo-elements", "Browser-Specific CSS Properties", "Browser-Specific Pseudo-classes", "Browser-Specific Pseudo-elements", 0 }; LexerModule lmCss(SCLEX_CSS, ColouriseCssDoc, "css", FoldCSSDoc, cssWordListDesc); lexilla/lexers/LexCmake.cxx0000664000175000017500000003670714647367374014733 0ustar neilneil// Scintilla source code edit control /** @file LexCmake.cxx ** Lexer for Cmake **/ // Copyright 2007 by Cristian Adam // based on the NSIS lexer // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static bool isCmakeNumber(char ch) { return(ch >= '0' && ch <= '9'); } static bool isCmakeChar(char ch) { return(ch == '.' ) || (ch == '_' ) || isCmakeNumber(ch) || (ch >= 'A' && ch <= 'Z') || (ch >= 'a' && ch <= 'z'); } static bool isCmakeLetter(char ch) { return(ch >= 'A' && ch <= 'Z') || (ch >= 'a' && ch <= 'z'); } static bool CmakeNextLineHasElse(Sci_PositionU start, Sci_PositionU end, Accessor &styler) { Sci_Position nNextLine = -1; for ( Sci_PositionU i = start; i < end; i++ ) { char cNext = styler.SafeGetCharAt( i ); if ( cNext == '\n' ) { nNextLine = i+1; break; } } if ( nNextLine == -1 ) // We never foudn the next line... return false; for ( Sci_PositionU firstChar = nNextLine; firstChar < end; firstChar++ ) { char cNext = styler.SafeGetCharAt( firstChar ); if ( cNext == ' ' ) continue; if ( cNext == '\t' ) continue; if ( styler.Match(firstChar, "ELSE") || styler.Match(firstChar, "else")) return true; break; } return false; } static int calculateFoldCmake(Sci_PositionU start, Sci_PositionU end, int foldlevel, Accessor &styler, bool bElse) { // If the word is too long, it is not what we are looking for if ( end - start > 20 ) return foldlevel; int newFoldlevel = foldlevel; char s[20]; // The key word we are looking for has atmost 13 characters for (unsigned int i = 0; i < end - start + 1 && i < 19; i++) { s[i] = static_cast( styler[ start + i ] ); s[i + 1] = '\0'; } if ( CompareCaseInsensitive(s, "IF") == 0 || CompareCaseInsensitive(s, "WHILE") == 0 || CompareCaseInsensitive(s, "MACRO") == 0 || CompareCaseInsensitive(s, "FOREACH") == 0 || CompareCaseInsensitive(s, "FUNCTION") == 0) newFoldlevel++; else if ( CompareCaseInsensitive(s, "ENDIF") == 0 || CompareCaseInsensitive(s, "ENDWHILE") == 0 || CompareCaseInsensitive(s, "ENDMACRO") == 0 || CompareCaseInsensitive(s, "ENDFOREACH") == 0 || CompareCaseInsensitive(s, "ENDFUNCTION") == 0) newFoldlevel--; else if ( bElse && CompareCaseInsensitive(s, "ELSEIF") == 0 ) newFoldlevel++; else if ( bElse && CompareCaseInsensitive(s, "ELSE") == 0 ) newFoldlevel++; return newFoldlevel; } static int classifyWordCmake(Sci_PositionU start, Sci_PositionU end, WordList *keywordLists[], Accessor &styler ) { char word[100] = {0}; char lowercaseWord[100] = {0}; WordList &Commands = *keywordLists[0]; WordList &Parameters = *keywordLists[1]; WordList &UserDefined = *keywordLists[2]; for (Sci_PositionU i = 0; i < end - start + 1 && i < 99; i++) { word[i] = static_cast( styler[ start + i ] ); lowercaseWord[i] = static_cast(tolower(word[i])); } // Check for special words... if ( CompareCaseInsensitive(word, "MACRO") == 0 || CompareCaseInsensitive(word, "ENDMACRO") == 0 ) return SCE_CMAKE_MACRODEF; if ( CompareCaseInsensitive(word, "IF") == 0 || CompareCaseInsensitive(word, "ENDIF") == 0 ) return SCE_CMAKE_IFDEFINEDEF; if ( CompareCaseInsensitive(word, "ELSEIF") == 0 || CompareCaseInsensitive(word, "ELSE") == 0 ) return SCE_CMAKE_IFDEFINEDEF; if ( CompareCaseInsensitive(word, "WHILE") == 0 || CompareCaseInsensitive(word, "ENDWHILE") == 0) return SCE_CMAKE_WHILEDEF; if ( CompareCaseInsensitive(word, "FOREACH") == 0 || CompareCaseInsensitive(word, "ENDFOREACH") == 0) return SCE_CMAKE_FOREACHDEF; if ( Commands.InList(lowercaseWord) ) return SCE_CMAKE_COMMANDS; if ( Parameters.InList(word) ) return SCE_CMAKE_PARAMETERS; if ( UserDefined.InList(word) ) return SCE_CMAKE_USERDEFINED; if ( strlen(word) > 3 ) { if ( word[1] == '{' && word[strlen(word)-1] == '}' ) return SCE_CMAKE_VARIABLE; } // To check for numbers if ( isCmakeNumber( word[0] ) ) { bool bHasSimpleCmakeNumber = true; for (unsigned int j = 1; j < end - start + 1 && j < 99; j++) { if ( !isCmakeNumber( word[j] ) ) { bHasSimpleCmakeNumber = false; break; } } if ( bHasSimpleCmakeNumber ) return SCE_CMAKE_NUMBER; } return SCE_CMAKE_DEFAULT; } static void ColouriseCmakeDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *keywordLists[], Accessor &styler) { int state = SCE_CMAKE_DEFAULT; if ( startPos > 0 ) state = styler.StyleAt(startPos-1); // Use the style from the previous line, usually default, but could be commentbox styler.StartAt( startPos ); styler.GetLine( startPos ); Sci_PositionU nLengthDoc = startPos + length; styler.StartSegment( startPos ); char cCurrChar; bool bVarInString = false; bool bClassicVarInString = false; Sci_PositionU i; for ( i = startPos; i < nLengthDoc; i++ ) { cCurrChar = styler.SafeGetCharAt( i ); char cNextChar = styler.SafeGetCharAt(i+1); switch (state) { case SCE_CMAKE_DEFAULT: if ( cCurrChar == '#' ) { // we have a comment line styler.ColourTo(i-1, state ); state = SCE_CMAKE_COMMENT; break; } if ( cCurrChar == '"' ) { styler.ColourTo(i-1, state ); state = SCE_CMAKE_STRINGDQ; bVarInString = false; bClassicVarInString = false; break; } if ( cCurrChar == '\'' ) { styler.ColourTo(i-1, state ); state = SCE_CMAKE_STRINGRQ; bVarInString = false; bClassicVarInString = false; break; } if ( cCurrChar == '`' ) { styler.ColourTo(i-1, state ); state = SCE_CMAKE_STRINGLQ; bVarInString = false; bClassicVarInString = false; break; } // CMake Variable if ( cCurrChar == '$' || isCmakeChar(cCurrChar)) { styler.ColourTo(i-1,state); state = SCE_CMAKE_VARIABLE; // If it is a number, we must check and set style here first... if ( isCmakeNumber(cCurrChar) && (cNextChar == '\t' || cNextChar == ' ' || cNextChar == '\r' || cNextChar == '\n' ) ) styler.ColourTo( i, SCE_CMAKE_NUMBER); break; } break; case SCE_CMAKE_COMMENT: if ( cCurrChar == '\n' || cCurrChar == '\r' ) { if ( styler.SafeGetCharAt(i-1) == '\\' ) { styler.ColourTo(i-2,state); styler.ColourTo(i-1,SCE_CMAKE_DEFAULT); } else { styler.ColourTo(i-1,state); state = SCE_CMAKE_DEFAULT; } } break; case SCE_CMAKE_STRINGDQ: case SCE_CMAKE_STRINGLQ: case SCE_CMAKE_STRINGRQ: if ( styler.SafeGetCharAt(i-1) == '\\' && styler.SafeGetCharAt(i-2) == '$' ) break; // Ignore the next character, even if it is a quote of some sort if ( cCurrChar == '"' && state == SCE_CMAKE_STRINGDQ ) { styler.ColourTo(i,state); state = SCE_CMAKE_DEFAULT; break; } if ( cCurrChar == '`' && state == SCE_CMAKE_STRINGLQ ) { styler.ColourTo(i,state); state = SCE_CMAKE_DEFAULT; break; } if ( cCurrChar == '\'' && state == SCE_CMAKE_STRINGRQ ) { styler.ColourTo(i,state); state = SCE_CMAKE_DEFAULT; break; } if ( cNextChar == '\r' || cNextChar == '\n' ) { Sci_Position nCurLine = styler.GetLine(i+1); Sci_Position nBack = i; // We need to check if the previous line has a \ in it... bool bNextLine = false; while ( nBack > 0 ) { if ( styler.GetLine(nBack) != nCurLine ) break; char cTemp = styler.SafeGetCharAt(nBack, 'a'); // Letter 'a' is safe here if ( cTemp == '\\' ) { bNextLine = true; break; } if ( cTemp != '\r' && cTemp != '\n' && cTemp != '\t' && cTemp != ' ' ) break; nBack--; } if ( bNextLine ) { styler.ColourTo(i+1,state); } if ( bNextLine == false ) { styler.ColourTo(i,state); state = SCE_CMAKE_DEFAULT; } } break; case SCE_CMAKE_VARIABLE: // CMake Variable: if ( cCurrChar == '$' ) state = SCE_CMAKE_DEFAULT; else if ( cCurrChar == '\\' && (cNextChar == 'n' || cNextChar == 'r' || cNextChar == 't' ) ) state = SCE_CMAKE_DEFAULT; else if ( (isCmakeChar(cCurrChar) && !isCmakeChar( cNextChar) && cNextChar != '}') || cCurrChar == '}' ) { state = classifyWordCmake( styler.GetStartSegment(), i, keywordLists, styler ); styler.ColourTo( i, state); state = SCE_CMAKE_DEFAULT; } else if ( !isCmakeChar( cCurrChar ) && cCurrChar != '{' && cCurrChar != '}' ) { if ( classifyWordCmake( styler.GetStartSegment(), i-1, keywordLists, styler) == SCE_CMAKE_NUMBER ) styler.ColourTo( i-1, SCE_CMAKE_NUMBER ); state = SCE_CMAKE_DEFAULT; if ( cCurrChar == '"' ) { state = SCE_CMAKE_STRINGDQ; bVarInString = false; bClassicVarInString = false; } else if ( cCurrChar == '`' ) { state = SCE_CMAKE_STRINGLQ; bVarInString = false; bClassicVarInString = false; } else if ( cCurrChar == '\'' ) { state = SCE_CMAKE_STRINGRQ; bVarInString = false; bClassicVarInString = false; } else if ( cCurrChar == '#' ) { state = SCE_CMAKE_COMMENT; } } break; } if ( state == SCE_CMAKE_STRINGDQ || state == SCE_CMAKE_STRINGLQ || state == SCE_CMAKE_STRINGRQ ) { bool bIngoreNextDollarSign = false; if ( bVarInString && cCurrChar == '$' ) { bVarInString = false; bIngoreNextDollarSign = true; } else if ( bVarInString && cCurrChar == '\\' && (cNextChar == 'n' || cNextChar == 'r' || cNextChar == 't' || cNextChar == '"' || cNextChar == '`' || cNextChar == '\'' ) ) { styler.ColourTo( i+1, SCE_CMAKE_STRINGVAR); bVarInString = false; bIngoreNextDollarSign = false; } else if ( bVarInString && !isCmakeChar(cNextChar) ) { int nWordState = classifyWordCmake( styler.GetStartSegment(), i, keywordLists, styler); if ( nWordState == SCE_CMAKE_VARIABLE ) styler.ColourTo( i, SCE_CMAKE_STRINGVAR); bVarInString = false; } // Covers "${TEST}..." else if ( bClassicVarInString && cNextChar == '}' ) { styler.ColourTo( i+1, SCE_CMAKE_STRINGVAR); bClassicVarInString = false; } // Start of var in string if ( !bIngoreNextDollarSign && cCurrChar == '$' && cNextChar == '{' ) { styler.ColourTo( i-1, state); bClassicVarInString = true; bVarInString = false; } else if ( !bIngoreNextDollarSign && cCurrChar == '$' ) { styler.ColourTo( i-1, state); bVarInString = true; bClassicVarInString = false; } } } // Colourise remaining document styler.ColourTo(nLengthDoc-1,state); } static void FoldCmakeDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { // No folding enabled, no reason to continue... if ( styler.GetPropertyInt("fold") == 0 ) return; bool foldAtElse = styler.GetPropertyInt("fold.at.else", 0) == 1; Sci_Position lineCurrent = styler.GetLine(startPos); Sci_PositionU safeStartPos = styler.LineStart( lineCurrent ); bool bArg1 = true; Sci_Position nWordStart = -1; int levelCurrent = SC_FOLDLEVELBASE; if (lineCurrent > 0) levelCurrent = styler.LevelAt(lineCurrent-1) >> 16; int levelNext = levelCurrent; for (Sci_PositionU i = safeStartPos; i < startPos + length; i++) { char chCurr = styler.SafeGetCharAt(i); if ( bArg1 ) { if ( nWordStart == -1 && (isCmakeLetter(chCurr)) ) { nWordStart = i; } else if ( isCmakeLetter(chCurr) == false && nWordStart > -1 ) { int newLevel = calculateFoldCmake( nWordStart, i-1, levelNext, styler, foldAtElse); if ( newLevel == levelNext ) { if ( foldAtElse ) { if ( CmakeNextLineHasElse(i, startPos + length, styler) ) levelNext--; } } else levelNext = newLevel; bArg1 = false; } } if ( chCurr == '\n' ) { if ( bArg1 && foldAtElse) { if ( CmakeNextLineHasElse(i, startPos + length, styler) ) levelNext--; } // If we are on a new line... int levelUse = levelCurrent; int lev = levelUse | levelNext << 16; if (levelUse < levelNext ) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) styler.SetLevel(lineCurrent, lev); lineCurrent++; levelCurrent = levelNext; bArg1 = true; // New line, lets look at first argument again nWordStart = -1; } } int levelUse = levelCurrent; int lev = levelUse | levelNext << 16; if (levelUse < levelNext) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) styler.SetLevel(lineCurrent, lev); } static const char * const cmakeWordLists[] = { "Commands", "Parameters", "UserDefined", 0, 0,}; LexerModule lmCmake(SCLEX_CMAKE, ColouriseCmakeDoc, "cmake", FoldCmakeDoc, cmakeWordLists); lexilla/lexers/LexPython.cxx0000664000175000017500000011204014647367374015155 0ustar neilneil// Scintilla source code edit control /** @file LexPython.cxx ** Lexer for Python. **/ // Copyright 1998-2002 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "CharacterCategory.h" #include "LexerModule.h" #include "OptionSet.h" #include "SubStyles.h" #include "DefaultLexer.h" using namespace Scintilla; using namespace Lexilla; namespace { // Use an unnamed namespace to protect the functions and classes from name conflicts /* Notes on f-strings: f-strings are strings prefixed with f (e.g. f'') that may have arbitrary expressions in {}. The tokens in the expressions are lexed as if they were outside of any string. Expressions may contain { and } characters as long as there is a closing } for every {, may be 2+ lines in a triple quoted string, and may have a formatting specifier following a ! or :, but both ! and : are valid inside of a bracketed expression and != is a valid expression token even outside of a bracketed expression. When in an f-string expression, the lexer keeps track of the state value of the f-string and the nesting count for the expression (# of [, (, { seen - # of }, ), ] seen). f-strings may be nested (e.g. f'{ a + f"{1+2}"') so a stack of states and nesting counts is kept. If a f-string expression continues beyond the end of a line, this stack is saved in a std::map that maps a line number to the stack at the end of that line. std::vector is used for the stack. The PEP for f-strings is at https://www.python.org/dev/peps/pep-0498/ */ struct SingleFStringExpState { int state; int nestingCount; }; /* kwCDef, kwCTypeName only used for Cython */ enum kwType { kwOther, kwClass, kwDef, kwImport, kwCDef, kwCTypeName, kwCPDef }; enum literalsAllowed { litNone = 0, litU = 1, litB = 2, litF = 4 }; constexpr int indicatorWhitespace = 1; bool IsPyComment(Accessor &styler, Sci_Position pos, Sci_Position len) { return len > 0 && styler[pos] == '#'; } constexpr bool IsPyStringTypeChar(int ch, literalsAllowed allowed) noexcept { return ((allowed & litB) && (ch == 'b' || ch == 'B')) || ((allowed & litU) && (ch == 'u' || ch == 'U')) || ((allowed & litF) && (ch == 'f' || ch == 'F')); } constexpr bool IsQuote(int ch) { return AnyOf(ch, '"', '\''); } constexpr bool IsRawPrefix(int ch) { return AnyOf(ch, 'r', 'R'); } bool IsPyStringStart(int ch, int chNext, int chNext2, literalsAllowed allowed) noexcept { // To cover both python2 and python3 lex character prefixes as -- // ur'' is a string, but ru'' is not // fr'', rf'', br'', rb'' are all strings if (IsQuote(ch)) return true; if (IsPyStringTypeChar(ch, allowed)) { if (IsQuote(chNext)) return true; if (IsRawPrefix(chNext) && IsQuote(chNext2)) return true; } if (IsRawPrefix(ch)) { if (IsQuote(chNext)) return true; if (IsPyStringTypeChar(chNext, allowed) && !AnyOf(chNext, 'u', 'U') && IsQuote(chNext2)) return true; } return false; } constexpr bool IsPyFStringState(int st) noexcept { return AnyOf(st, SCE_P_FCHARACTER, SCE_P_FSTRING, SCE_P_FTRIPLE, SCE_P_FTRIPLEDOUBLE); } constexpr bool IsPySingleQuoteStringState(int st) noexcept { return AnyOf(st, SCE_P_CHARACTER, SCE_P_STRING, SCE_P_FCHARACTER, SCE_P_FSTRING); } constexpr bool IsPyTripleQuoteStringState(int st) noexcept { return AnyOf(st, SCE_P_TRIPLE, SCE_P_TRIPLEDOUBLE, SCE_P_FTRIPLE, SCE_P_FTRIPLEDOUBLE); } char GetPyStringQuoteChar(int st) noexcept { if (AnyOf(st, SCE_P_CHARACTER, SCE_P_FCHARACTER, SCE_P_TRIPLE, SCE_P_FTRIPLE)) return '\''; if (AnyOf(st, SCE_P_STRING, SCE_P_FSTRING, SCE_P_TRIPLEDOUBLE, SCE_P_FTRIPLEDOUBLE)) return '"'; return '\0'; } void PushStateToStack(int state, std::vector &stack, SingleFStringExpState *¤tFStringExp) { const SingleFStringExpState single = {state, 0}; stack.push_back(single); currentFStringExp = &stack.back(); } int PopFromStateStack(std::vector &stack, SingleFStringExpState *¤tFStringExp) noexcept { int state = 0; if (!stack.empty()) { state = stack.back().state; stack.pop_back(); } if (stack.empty()) { currentFStringExp = nullptr; } else { currentFStringExp = &stack.back(); } return state; } /* Return the state to use for the string starting at i; *nextIndex will be set to the first index following the quote(s) */ int GetPyStringState(Accessor &styler, Sci_Position i, Sci_PositionU *nextIndex, literalsAllowed allowed) { char ch = styler.SafeGetCharAt(i); char chNext = styler.SafeGetCharAt(i + 1); bool isFString = false; // Advance beyond r, a type char, or both (in either order) // Note that this depends on IsPyStringStart to enforce ru'' not being a string if (IsRawPrefix(ch)) { i++; if (IsPyStringTypeChar(chNext, allowed)) { if (AnyOf(chNext, 'f', 'F')) isFString = true; i++; } ch = styler.SafeGetCharAt(i); chNext = styler.SafeGetCharAt(i + 1); } else if (IsPyStringTypeChar(ch, allowed)) { if (AnyOf(ch, 'f', 'F')) isFString = true; if (IsRawPrefix(chNext)) i += 2; else i += 1; ch = styler.SafeGetCharAt(i); chNext = styler.SafeGetCharAt(i + 1); } // ch and i will be the first quote if (!IsQuote(ch)) { *nextIndex = i + 1; return SCE_P_DEFAULT; } if (ch == chNext && ch == styler.SafeGetCharAt(i + 2)) { *nextIndex = i + 3; if (ch == '"') return (isFString ? SCE_P_FTRIPLEDOUBLE : SCE_P_TRIPLEDOUBLE); else return (isFString ? SCE_P_FTRIPLE : SCE_P_TRIPLE); } else { *nextIndex = i + 1; if (ch == '"') return (isFString ? SCE_P_FSTRING : SCE_P_STRING); else return (isFString ? SCE_P_FCHARACTER : SCE_P_CHARACTER); } } bool IsAWordChar(int ch, bool unicodeIdentifiers) noexcept { if (IsASCII(ch)) return (IsAlphaNumeric(ch) || ch == '.' || ch == '_'); if (!unicodeIdentifiers) return false; // Python uses the XID_Continue set from Unicode data return IsXidContinue(ch); } bool IsAWordStart(int ch, bool unicodeIdentifiers) noexcept { if (IsASCII(ch)) return (IsUpperOrLowerCase(ch) || ch == '_'); if (!unicodeIdentifiers) return false; // Python uses the XID_Start set from Unicode data return IsXidStart(ch); } bool IsFirstNonWhitespace(Sci_Position pos, Accessor &styler) { const Sci_Position line = styler.GetLine(pos); const Sci_Position start_pos = styler.LineStart(line); for (Sci_Position i = start_pos; i < pos; i++) { const char ch = styler[i]; if (!IsASpaceOrTab(ch)) return false; } return true; } unsigned char GetNextNonWhitespaceChar(Accessor &styler, Sci_PositionU pos, Sci_PositionU maxPos, Sci_PositionU *charPosPtr = nullptr) { while (pos < maxPos) { const unsigned char ch = styler.SafeGetCharAt(pos, '\0'); if (!AnyOf(ch, ' ', '\t', '\n', '\r')) { if (charPosPtr != nullptr) { *charPosPtr = pos; } return ch; } pos++; } return '\0'; } // Returns whether symbol is "match" or "case" and it is an identifier & // not a keyword. Does not require the line to end with : so "match\n" // and "match (x)\n" return false because match could be a keyword once // more text is added bool IsMatchOrCaseIdentifier(const StyleContext &sc, Accessor &styler, const char *symbol) { if (strcmp(symbol, "match") != 0 && strcmp(symbol, "case") != 0) { return false; } if (!IsFirstNonWhitespace(sc.currentPos - strlen(symbol), styler)) { return true; } // The match keyword can be followed by an expression; the case keyword // is a bit more restrictive but not much. Here, we look for the next // char and return false if the char cannot start an expression; for '.' // we look at the following char to see if it's a digit because .1 is a // number Sci_PositionU nextCharPos = 0; const unsigned char nextChar = GetNextNonWhitespaceChar(styler, sc.currentPos, sc.lineEnd, &nextCharPos); if (nextChar == '=' || nextChar == '#') { return true; } if (nextChar == '.' && nextCharPos >= sc.currentPos) { const unsigned char followingChar = GetNextNonWhitespaceChar(styler, nextCharPos+1, sc.lineEnd); if (!IsADigit(followingChar)) { return true; } } return false; } // Options used for LexerPython struct OptionsPython { int whingeLevel = 0; bool base2or8Literals = true; bool stringsU = true; bool stringsB = true; bool stringsF = true; bool stringsOverNewline = false; bool keywords2NoSubIdentifiers = false; bool fold = false; bool foldQuotes = false; bool foldCompact = false; bool unicodeIdentifiers = true; int identifierAttributes = 0; int decoratorAttributes = 0; bool pep701StringsF = true; [[nodiscard]] literalsAllowed AllowedLiterals() const noexcept { literalsAllowed allowedLiterals = stringsU ? litU : litNone; if (stringsB) allowedLiterals = static_cast(allowedLiterals | litB); if (stringsF) allowedLiterals = static_cast(allowedLiterals | litF); return allowedLiterals; } }; const char *const pythonWordListDesc[] = { "Keywords", "Highlighted identifiers", nullptr }; struct OptionSetPython : public OptionSet { OptionSetPython() { DefineProperty("tab.timmy.whinge.level", &OptionsPython::whingeLevel, "For Python code, checks whether indenting is consistent. " "The default, 0 turns off indentation checking, " "1 checks whether each line is potentially inconsistent with the previous line, " "2 checks whether any space characters occur before a tab character in the indentation, " "3 checks whether any spaces are in the indentation, and " "4 checks for any tab characters in the indentation. " "1 is a good level to use."); DefineProperty("lexer.python.literals.binary", &OptionsPython::base2or8Literals, "Set to 0 to not recognise Python 3 binary and octal literals: 0b1011 0o712."); DefineProperty("lexer.python.strings.u", &OptionsPython::stringsU, "Set to 0 to not recognise Python Unicode literals u\"x\" as used before Python 3."); DefineProperty("lexer.python.strings.b", &OptionsPython::stringsB, "Set to 0 to not recognise Python 3 bytes literals b\"x\"."); DefineProperty("lexer.python.strings.f", &OptionsPython::stringsF, "Set to 0 to not recognise Python 3.6 f-string literals f\"var={var}\"."); DefineProperty("lexer.python.strings.f.pep.701", &OptionsPython::pep701StringsF, "Set to 0 to use pre-PEP 701 / Python 3.12 f-string lexing."); DefineProperty("lexer.python.strings.over.newline", &OptionsPython::stringsOverNewline, "Set to 1 to allow strings to span newline characters."); DefineProperty("lexer.python.keywords2.no.sub.identifiers", &OptionsPython::keywords2NoSubIdentifiers, "When enabled, it will not style keywords2 items that are used as a sub-identifier. " "Example: when set, will not highlight \"foo.open\" when \"open\" is a keywords2 item."); DefineProperty("fold", &OptionsPython::fold); DefineProperty("fold.quotes.python", &OptionsPython::foldQuotes, "This option enables folding multi-line quoted strings when using the Python lexer."); DefineProperty("fold.compact", &OptionsPython::foldCompact); DefineProperty("lexer.python.unicode.identifiers", &OptionsPython::unicodeIdentifiers, "Set to 0 to not recognise Python 3 Unicode identifiers."); DefineProperty("lexer.python.identifier.attributes", &OptionsPython::identifierAttributes, "Set to 1 to recognise Python identifier attributes."); DefineProperty("lexer.python.decorator.attributes", &OptionsPython::decoratorAttributes, "Set to 1 to recognise Python decorator attributes."); DefineWordListSets(pythonWordListDesc); } }; const char styleSubable[] = { SCE_P_IDENTIFIER, 0 }; const LexicalClass lexicalClasses[] = { // Lexer Python SCLEX_PYTHON SCE_P_: 0, "SCE_P_DEFAULT", "default", "White space", 1, "SCE_P_COMMENTLINE", "comment line", "Comment", 2, "SCE_P_NUMBER", "literal numeric", "Number", 3, "SCE_P_STRING", "literal string", "String", 4, "SCE_P_CHARACTER", "literal string", "Single quoted string", 5, "SCE_P_WORD", "keyword", "Keyword", 6, "SCE_P_TRIPLE", "literal string", "Triple quotes", 7, "SCE_P_TRIPLEDOUBLE", "literal string", "Triple double quotes", 8, "SCE_P_CLASSNAME", "identifier", "Class name definition", 9, "SCE_P_DEFNAME", "identifier", "Function or method name definition", 10, "SCE_P_OPERATOR", "operator", "Operators", 11, "SCE_P_IDENTIFIER", "identifier", "Identifiers", 12, "SCE_P_COMMENTBLOCK", "comment", "Comment-blocks", 13, "SCE_P_STRINGEOL", "error literal string", "End of line where string is not closed", 14, "SCE_P_WORD2", "identifier", "Highlighted identifiers", 15, "SCE_P_DECORATOR", "preprocessor", "Decorators", 16, "SCE_P_FSTRING", "literal string interpolated", "F-String", 17, "SCE_P_FCHARACTER", "literal string interpolated", "Single quoted f-string", 18, "SCE_P_FTRIPLE", "literal string interpolated", "Triple quoted f-string", 19, "SCE_P_FTRIPLEDOUBLE", "literal string interpolated", "Triple double quoted f-string", 20, "SCE_P_ATTRIBUTE", "identifier", "Attribute of identifier", }; class LexerPython : public DefaultLexer { WordList keywords; WordList keywords2; OptionsPython options; OptionSetPython osPython; enum { ssIdentifier }; SubStyles subStyles{styleSubable}; std::map > ftripleStateAtEol; public: explicit LexerPython() : DefaultLexer("python", SCLEX_PYTHON, lexicalClasses, std::size(lexicalClasses)) { } ~LexerPython() override = default; void SCI_METHOD Release() override { delete this; } int SCI_METHOD Version() const override { return lvRelease5; } const char *SCI_METHOD PropertyNames() override { return osPython.PropertyNames(); } int SCI_METHOD PropertyType(const char *name) override { return osPython.PropertyType(name); } const char *SCI_METHOD DescribeProperty(const char *name) override { return osPython.DescribeProperty(name); } Sci_Position SCI_METHOD PropertySet(const char *key, const char *val) override; const char *SCI_METHOD PropertyGet(const char *key) override { return osPython.PropertyGet(key); } const char *SCI_METHOD DescribeWordListSets() override { return osPython.DescribeWordListSets(); } Sci_Position SCI_METHOD WordListSet(int n, const char *wl) override; void SCI_METHOD Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void SCI_METHOD Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void *SCI_METHOD PrivateCall(int, void *) override { return nullptr; } int SCI_METHOD LineEndTypesSupported() override { return SC_LINE_END_TYPE_UNICODE; } int SCI_METHOD AllocateSubStyles(int styleBase, int numberStyles) override { return subStyles.Allocate(styleBase, numberStyles); } int SCI_METHOD SubStylesStart(int styleBase) override { return subStyles.Start(styleBase); } int SCI_METHOD SubStylesLength(int styleBase) override { return subStyles.Length(styleBase); } int SCI_METHOD StyleFromSubStyle(int subStyle) override { const int styleBase = subStyles.BaseStyle(subStyle); return styleBase; } int SCI_METHOD PrimaryStyleFromStyle(int style) override { return style; } void SCI_METHOD FreeSubStyles() override { subStyles.Free(); } void SCI_METHOD SetIdentifiers(int style, const char *identifiers) override { subStyles.SetIdentifiers(style, identifiers); } int SCI_METHOD DistanceToSecondaryStyles() override { return 0; } const char *SCI_METHOD GetSubStyleBases() override { return styleSubable; } static ILexer5 *LexerFactoryPython() { return new LexerPython(); } private: void ProcessLineEnd(StyleContext &sc, std::vector &fstringStateStack, SingleFStringExpState *¤tFStringExp, bool &inContinuedString); }; Sci_Position SCI_METHOD LexerPython::PropertySet(const char *key, const char *val) { if (osPython.PropertySet(&options, key, val)) { return 0; } return -1; } Sci_Position SCI_METHOD LexerPython::WordListSet(int n, const char *wl) { WordList *wordListN = nullptr; switch (n) { case 0: wordListN = &keywords; break; case 1: wordListN = &keywords2; break; default: break; } Sci_Position firstModification = -1; if (wordListN) { if (wordListN->Set(wl)) { firstModification = 0; } } return firstModification; } void LexerPython::ProcessLineEnd(StyleContext &sc, std::vector &fstringStateStack, SingleFStringExpState *¤tFStringExp, bool &inContinuedString) { // Before pep 701 single quote f-string's could not continue to a 2nd+ line // Post pep 701, they can continue both with a trailing \ and if a { field is // not ended with a } if (!options.pep701StringsF) { long deepestSingleStateIndex = -1; unsigned long i; // Find the deepest single quote state because that string will end; no \ continuation in f-string for (i = 0; i < fstringStateStack.size(); i++) { if (IsPySingleQuoteStringState(fstringStateStack[i].state)) { deepestSingleStateIndex = i; break; } } if (deepestSingleStateIndex != -1) { sc.SetState(fstringStateStack[deepestSingleStateIndex].state); while (fstringStateStack.size() > static_cast(deepestSingleStateIndex)) { PopFromStateStack(fstringStateStack, currentFStringExp); } } } if (!fstringStateStack.empty()) { std::pair > val; val.first = sc.currentLine; val.second = fstringStateStack; ftripleStateAtEol.insert(val); } if ((sc.state == SCE_P_DEFAULT) || IsPyTripleQuoteStringState(sc.state)) { // Perform colourisation of white space and triple quoted strings at end of each line to allow // tab marking to work inside white space and triple quoted strings sc.SetState(sc.state); } if (IsPySingleQuoteStringState(sc.state)) { if (inContinuedString || options.stringsOverNewline) { inContinuedString = false; } else { sc.ChangeState(SCE_P_STRINGEOL); sc.ForwardSetState(SCE_P_DEFAULT); } } } void SCI_METHOD LexerPython::Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { Accessor styler(pAccess, nullptr); // Track whether in f-string expression; vector is used for a stack to // handle nested f-strings such as f"""{f'''{f"{f'{1}'}"}'''}""" std::vector fstringStateStack; SingleFStringExpState *currentFStringExp = nullptr; const Sci_Position endPos = startPos + length; // Backtrack to previous line in case need to fix its tab whinging Sci_Position lineCurrent = styler.GetLine(startPos); if (startPos > 0) { if (lineCurrent > 0) { lineCurrent--; // Look for backslash-continued lines while (lineCurrent > 0) { const Sci_Position eolPos = styler.LineStart(lineCurrent) - 1; const int eolStyle = styler.StyleIndexAt(eolPos); if (AnyOf(eolStyle, SCE_P_STRING, SCE_P_CHARACTER, SCE_P_STRINGEOL)) { lineCurrent -= 1; } else { break; } } startPos = styler.LineStart(lineCurrent); } initStyle = startPos == 0 ? SCE_P_DEFAULT : styler.StyleIndexAt(startPos - 1); } const literalsAllowed allowedLiterals = options.AllowedLiterals(); if (initStyle == SCE_P_STRINGEOL) { initStyle = SCE_P_DEFAULT; } // Set up fstate stack from last line and remove any subsequent ftriple at eol states std::map >::iterator it; it = ftripleStateAtEol.find(lineCurrent - 1); if (it != ftripleStateAtEol.end() && !it->second.empty()) { fstringStateStack = it->second; currentFStringExp = &fstringStateStack.back(); } it = ftripleStateAtEol.lower_bound(lineCurrent); if (it != ftripleStateAtEol.end()) { ftripleStateAtEol.erase(it, ftripleStateAtEol.end()); } kwType kwLast = kwOther; int spaceFlags = 0; styler.IndentAmount(lineCurrent, &spaceFlags, IsPyComment); bool base_n_number = false; const WordClassifier &classifierIdentifiers = subStyles.Classifier(SCE_P_IDENTIFIER); StyleContext sc(startPos, endPos - startPos, initStyle, styler); bool indentGood = true; Sci_Position startIndicator = sc.currentPos; bool inContinuedString = false; for (; sc.More(); sc.Forward()) { if (sc.atLineStart) { styler.IndentAmount(lineCurrent, &spaceFlags, IsPyComment); indentGood = true; if (options.whingeLevel == 1) { indentGood = (spaceFlags & wsInconsistent) == 0; } else if (options.whingeLevel == 2) { indentGood = (spaceFlags & wsSpaceTab) == 0; } else if (options.whingeLevel == 3) { indentGood = (spaceFlags & wsSpace) == 0; } else if (options.whingeLevel == 4) { indentGood = (spaceFlags & wsTab) == 0; } if (!indentGood) { styler.IndicatorFill(startIndicator, sc.currentPos, indicatorWhitespace, 0); startIndicator = sc.currentPos; } } if (sc.atLineEnd) { ProcessLineEnd(sc, fstringStateStack, currentFStringExp, inContinuedString); lineCurrent++; if (!sc.More()) break; } bool needEOLCheck = false; if (sc.state == SCE_P_OPERATOR) { kwLast = kwOther; sc.SetState(SCE_P_DEFAULT); } else if (sc.state == SCE_P_NUMBER) { if (!IsAWordChar(sc.ch, false) && !(!base_n_number && ((sc.ch == '+' || sc.ch == '-') && (sc.chPrev == 'e' || sc.chPrev == 'E')))) { sc.SetState(SCE_P_DEFAULT); } } else if (sc.state == SCE_P_IDENTIFIER) { if ((sc.ch == '.') || (!IsAWordChar(sc.ch, options.unicodeIdentifiers))) { char identifier[100]; sc.GetCurrent(identifier, sizeof(identifier)); int style = SCE_P_IDENTIFIER; if ((kwLast == kwImport) && (strcmp(identifier, "as") == 0)) { style = SCE_P_WORD; } else if (keywords.InList(identifier) && !IsMatchOrCaseIdentifier(sc, styler, identifier)) { style = SCE_P_WORD; } else if (kwLast == kwClass) { style = SCE_P_CLASSNAME; } else if (kwLast == kwDef) { style = SCE_P_DEFNAME; } else if (kwLast == kwCDef || kwLast == kwCPDef) { Sci_Position pos = sc.currentPos; unsigned char ch = styler.SafeGetCharAt(pos, '\0'); while (ch != '\0') { if (ch == '(') { style = SCE_P_DEFNAME; break; } else if (ch == ':') { style = SCE_P_CLASSNAME; break; } else if (ch == ' ' || ch == '\t' || ch == '\n' || ch == '\r') { pos++; ch = styler.SafeGetCharAt(pos, '\0'); } else { break; } } } else if (keywords2.InList(identifier)) { if (options.keywords2NoSubIdentifiers) { // We don't want to highlight keywords2 // that are used as a sub-identifier, // i.e. not open in "foo.open". const Sci_Position pos = styler.GetStartSegment() - 1; if (pos < 0 || (styler.SafeGetCharAt(pos, '\0') != '.')) style = SCE_P_WORD2; } else { style = SCE_P_WORD2; } } else { const int subStyle = classifierIdentifiers.ValueFor(identifier); if (subStyle >= 0) { style = subStyle; } if (options.identifierAttributes > 0 || options.decoratorAttributes > 0) { // Does the user even want attributes styled? Sci_Position pos = styler.GetStartSegment() - 1; unsigned char ch = styler.SafeGetCharAt(pos, '\0'); while (ch != '\0' && (ch == '.' || ch == ' ' || ch == '\\' || ch == '\t' || ch == '\n' || ch == '\r')) { // Backwards search for a . while only allowing certain valid characters if (IsAWordChar(ch, options.unicodeIdentifiers)) { break; } pos--; ch = styler.SafeGetCharAt(pos, '\0'); } if (pos < 0 || ch == '.') { // Is this an attribute we could style? if it is, do as asked bool isComment = false; bool isDecoratorAttribute = false; const Sci_Position attrLine = styler.GetLine(pos); for (Sci_Position i = styler.LineStart(attrLine); i < pos; i++) { const char attrCh = styler[i]; if (attrCh == '@') isDecoratorAttribute = true; if (attrCh == '#') isComment = true; // Detect if this attribute belongs to a decorator if (!IsASpaceOrTab(ch)) break; } if (((isDecoratorAttribute) && (!isComment)) && (((options.decoratorAttributes == 1) && (style == SCE_P_IDENTIFIER)) || (options.decoratorAttributes == 2))) { // Style decorator attributes as decorators but respect already styled identifiers (unless requested to ignore already styled identifiers) style = SCE_P_DECORATOR; } if (((!isDecoratorAttribute) && (!isComment)) && (((options.identifierAttributes == 1) && (style == SCE_P_IDENTIFIER)) || (options.identifierAttributes == 2))) { // Style attributes and ignore decorator attributes but respect already styled identifiers (unless requested to ignore already styled identifiers) style = SCE_P_ATTRIBUTE; } } } } sc.ChangeState(style); sc.SetState(SCE_P_DEFAULT); if (style == SCE_P_WORD) { if (0 == strcmp(identifier, "class")) kwLast = kwClass; else if (0 == strcmp(identifier, "def")) kwLast = kwDef; else if (0 == strcmp(identifier, "import")) kwLast = kwImport; else if (0 == strcmp(identifier, "cdef")) kwLast = kwCDef; else if (0 == strcmp(identifier, "cpdef")) kwLast = kwCPDef; else if (0 == strcmp(identifier, "cimport")) kwLast = kwImport; else if (kwLast != kwCDef && kwLast != kwCPDef) kwLast = kwOther; } else if (kwLast != kwCDef && kwLast != kwCPDef) { kwLast = kwOther; } } } else if ((sc.state == SCE_P_COMMENTLINE) || (sc.state == SCE_P_COMMENTBLOCK)) { if (sc.ch == '\r' || sc.ch == '\n') { sc.SetState(SCE_P_DEFAULT); } } else if (sc.state == SCE_P_DECORATOR) { if (!IsAWordStart(sc.ch, options.unicodeIdentifiers)) { sc.SetState(SCE_P_DEFAULT); } } else if (IsPySingleQuoteStringState(sc.state)) { if (sc.ch == '\\') { if ((sc.chNext == '\r') && (sc.GetRelative(2) == '\n')) { sc.Forward(); } if (sc.chNext == '\n' || sc.chNext == '\r') { inContinuedString = true; } else { // Don't roll over the newline. sc.Forward(); } } else if (sc.ch == GetPyStringQuoteChar(sc.state)) { sc.ForwardSetState(SCE_P_DEFAULT); needEOLCheck = true; } } else if ((sc.state == SCE_P_TRIPLE) || (sc.state == SCE_P_FTRIPLE)) { if (sc.ch == '\\') { sc.Forward(); } else if (sc.Match(R"(''')")) { sc.Forward(); sc.Forward(); sc.ForwardSetState(SCE_P_DEFAULT); needEOLCheck = true; } } else if ((sc.state == SCE_P_TRIPLEDOUBLE) || (sc.state == SCE_P_FTRIPLEDOUBLE)) { if (sc.ch == '\\') { sc.Forward(); } else if (sc.Match(R"(""")")) { sc.Forward(); sc.Forward(); sc.ForwardSetState(SCE_P_DEFAULT); needEOLCheck = true; } } // Note if used and not if else because string states also match // some of the above clauses if (IsPyFStringState(sc.state) && sc.ch == '{') { if (sc.chNext == '{') { sc.Forward(); } else { PushStateToStack(sc.state, fstringStateStack, currentFStringExp); sc.ForwardSetState(SCE_P_DEFAULT); } needEOLCheck = true; } // If in an f-string expression and pre pep 701 lexing is used, // check for the ending quote(s) and end f-string to handle // syntactically incorrect cases like f'{' and f"""{""". Post // pep 701, a quote may appear in a { } field so cases like // f"n = {":".join(seq)}" is valid if (!options.pep701StringsF && !fstringStateStack.empty() && IsQuote(sc.ch)) { long matching_stack_i = -1; for (unsigned long stack_i = 0; stack_i < fstringStateStack.size() && matching_stack_i == -1; stack_i++) { const int stack_state = fstringStateStack[stack_i].state; const char quote = GetPyStringQuoteChar(stack_state); if (sc.ch == quote) { if (IsPySingleQuoteStringState(stack_state)) { matching_stack_i = stack_i; } else if (quote == '"' ? sc.Match(R"(""")") : sc.Match("'''")) { matching_stack_i = stack_i; } } } if (matching_stack_i != -1) { sc.SetState(fstringStateStack[matching_stack_i].state); if (IsPyTripleQuoteStringState(fstringStateStack[matching_stack_i].state)) { sc.Forward(); sc.Forward(); } sc.ForwardSetState(SCE_P_DEFAULT); needEOLCheck = true; while (fstringStateStack.size() > static_cast(matching_stack_i)) { PopFromStateStack(fstringStateStack, currentFStringExp); } } } // End of code to find the end of a state if (!indentGood && !IsASpaceOrTab(sc.ch)) { styler.IndicatorFill(startIndicator, sc.currentPos, indicatorWhitespace, 1); startIndicator = sc.currentPos; indentGood = true; } // One cdef or cpdef line, clear kwLast only at end of line if ((kwLast == kwCDef || kwLast == kwCPDef) && sc.atLineEnd) { kwLast = kwOther; } // State exit code may have moved on to end of line if (needEOLCheck && sc.atLineEnd) { ProcessLineEnd(sc, fstringStateStack, currentFStringExp, inContinuedString); lineCurrent++; styler.IndentAmount(lineCurrent, &spaceFlags, IsPyComment); if (!sc.More()) break; } // If in f-string expression, check for }, :, ! to resume f-string state or update nesting count if (currentFStringExp && !IsPySingleQuoteStringState(sc.state) && !IsPyTripleQuoteStringState(sc.state)) { if (currentFStringExp->nestingCount == 0 && (sc.ch == '}' || sc.ch == ':' || (sc.ch == '!' && sc.chNext != '='))) { sc.SetState(PopFromStateStack(fstringStateStack, currentFStringExp)); } else { if (sc.ch == '{' || sc.ch == '[' || sc.ch == '(') { currentFStringExp->nestingCount++; } else if (sc.ch == '}' || sc.ch == ']' || sc.ch == ')') { currentFStringExp->nestingCount--; } } } // Check for a new state starting character if (sc.state == SCE_P_DEFAULT) { if (IsADigit(sc.ch) || (sc.ch == '.' && IsADigit(sc.chNext))) { if (sc.ch == '0' && (sc.chNext == 'x' || sc.chNext == 'X')) { base_n_number = true; sc.SetState(SCE_P_NUMBER); } else if (sc.ch == '0' && (sc.chNext == 'o' || sc.chNext == 'O' || sc.chNext == 'b' || sc.chNext == 'B')) { if (options.base2or8Literals) { base_n_number = true; sc.SetState(SCE_P_NUMBER); } else { sc.SetState(SCE_P_NUMBER); sc.ForwardSetState(SCE_P_IDENTIFIER); } } else { base_n_number = false; sc.SetState(SCE_P_NUMBER); } } else if (isoperator(sc.ch) || sc.ch == '`') { sc.SetState(SCE_P_OPERATOR); } else if (sc.ch == '#') { sc.SetState(sc.chNext == '#' ? SCE_P_COMMENTBLOCK : SCE_P_COMMENTLINE); } else if (sc.ch == '@') { if (IsFirstNonWhitespace(sc.currentPos, styler)) sc.SetState(SCE_P_DECORATOR); else sc.SetState(SCE_P_OPERATOR); } else if (IsPyStringStart(sc.ch, sc.chNext, sc.GetRelative(2), allowedLiterals)) { Sci_PositionU nextIndex = 0; sc.SetState(GetPyStringState(styler, sc.currentPos, &nextIndex, allowedLiterals)); while (nextIndex > (sc.currentPos + 1) && sc.More()) { sc.Forward(); } } else if (IsAWordStart(sc.ch, options.unicodeIdentifiers)) { sc.SetState(SCE_P_IDENTIFIER); } } } styler.IndicatorFill(startIndicator, sc.currentPos, indicatorWhitespace, 0); sc.Complete(); } bool IsCommentLine(Sci_Position line, Accessor &styler) { const Sci_Position pos = styler.LineStart(line); const Sci_Position eol_pos = styler.LineStart(line + 1) - 1; for (Sci_Position i = pos; i < eol_pos; i++) { const char ch = styler[i]; if (ch == '#') return true; if (!IsASpaceOrTab(ch)) return false; } return false; } bool IsQuoteLine(Sci_Position line, const Accessor &styler) { const int style = styler.StyleIndexAt(styler.LineStart(line)); return IsPyTripleQuoteStringState(style); } void SCI_METHOD LexerPython::Fold(Sci_PositionU startPos, Sci_Position length, int /*initStyle - unused*/, IDocument *pAccess) { if (!options.fold) return; Accessor styler(pAccess, nullptr); const Sci_Position maxPos = startPos + length; const Sci_Position maxLines = (maxPos == styler.Length()) ? styler.GetLine(maxPos) : styler.GetLine(maxPos - 1); // Requested last line const Sci_Position docLines = styler.GetLine(styler.Length()); // Available last line // Backtrack to previous non-blank line so we can determine indent level // for any white space lines (needed esp. within triple quoted strings) // and so we can fix any preceding fold level (which is why we go back // at least one line in all cases) int spaceFlags = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int indentCurrent = styler.IndentAmount(lineCurrent, &spaceFlags, nullptr); while (lineCurrent > 0) { lineCurrent--; indentCurrent = styler.IndentAmount(lineCurrent, &spaceFlags, nullptr); if (!(indentCurrent & SC_FOLDLEVELWHITEFLAG) && (!IsCommentLine(lineCurrent, styler)) && (!IsQuoteLine(lineCurrent, styler))) break; } int indentCurrentLevel = indentCurrent & SC_FOLDLEVELNUMBERMASK; // Set up initial loop state startPos = styler.LineStart(lineCurrent); int prev_state = SCE_P_DEFAULT; if (lineCurrent >= 1) prev_state = styler.StyleIndexAt(startPos - 1); int prevQuote = options.foldQuotes && IsPyTripleQuoteStringState(prev_state); // Process all characters to end of requested range or end of any triple quote //that hangs over the end of the range. Cap processing in all cases // to end of document (in case of unclosed quote at end). while ((lineCurrent <= docLines) && ((lineCurrent <= maxLines) || prevQuote)) { // Gather info int lev = indentCurrent; Sci_Position lineNext = lineCurrent + 1; int indentNext = indentCurrent; int quote = false; if (lineNext <= docLines) { // Information about next line is only available if not at end of document indentNext = styler.IndentAmount(lineNext, &spaceFlags, nullptr); const Sci_Position lookAtPos = (styler.LineStart(lineNext) == styler.Length()) ? styler.Length() - 1 : styler.LineStart(lineNext); const int style = styler.StyleIndexAt(lookAtPos); quote = options.foldQuotes && IsPyTripleQuoteStringState(style); } const bool quote_start = (quote && !prevQuote); const bool quote_continue = (quote && prevQuote); if (!quote || !prevQuote) indentCurrentLevel = indentCurrent & SC_FOLDLEVELNUMBERMASK; if (quote) indentNext = indentCurrentLevel; if (indentNext & SC_FOLDLEVELWHITEFLAG) indentNext = SC_FOLDLEVELWHITEFLAG | indentCurrentLevel; if (quote_start) { // Place fold point at start of triple quoted string lev |= SC_FOLDLEVELHEADERFLAG; } else if (quote_continue || prevQuote) { // Add level to rest of lines in the string lev = lev + 1; } // Skip past any blank lines for next indent level info; we skip also // comments (all comments, not just those starting in column 0) // which effectively folds them into surrounding code rather // than screwing up folding. If comments end file, use the min // comment indent as the level after int minCommentLevel = indentCurrentLevel; while (!quote && (lineNext < docLines) && ((indentNext & SC_FOLDLEVELWHITEFLAG) || (IsCommentLine(lineNext, styler)))) { if (IsCommentLine(lineNext, styler) && indentNext < minCommentLevel) { minCommentLevel = indentNext; } lineNext++; indentNext = styler.IndentAmount(lineNext, &spaceFlags, nullptr); } const int levelAfterComments = ((lineNext < docLines) ? indentNext & SC_FOLDLEVELNUMBERMASK : minCommentLevel); const int levelBeforeComments = std::max(indentCurrentLevel, levelAfterComments); // Now set all the indent levels on the lines we skipped // Do this from end to start. Once we encounter one line // which is indented more than the line after the end of // the comment-block, use the level of the block before Sci_Position skipLine = lineNext; int skipLevel = levelAfterComments; while (--skipLine > lineCurrent) { const int skipLineIndent = styler.IndentAmount(skipLine, &spaceFlags, nullptr); if (options.foldCompact) { if ((skipLineIndent & SC_FOLDLEVELNUMBERMASK) > levelAfterComments) skipLevel = levelBeforeComments; const int whiteFlag = skipLineIndent & SC_FOLDLEVELWHITEFLAG; styler.SetLevel(skipLine, skipLevel | whiteFlag); } else { if ((skipLineIndent & SC_FOLDLEVELNUMBERMASK) > levelAfterComments && !(skipLineIndent & SC_FOLDLEVELWHITEFLAG) && !IsCommentLine(skipLine, styler)) skipLevel = levelBeforeComments; styler.SetLevel(skipLine, skipLevel); } } // Set fold header on non-quote line if (!quote && !(indentCurrent & SC_FOLDLEVELWHITEFLAG)) { if ((indentCurrent & SC_FOLDLEVELNUMBERMASK) < (indentNext & SC_FOLDLEVELNUMBERMASK)) lev |= SC_FOLDLEVELHEADERFLAG; } // Keep track of triple quote state of previous line prevQuote = quote; // Set fold level for this line and move to next line styler.SetLevel(lineCurrent, options.foldCompact ? lev : lev & ~SC_FOLDLEVELWHITEFLAG); indentCurrent = indentNext; lineCurrent = lineNext; } // NOTE: Cannot set level of last line here because indentCurrent doesn't have // header flag set; the loop above is crafted to take care of this case! //styler.SetLevel(lineCurrent, indentCurrent); } } LexerModule lmPython(SCLEX_PYTHON, LexerPython::LexerFactoryPython, "python", pythonWordListDesc); lexilla/lexers/LexEScript.cxx0000664000175000017500000002004414647367374015247 0ustar neilneil// Scintilla source code edit control /** @file LexEScript.cxx ** Lexer for ESCRIPT **/ // Copyright 2003 by Patrizio Bekerle (patrizio@bekerle.com) #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static inline bool IsAWordChar(const int ch) { return (ch < 0x80) && (isalnum(ch) || ch == '.' || ch == '_'); } static inline bool IsAWordStart(const int ch) { return (ch < 0x80) && (isalnum(ch) || ch == '_'); } static void ColouriseESCRIPTDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { WordList &keywords = *keywordlists[0]; WordList &keywords2 = *keywordlists[1]; WordList &keywords3 = *keywordlists[2]; // Do not leak onto next line /*if (initStyle == SCE_ESCRIPT_STRINGEOL) initStyle = SCE_ESCRIPT_DEFAULT;*/ StyleContext sc(startPos, length, initStyle, styler); bool caseSensitive = styler.GetPropertyInt("escript.case.sensitive", 0) != 0; for (; sc.More(); sc.Forward()) { /*if (sc.atLineStart && (sc.state == SCE_ESCRIPT_STRING)) { // Prevent SCE_ESCRIPT_STRINGEOL from leaking back to previous line sc.SetState(SCE_ESCRIPT_STRING); }*/ // Handle line continuation generically. if (sc.ch == '\\') { if (sc.chNext == '\n' || sc.chNext == '\r') { sc.Forward(); if (sc.ch == '\r' && sc.chNext == '\n') { sc.Forward(); } continue; } } // Determine if the current state should terminate. if (sc.state == SCE_ESCRIPT_OPERATOR || sc.state == SCE_ESCRIPT_BRACE) { sc.SetState(SCE_ESCRIPT_DEFAULT); } else if (sc.state == SCE_ESCRIPT_NUMBER) { if (!IsADigit(sc.ch) || sc.ch != '.') { sc.SetState(SCE_ESCRIPT_DEFAULT); } } else if (sc.state == SCE_ESCRIPT_IDENTIFIER) { if (!IsAWordChar(sc.ch) || (sc.ch == '.')) { char s[100]; if (caseSensitive) { sc.GetCurrent(s, sizeof(s)); } else { sc.GetCurrentLowered(s, sizeof(s)); } // sc.GetCurrentLowered(s, sizeof(s)); if (keywords.InList(s)) { sc.ChangeState(SCE_ESCRIPT_WORD); } else if (keywords2.InList(s)) { sc.ChangeState(SCE_ESCRIPT_WORD2); } else if (keywords3.InList(s)) { sc.ChangeState(SCE_ESCRIPT_WORD3); // sc.state = SCE_ESCRIPT_IDENTIFIER; } sc.SetState(SCE_ESCRIPT_DEFAULT); } } else if (sc.state == SCE_ESCRIPT_COMMENT) { if (sc.Match('*', '/')) { sc.Forward(); sc.ForwardSetState(SCE_ESCRIPT_DEFAULT); } } else if (sc.state == SCE_ESCRIPT_COMMENTDOC) { if (sc.Match('*', '/')) { sc.Forward(); sc.ForwardSetState(SCE_ESCRIPT_DEFAULT); } } else if (sc.state == SCE_ESCRIPT_COMMENTLINE) { if (sc.atLineEnd) { sc.SetState(SCE_ESCRIPT_DEFAULT); } } else if (sc.state == SCE_ESCRIPT_STRING) { if (sc.ch == '\\') { if (sc.chNext == '\"' || sc.chNext == '\\') { sc.Forward(); } } else if (sc.ch == '\"') { sc.ForwardSetState(SCE_ESCRIPT_DEFAULT); } } // Determine if a new state should be entered. if (sc.state == SCE_ESCRIPT_DEFAULT) { if (IsADigit(sc.ch) || (sc.ch == '.' && IsADigit(sc.chNext))) { sc.SetState(SCE_ESCRIPT_NUMBER); } else if (IsAWordStart(sc.ch) || (sc.ch == '#')) { sc.SetState(SCE_ESCRIPT_IDENTIFIER); } else if (sc.Match('/', '*')) { sc.SetState(SCE_ESCRIPT_COMMENT); sc.Forward(); // Eat the * so it isn't used for the end of the comment } else if (sc.Match('/', '/')) { sc.SetState(SCE_ESCRIPT_COMMENTLINE); } else if (sc.ch == '\"') { sc.SetState(SCE_ESCRIPT_STRING); //} else if (isoperator(static_cast(sc.ch))) { } else if (sc.ch == '+' || sc.ch == '-' || sc.ch == '*' || sc.ch == '/' || sc.ch == '=' || sc.ch == '<' || sc.ch == '>' || sc.ch == '&' || sc.ch == '|' || sc.ch == '!' || sc.ch == '?' || sc.ch == ':') { sc.SetState(SCE_ESCRIPT_OPERATOR); } else if (sc.ch == '{' || sc.ch == '}') { sc.SetState(SCE_ESCRIPT_BRACE); } } } sc.Complete(); } static int classifyFoldPointESCRIPT(const char* s, const char* prevWord) { int lev = 0; if (strcmp(prevWord, "end") == 0) return lev; if ((strcmp(prevWord, "else") == 0 && strcmp(s, "if") == 0) || strcmp(s, "elseif") == 0) return -1; if (strcmp(s, "for") == 0 || strcmp(s, "foreach") == 0 || strcmp(s, "program") == 0 || strcmp(s, "function") == 0 || strcmp(s, "while") == 0 || strcmp(s, "case") == 0 || strcmp(s, "if") == 0 ) { lev = 1; } else if ( strcmp(s, "endfor") == 0 || strcmp(s, "endforeach") == 0 || strcmp(s, "endprogram") == 0 || strcmp(s, "endfunction") == 0 || strcmp(s, "endwhile") == 0 || strcmp(s, "endcase") == 0 || strcmp(s, "endif") == 0 ) { lev = -1; } return lev; } static bool IsStreamCommentStyle(int style) { return style == SCE_ESCRIPT_COMMENT || style == SCE_ESCRIPT_COMMENTDOC || style == SCE_ESCRIPT_COMMENTLINE; } static void FoldESCRIPTDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *[], Accessor &styler) { //~ bool foldComment = styler.GetPropertyInt("fold.comment") != 0; // Do not know how to fold the comment at the moment. bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; bool foldComment = true; Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelPrev = styler.LevelAt(lineCurrent) & SC_FOLDLEVELNUMBERMASK; int levelCurrent = levelPrev; char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); int style = initStyle; Sci_Position lastStart = 0; char prevWord[32] = ""; for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); int stylePrev = style; style = styleNext; styleNext = styler.StyleAt(i + 1); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (foldComment && IsStreamCommentStyle(style)) { if (!IsStreamCommentStyle(stylePrev)) { levelCurrent++; } else if (!IsStreamCommentStyle(styleNext) && !atEOL) { // Comments don't end at end of line and the next character may be unstyled. levelCurrent--; } } if (foldComment && (style == SCE_ESCRIPT_COMMENTLINE)) { if ((ch == '/') && (chNext == '/')) { char chNext2 = styler.SafeGetCharAt(i + 2); if (chNext2 == '{') { levelCurrent++; } else if (chNext2 == '}') { levelCurrent--; } } } if (stylePrev == SCE_ESCRIPT_DEFAULT && style == SCE_ESCRIPT_WORD3) { // Store last word start point. lastStart = i; } if (style == SCE_ESCRIPT_WORD3) { if(iswordchar(ch) && !iswordchar(chNext)) { char s[32]; Sci_PositionU j; for(j = 0; ( j < 31 ) && ( j < i-lastStart+1 ); j++) { s[j] = static_cast(tolower(styler[lastStart + j])); } s[j] = '\0'; levelCurrent += classifyFoldPointESCRIPT(s, prevWord); strcpy(prevWord, s); } } if (atEOL) { int lev = levelPrev; if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if ((levelCurrent > levelPrev) && (visibleChars > 0)) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelPrev = levelCurrent; visibleChars = 0; strcpy(prevWord, ""); } if (!isspacechar(ch)) visibleChars++; } // Fill in the real level of the next line, keeping the current flags as they will be filled in later int flagsNext = styler.LevelAt(lineCurrent) & ~SC_FOLDLEVELNUMBERMASK; styler.SetLevel(lineCurrent, levelPrev | flagsNext); } static const char * const ESCRIPTWordLists[] = { "Primary keywords and identifiers", "Intrinsic functions", "Extended and user defined functions", 0, }; LexerModule lmESCRIPT(SCLEX_ESCRIPT, ColouriseESCRIPTDoc, "escript", FoldESCRIPTDoc, ESCRIPTWordLists); lexilla/lexers/LexEDIFACT.cxx0000664000175000017500000002366714647367374014753 0ustar neilneil// Scintilla Lexer for EDIFACT // @file LexEDIFACT.cxx // Written by Iain Clarke, IMCSoft & Inobiz AB. // EDIFACT documented here: https://www.unece.org/cefact/edifact/welcome.html // and more readably here: https://en.wikipedia.org/wiki/EDIFACT // This code is subject to the same license terms as the rest of the scintilla project: // The License.txt file describes the conditions under which this software may be distributed. // // Header order must match order in scripts/HeaderOrder.txt #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "LexAccessor.h" #include "LexerModule.h" #include "DefaultLexer.h" using namespace Scintilla; using namespace Lexilla; class LexerEDIFACT : public DefaultLexer { public: LexerEDIFACT(); virtual ~LexerEDIFACT() {} // virtual destructor, as we inherit from ILexer static ILexer5 *Factory() { return new LexerEDIFACT; } int SCI_METHOD Version() const override { return lvRelease5; } void SCI_METHOD Release() override { delete this; } const char * SCI_METHOD PropertyNames() override { return "fold\nlexer.edifact.highlight.un.all"; } int SCI_METHOD PropertyType(const char *) override { return SC_TYPE_BOOLEAN; // Only one property! } const char * SCI_METHOD DescribeProperty(const char *name) override { if (!strcmp(name, "fold")) return "Whether to apply folding to document or not"; if (!strcmp(name, "lexer.edifact.highlight.un.all")) return "Whether to apply UN* highlighting to all UN segments, or just to UNH"; return NULL; } Sci_Position SCI_METHOD PropertySet(const char *key, const char *val) override { if (!strcmp(key, "fold")) { m_bFold = strcmp(val, "0") ? true : false; return 0; } if (!strcmp(key, "lexer.edifact.highlight.un.all")) // GetProperty { m_bHighlightAllUN = strcmp(val, "0") ? true : false; return 0; } return -1; } const char * SCI_METHOD PropertyGet(const char *key) override { m_lastPropertyValue = ""; if (!strcmp(key, "fold")) { m_lastPropertyValue = m_bFold ? "1" : "0"; } if (!strcmp(key, "lexer.edifact.highlight.un.all")) // GetProperty { m_lastPropertyValue = m_bHighlightAllUN ? "1" : "0"; } return m_lastPropertyValue.c_str(); } const char * SCI_METHOD DescribeWordListSets() override { return NULL; } Sci_Position SCI_METHOD WordListSet(int, const char *) override { return -1; } void SCI_METHOD Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void SCI_METHOD Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void * SCI_METHOD PrivateCall(int, void *) override { return NULL; } protected: Sci_Position InitialiseFromUNA(IDocument *pAccess, Sci_PositionU MaxLength); Sci_Position FindPreviousEnd(IDocument *pAccess, Sci_Position startPos) const; Sci_Position ForwardPastWhitespace(IDocument *pAccess, Sci_Position startPos, Sci_Position MaxLength) const; int DetectSegmentHeader(char SegmentHeader[3]) const; bool m_bFold; // property lexer.edifact.highlight.un.all // Set to 0 to highlight only UNA segments, or 1 to highlight all UNx segments. bool m_bHighlightAllUN; char m_chComponent; char m_chData; char m_chDecimal; char m_chRelease; char m_chSegment; std::string m_lastPropertyValue; }; LexerModule lmEDIFACT(SCLEX_EDIFACT, LexerEDIFACT::Factory, "edifact"); /////////////////////////////////////////////////////////////////////////////// /////////////////////////////////////////////////////////////////////////////// LexerEDIFACT::LexerEDIFACT() : DefaultLexer("edifact", SCLEX_EDIFACT) { m_bFold = false; m_bHighlightAllUN = false; m_chComponent = ':'; m_chData = '+'; m_chDecimal = '.'; m_chRelease = '?'; m_chSegment = '\''; } void LexerEDIFACT::Lex(Sci_PositionU startPos, Sci_Position length, int, IDocument *pAccess) { Sci_PositionU posFinish = startPos + length; InitialiseFromUNA(pAccess, posFinish); // Look backwards for a ' or a document beginning Sci_PositionU posCurrent = FindPreviousEnd(pAccess, startPos); // And jump past the ' if this was not the beginning of the document if (posCurrent != 0) posCurrent++; // Style buffer, so we're not issuing loads of notifications LexAccessor styler (pAccess); pAccess->StartStyling(posCurrent); styler.StartSegment(posCurrent); Sci_Position posSegmentStart = -1; while ((posCurrent < posFinish) && (posSegmentStart == -1)) { posCurrent = ForwardPastWhitespace(pAccess, posCurrent, posFinish); // Mark whitespace as default styler.ColourTo(posCurrent - 1, SCE_EDI_DEFAULT); if (posCurrent >= posFinish) break; // Does is start with 3 charaters? ie, UNH char SegmentHeader[4] = { 0 }; pAccess->GetCharRange(SegmentHeader, posCurrent, 3); int SegmentStyle = DetectSegmentHeader(SegmentHeader); if (SegmentStyle == SCE_EDI_BADSEGMENT) break; if (SegmentStyle == SCE_EDI_UNA) { posCurrent += 9; styler.ColourTo(posCurrent - 1, SCE_EDI_UNA); // UNA continue; } posSegmentStart = posCurrent; posCurrent += 3; styler.ColourTo(posCurrent - 1, SegmentStyle); // UNH etc // Colour in the rest of the segment for (char c; posCurrent < posFinish; posCurrent++) { pAccess->GetCharRange(&c, posCurrent, 1); if (c == m_chRelease) // ? escape character, check first, in case of ?' posCurrent++; else if (c == m_chSegment) // ' { // Make sure the whole segment is on one line. styler won't let us go back in time, so we'll settle for marking the ' as bad. Sci_Position lineSegmentStart = pAccess->LineFromPosition(posSegmentStart); Sci_Position lineSegmentEnd = pAccess->LineFromPosition(posCurrent); if (lineSegmentStart == lineSegmentEnd) styler.ColourTo(posCurrent, SCE_EDI_SEGMENTEND); else styler.ColourTo(posCurrent, SCE_EDI_BADSEGMENT); posSegmentStart = -1; posCurrent++; break; } else if (c == m_chComponent) // : styler.ColourTo(posCurrent, SCE_EDI_SEP_COMPOSITE); else if (c == m_chData) // + styler.ColourTo(posCurrent, SCE_EDI_SEP_ELEMENT); else styler.ColourTo(posCurrent, SCE_EDI_DEFAULT); } } styler.Flush(); if (posSegmentStart == -1) return; pAccess->StartStyling(posSegmentStart); pAccess->SetStyleFor(posFinish - posSegmentStart, SCE_EDI_BADSEGMENT); } void LexerEDIFACT::Fold(Sci_PositionU startPos, Sci_Position length, int, IDocument *pAccess) { if (!m_bFold) return; Sci_PositionU endPos = startPos + length; startPos = FindPreviousEnd(pAccess, startPos); char c; char SegmentHeader[4] = { 0 }; bool AwaitingSegment = true; Sci_PositionU currLine = pAccess->LineFromPosition(startPos); int levelCurrentStyle = SC_FOLDLEVELBASE; if (currLine > 0) levelCurrentStyle = pAccess->GetLevel(currLine - 1); // bottom 12 bits are level int indentCurrent = levelCurrentStyle & SC_FOLDLEVELNUMBERMASK; int indentNext = indentCurrent; while (startPos < endPos) { pAccess->GetCharRange(&c, startPos, 1); switch (c) { case '\t': case '\r': case ' ': startPos++; continue; case '\n': currLine = pAccess->LineFromPosition(startPos); pAccess->SetLevel(currLine, levelCurrentStyle | indentCurrent); startPos++; levelCurrentStyle = SC_FOLDLEVELBASE; indentCurrent = indentNext; continue; } if (c == m_chRelease) { startPos += 2; continue; } if (c == m_chSegment) { AwaitingSegment = true; startPos++; continue; } if (!AwaitingSegment) { startPos++; continue; } // Segment! pAccess->GetCharRange(SegmentHeader, startPos, 3); if (SegmentHeader[0] != 'U' || SegmentHeader[1] != 'N') { startPos++; continue; } AwaitingSegment = false; switch (SegmentHeader[2]) { case 'H': case 'G': indentNext++; levelCurrentStyle = SC_FOLDLEVELBASE | SC_FOLDLEVELHEADERFLAG; break; case 'T': case 'E': if (indentNext > 0) indentNext--; break; } startPos += 3; } } Sci_Position LexerEDIFACT::InitialiseFromUNA(IDocument *pAccess, Sci_PositionU MaxLength) { MaxLength -= 9; // drop 9 chars, to give us room for UNA:+.? ' Sci_PositionU startPos = 0; startPos += ForwardPastWhitespace(pAccess, 0, MaxLength); if (startPos < MaxLength) { char bufUNA[9]; pAccess->GetCharRange(bufUNA, startPos, 9); // Check it's UNA segment if (!memcmp(bufUNA, "UNA", 3)) { m_chComponent = bufUNA[3]; m_chData = bufUNA[4]; m_chDecimal = bufUNA[5]; m_chRelease = bufUNA[6]; // bufUNA [7] should be space - reserved. m_chSegment = bufUNA[8]; return 0; // success! } } // We failed to find a UNA, so drop to defaults m_chComponent = ':'; m_chData = '+'; m_chDecimal = '.'; m_chRelease = '?'; m_chSegment = '\''; return -1; } Sci_Position LexerEDIFACT::ForwardPastWhitespace(IDocument *pAccess, Sci_Position startPos, Sci_Position MaxLength) const { char c; while (startPos < MaxLength) { pAccess->GetCharRange(&c, startPos, 1); switch (c) { case '\t': case '\r': case '\n': case ' ': break; default: return startPos; } startPos++; } return MaxLength; } int LexerEDIFACT::DetectSegmentHeader(char SegmentHeader[3]) const { if ( SegmentHeader[0] < 'A' || SegmentHeader[0] > 'Z' || SegmentHeader[1] < 'A' || SegmentHeader[1] > 'Z' || SegmentHeader[2] < 'A' || SegmentHeader[2] > 'Z') return SCE_EDI_BADSEGMENT; if (!memcmp(SegmentHeader, "UNA", 3)) return SCE_EDI_UNA; if (m_bHighlightAllUN && !memcmp(SegmentHeader, "UN", 2)) return SCE_EDI_UNH; else if (!memcmp(SegmentHeader, "UNH", 3)) return SCE_EDI_UNH; else if (!memcmp(SegmentHeader, "UNG", 3)) return SCE_EDI_UNH; return SCE_EDI_SEGMENTSTART; } // Look backwards for a ' or a document beginning Sci_Position LexerEDIFACT::FindPreviousEnd(IDocument *pAccess, Sci_Position startPos) const { for (char c; startPos > 0; startPos--) { pAccess->GetCharRange(&c, startPos, 1); if (c == m_chSegment) return startPos; } // We didn't find a ', so just go with the beginning return 0; } lexilla/lexers/LexAVS.cxx0000664000175000017500000002064314647367374014334 0ustar neilneil// Scintilla source code edit control /** @file LexAVS.cxx ** Lexer for AviSynth. **/ // Copyright 2012 by Bruno Barbieri // Heavily based on LexPOV by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static inline bool IsAWordChar(const int ch) { return (ch < 0x80) && (isalnum(ch) || ch == '_'); } static inline bool IsAWordStart(int ch) { return isalpha(ch) || (ch != ' ' && ch != '\n' && ch != '(' && ch != '.' && ch != ','); } static inline bool IsANumberChar(int ch) { // Not exactly following number definition (several dots are seen as OK, etc.) // but probably enough in most cases. return (ch < 0x80) && (isdigit(ch) || ch == '.' || ch == '-' || ch == '+'); } static void ColouriseAvsDoc( Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { WordList &keywords = *keywordlists[0]; WordList &filters = *keywordlists[1]; WordList &plugins = *keywordlists[2]; WordList &functions = *keywordlists[3]; WordList &clipProperties = *keywordlists[4]; WordList &userDefined = *keywordlists[5]; Sci_Position currentLine = styler.GetLine(startPos); // Initialize the block comment nesting level, if we are inside such a comment. int blockCommentLevel = 0; if (initStyle == SCE_AVS_COMMENTBLOCK || initStyle == SCE_AVS_COMMENTBLOCKN) { blockCommentLevel = styler.GetLineState(currentLine - 1); } // Do not leak onto next line if (initStyle == SCE_AVS_COMMENTLINE) { initStyle = SCE_AVS_DEFAULT; } StyleContext sc(startPos, length, initStyle, styler); for (; sc.More(); sc.Forward()) { if (sc.atLineEnd) { // Update the line state, so it can be seen by next line currentLine = styler.GetLine(sc.currentPos); if (sc.state == SCE_AVS_COMMENTBLOCK || sc.state == SCE_AVS_COMMENTBLOCKN) { // Inside a block comment, we set the line state styler.SetLineState(currentLine, blockCommentLevel); } else { // Reset the line state styler.SetLineState(currentLine, 0); } } // Determine if the current state should terminate. if (sc.state == SCE_AVS_OPERATOR) { sc.SetState(SCE_AVS_DEFAULT); } else if (sc.state == SCE_AVS_NUMBER) { // We stop the number definition on non-numerical non-dot non-sign char if (!IsANumberChar(sc.ch)) { sc.SetState(SCE_AVS_DEFAULT); } } else if (sc.state == SCE_AVS_IDENTIFIER) { if (!IsAWordChar(sc.ch)) { char s[100]; sc.GetCurrentLowered(s, sizeof(s)); if (keywords.InList(s)) { sc.ChangeState(SCE_AVS_KEYWORD); } else if (filters.InList(s)) { sc.ChangeState(SCE_AVS_FILTER); } else if (plugins.InList(s)) { sc.ChangeState(SCE_AVS_PLUGIN); } else if (functions.InList(s)) { sc.ChangeState(SCE_AVS_FUNCTION); } else if (clipProperties.InList(s)) { sc.ChangeState(SCE_AVS_CLIPPROP); } else if (userDefined.InList(s)) { sc.ChangeState(SCE_AVS_USERDFN); } sc.SetState(SCE_AVS_DEFAULT); } } else if (sc.state == SCE_AVS_COMMENTBLOCK) { if (sc.Match('/', '*')) { blockCommentLevel++; sc.Forward(); } else if (sc.Match('*', '/') && blockCommentLevel > 0) { blockCommentLevel--; sc.Forward(); if (blockCommentLevel == 0) { sc.ForwardSetState(SCE_AVS_DEFAULT); } } } else if (sc.state == SCE_AVS_COMMENTBLOCKN) { if (sc.Match('[', '*')) { blockCommentLevel++; sc.Forward(); } else if (sc.Match('*', ']') && blockCommentLevel > 0) { blockCommentLevel--; sc.Forward(); if (blockCommentLevel == 0) { sc.ForwardSetState(SCE_AVS_DEFAULT); } } } else if (sc.state == SCE_AVS_COMMENTLINE) { if (sc.atLineEnd) { sc.ForwardSetState(SCE_AVS_DEFAULT); } } else if (sc.state == SCE_AVS_STRING) { if (sc.ch == '\"') { sc.ForwardSetState(SCE_AVS_DEFAULT); } } else if (sc.state == SCE_AVS_TRIPLESTRING) { if (sc.Match("\"\"\"")) { sc.Forward(); sc.Forward(); sc.ForwardSetState(SCE_AVS_DEFAULT); } } // Determine if a new state should be entered. if (sc.state == SCE_AVS_DEFAULT) { if (IsADigit(sc.ch) || (sc.ch == '.' && IsADigit(sc.chNext))) { sc.SetState(SCE_AVS_NUMBER); } else if (IsADigit(sc.ch) || (sc.ch == ',' && IsADigit(sc.chNext))) { sc.Forward(); sc.SetState(SCE_AVS_NUMBER); } else if (sc.Match('/', '*')) { blockCommentLevel = 1; sc.SetState(SCE_AVS_COMMENTBLOCK); sc.Forward(); // Eat the * so it isn't used for the end of the comment } else if (sc.Match('[', '*')) { blockCommentLevel = 1; sc.SetState(SCE_AVS_COMMENTBLOCKN); sc.Forward(); // Eat the * so it isn't used for the end of the comment } else if (sc.ch == '#') { sc.SetState(SCE_AVS_COMMENTLINE); } else if (sc.ch == '\"') { if (sc.Match("\"\"\"")) { sc.SetState(SCE_AVS_TRIPLESTRING); } else { sc.SetState(SCE_AVS_STRING); } } else if (isoperator(static_cast(sc.ch))) { sc.SetState(SCE_AVS_OPERATOR); } else if (IsAWordStart(sc.ch)) { sc.SetState(SCE_AVS_IDENTIFIER); } } } // End of file: complete any pending changeState if (sc.state == SCE_AVS_IDENTIFIER) { if (!IsAWordChar(sc.ch)) { char s[100]; sc.GetCurrentLowered(s, sizeof(s)); if (keywords.InList(s)) { sc.ChangeState(SCE_AVS_KEYWORD); } else if (filters.InList(s)) { sc.ChangeState(SCE_AVS_FILTER); } else if (plugins.InList(s)) { sc.ChangeState(SCE_AVS_PLUGIN); } else if (functions.InList(s)) { sc.ChangeState(SCE_AVS_FUNCTION); } else if (clipProperties.InList(s)) { sc.ChangeState(SCE_AVS_CLIPPROP); } else if (userDefined.InList(s)) { sc.ChangeState(SCE_AVS_USERDFN); } sc.SetState(SCE_AVS_DEFAULT); } } sc.Complete(); } static void FoldAvsDoc( Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *[], Accessor &styler) { bool foldComment = styler.GetPropertyInt("fold.comment") != 0; bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelPrev = styler.LevelAt(lineCurrent) & SC_FOLDLEVELNUMBERMASK; int levelCurrent = levelPrev; char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); int style = initStyle; for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); int stylePrev = style; style = styleNext; styleNext = styler.StyleAt(i + 1); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (foldComment && style == SCE_AVS_COMMENTBLOCK) { if (stylePrev != SCE_AVS_COMMENTBLOCK) { levelCurrent++; } else if ((styleNext != SCE_AVS_COMMENTBLOCK) && !atEOL) { // Comments don't end at end of line and the next character may be unstyled. levelCurrent--; } } if (foldComment && style == SCE_AVS_COMMENTBLOCKN) { if (stylePrev != SCE_AVS_COMMENTBLOCKN) { levelCurrent++; } else if ((styleNext != SCE_AVS_COMMENTBLOCKN) && !atEOL) { // Comments don't end at end of line and the next character may be unstyled. levelCurrent--; } } if (style == SCE_AVS_OPERATOR) { if (ch == '{') { levelCurrent++; } else if (ch == '}') { levelCurrent--; } } if (atEOL) { int lev = levelPrev; if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if ((levelCurrent > levelPrev) && (visibleChars > 0)) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelPrev = levelCurrent; visibleChars = 0; } if (!isspacechar(ch)) visibleChars++; } // Fill in the real level of the next line, keeping the current flags as they will be filled in later int flagsNext = styler.LevelAt(lineCurrent) & ~SC_FOLDLEVELNUMBERMASK; styler.SetLevel(lineCurrent, levelPrev | flagsNext); } static const char * const avsWordLists[] = { "Keywords", "Filters", "Plugins", "Functions", "Clip properties", "User defined functions", 0, }; LexerModule lmAVS(SCLEX_AVS, ColouriseAvsDoc, "avs", FoldAvsDoc, avsWordLists); lexilla/lexers/LexBasic.cxx0000664000175000017500000004106614647367374014726 0ustar neilneil// Scintilla source code edit control /** @file LexBasic.cxx ** Lexer for BlitzBasic and PureBasic. ** Converted to lexer object and added further folding features/properties by "Udo Lechner" **/ // Copyright 1998-2003 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. // This tries to be a unified Lexer/Folder for all the BlitzBasic/BlitzMax/PurBasic basics // and derivatives. Once they diverge enough, might want to split it into multiple // lexers for more code clearity. // // Mail me (elias users sf net) for any bugs. // Folding only works for simple things like functions or types. // You may want to have a look at my ctags lexer as well, if you additionally to coloring // and folding need to extract things like label tags in your editor. #include #include #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" #include "OptionSet.h" #include "DefaultLexer.h" using namespace Scintilla; using namespace Lexilla; /* Bits: * 1 - whitespace * 2 - operator * 4 - identifier * 8 - decimal digit * 16 - hex digit * 32 - bin digit * 64 - letter */ static int character_classification[128] = { 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 1, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 2, 0, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 10, 2, 60, 60, 28, 28, 28, 28, 28, 28, 28, 28, 2, 2, 2, 2, 2, 2, 2, 84, 84, 84, 84, 84, 84, 68, 68, 68, 68, 68, 68, 68, 68, 68, 68, 68, 68, 68, 68, 68, 68, 68, 68, 68, 68, 2, 2, 2, 2, 68, 2, 84, 84, 84, 84, 84, 84, 68, 68, 68, 68, 68, 68, 68, 68, 68, 68, 68, 68, 68, 68, 68, 68, 68, 68, 68, 68, 2, 2, 2, 2, 0 }; static bool IsSpace(int c) { return c < 128 && (character_classification[c] & 1); } static bool IsOperator(int c) { return c < 128 && (character_classification[c] & 2); } static bool IsIdentifier(int c) { return c < 128 && (character_classification[c] & 4); } static bool IsDigit(int c) { return c < 128 && (character_classification[c] & 8); } static bool IsHexDigit(int c) { return c < 128 && (character_classification[c] & 16); } static bool IsBinDigit(int c) { return c < 128 && (character_classification[c] & 32); } static bool IsLetter(int c) { return c < 128 && (character_classification[c] & 64); } static int LowerCase(int c) { if (c >= 'A' && c <= 'Z') return 'a' + c - 'A'; return c; } static int CheckBlitzFoldPoint(char const *token, int &level) { if (!strcmp(token, "function") || !strcmp(token, "type")) { level |= SC_FOLDLEVELHEADERFLAG; return 1; } if (!strcmp(token, "end function") || !strcmp(token, "end type")) { return -1; } return 0; } static int CheckPureFoldPoint(char const *token, int &level) { if (!strcmp(token, "procedure") || !strcmp(token, "enumeration") || !strcmp(token, "interface") || !strcmp(token, "structure")) { level |= SC_FOLDLEVELHEADERFLAG; return 1; } if (!strcmp(token, "endprocedure") || !strcmp(token, "endenumeration") || !strcmp(token, "endinterface") || !strcmp(token, "endstructure")) { return -1; } return 0; } static int CheckFreeFoldPoint(char const *token, int &level) { if (!strcmp(token, "function") || !strcmp(token, "sub") || !strcmp(token, "enum") || !strcmp(token, "type") || !strcmp(token, "union") || !strcmp(token, "property") || !strcmp(token, "destructor") || !strcmp(token, "constructor")) { level |= SC_FOLDLEVELHEADERFLAG; return 1; } if (!strcmp(token, "end function") || !strcmp(token, "end sub") || !strcmp(token, "end enum") || !strcmp(token, "end type") || !strcmp(token, "end union") || !strcmp(token, "end property") || !strcmp(token, "end destructor") || !strcmp(token, "end constructor")) { return -1; } return 0; } // An individual named option for use in an OptionSet // Options used for LexerBasic struct OptionsBasic { bool fold; bool foldSyntaxBased; bool foldCommentExplicit; std::string foldExplicitStart; std::string foldExplicitEnd; bool foldExplicitAnywhere; bool foldCompact; OptionsBasic() { fold = false; foldSyntaxBased = true; foldCommentExplicit = false; foldExplicitStart = ""; foldExplicitEnd = ""; foldExplicitAnywhere = false; foldCompact = true; } }; static const char * const blitzbasicWordListDesc[] = { "BlitzBasic Keywords", "user1", "user2", "user3", 0 }; static const char * const purebasicWordListDesc[] = { "PureBasic Keywords", "PureBasic PreProcessor Keywords", "user defined 1", "user defined 2", 0 }; static const char * const freebasicWordListDesc[] = { "FreeBasic Keywords", "FreeBasic PreProcessor Keywords", "user defined 1", "user defined 2", 0 }; struct OptionSetBasic : public OptionSet { OptionSetBasic(const char * const wordListDescriptions[]) { DefineProperty("fold", &OptionsBasic::fold); DefineProperty("fold.basic.syntax.based", &OptionsBasic::foldSyntaxBased, "Set this property to 0 to disable syntax based folding."); DefineProperty("fold.basic.comment.explicit", &OptionsBasic::foldCommentExplicit, "This option enables folding explicit fold points when using the Basic lexer. " "Explicit fold points allows adding extra folding by placing a ;{ (BB/PB) or '{ (FB) comment at the start " "and a ;} (BB/PB) or '} (FB) at the end of a section that should be folded."); DefineProperty("fold.basic.explicit.start", &OptionsBasic::foldExplicitStart, "The string to use for explicit fold start points, replacing the standard ;{ (BB/PB) or '{ (FB)."); DefineProperty("fold.basic.explicit.end", &OptionsBasic::foldExplicitEnd, "The string to use for explicit fold end points, replacing the standard ;} (BB/PB) or '} (FB)."); DefineProperty("fold.basic.explicit.anywhere", &OptionsBasic::foldExplicitAnywhere, "Set this property to 1 to enable explicit fold points anywhere, not just in line comments."); DefineProperty("fold.compact", &OptionsBasic::foldCompact); DefineWordListSets(wordListDescriptions); } }; class LexerBasic : public DefaultLexer { char comment_char; int (*CheckFoldPoint)(char const *, int &); WordList keywordlists[4]; OptionsBasic options; OptionSetBasic osBasic; public: LexerBasic(const char *languageName_, int language_, char comment_char_, int (*CheckFoldPoint_)(char const *, int &), const char * const wordListDescriptions[]) : DefaultLexer(languageName_, language_), comment_char(comment_char_), CheckFoldPoint(CheckFoldPoint_), osBasic(wordListDescriptions) { } virtual ~LexerBasic() { } void SCI_METHOD Release() override { delete this; } int SCI_METHOD Version() const override { return lvRelease5; } const char * SCI_METHOD PropertyNames() override { return osBasic.PropertyNames(); } int SCI_METHOD PropertyType(const char *name) override { return osBasic.PropertyType(name); } const char * SCI_METHOD DescribeProperty(const char *name) override { return osBasic.DescribeProperty(name); } Sci_Position SCI_METHOD PropertySet(const char *key, const char *val) override; const char * SCI_METHOD PropertyGet(const char *key) override { return osBasic.PropertyGet(key); } const char * SCI_METHOD DescribeWordListSets() override { return osBasic.DescribeWordListSets(); } Sci_Position SCI_METHOD WordListSet(int n, const char *wl) override; void SCI_METHOD Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void SCI_METHOD Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void * SCI_METHOD PrivateCall(int, void *) override { return 0; } static ILexer5 *LexerFactoryBlitzBasic() { return new LexerBasic("blitzbasic", SCLEX_BLITZBASIC, ';', CheckBlitzFoldPoint, blitzbasicWordListDesc); } static ILexer5 *LexerFactoryPureBasic() { return new LexerBasic("purebasic", SCLEX_PUREBASIC, ';', CheckPureFoldPoint, purebasicWordListDesc); } static ILexer5 *LexerFactoryFreeBasic() { return new LexerBasic("freebasic", SCLEX_FREEBASIC, '\'', CheckFreeFoldPoint, freebasicWordListDesc ); } }; Sci_Position SCI_METHOD LexerBasic::PropertySet(const char *key, const char *val) { if (osBasic.PropertySet(&options, key, val)) { return 0; } return -1; } Sci_Position SCI_METHOD LexerBasic::WordListSet(int n, const char *wl) { WordList *wordListN = 0; switch (n) { case 0: wordListN = &keywordlists[0]; break; case 1: wordListN = &keywordlists[1]; break; case 2: wordListN = &keywordlists[2]; break; case 3: wordListN = &keywordlists[3]; break; } Sci_Position firstModification = -1; if (wordListN) { WordList wlNew; wlNew.Set(wl); if (*wordListN != wlNew) { wordListN->Set(wl); firstModification = 0; } } return firstModification; } void SCI_METHOD LexerBasic::Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { LexAccessor styler(pAccess); bool wasfirst = true, isfirst = true; // true if first token in a line styler.StartAt(startPos); int styleBeforeKeyword = SCE_B_DEFAULT; StyleContext sc(startPos, length, initStyle, styler); // Can't use sc.More() here else we miss the last character for (; ; sc.Forward()) { if (sc.state == SCE_B_IDENTIFIER) { if (!IsIdentifier(sc.ch)) { // Labels if (wasfirst && sc.Match(':')) { sc.ChangeState(SCE_B_LABEL); sc.ForwardSetState(SCE_B_DEFAULT); } else { char s[100]; int kstates[4] = { SCE_B_KEYWORD, SCE_B_KEYWORD2, SCE_B_KEYWORD3, SCE_B_KEYWORD4, }; sc.GetCurrentLowered(s, sizeof(s)); for (int i = 0; i < 4; i++) { if (keywordlists[i].InList(s)) { sc.ChangeState(kstates[i]); } } // Types, must set them as operator else they will be // matched as number/constant if (sc.Match('.') || sc.Match('$') || sc.Match('%') || sc.Match('#')) { sc.SetState(SCE_B_OPERATOR); } else { sc.SetState(SCE_B_DEFAULT); } } } } else if (sc.state == SCE_B_OPERATOR) { if (!IsOperator(sc.ch) || sc.Match('#')) sc.SetState(SCE_B_DEFAULT); } else if (sc.state == SCE_B_LABEL) { if (!IsIdentifier(sc.ch)) sc.SetState(SCE_B_DEFAULT); } else if (sc.state == SCE_B_CONSTANT) { if (!IsIdentifier(sc.ch)) sc.SetState(SCE_B_DEFAULT); } else if (sc.state == SCE_B_NUMBER) { if (!IsDigit(sc.ch)) sc.SetState(SCE_B_DEFAULT); } else if (sc.state == SCE_B_HEXNUMBER) { if (!IsHexDigit(sc.ch)) sc.SetState(SCE_B_DEFAULT); } else if (sc.state == SCE_B_BINNUMBER) { if (!IsBinDigit(sc.ch)) sc.SetState(SCE_B_DEFAULT); } else if (sc.state == SCE_B_STRING) { if (sc.ch == '"') { sc.ForwardSetState(SCE_B_DEFAULT); } if (sc.atLineEnd) { sc.ChangeState(SCE_B_ERROR); sc.SetState(SCE_B_DEFAULT); } } else if (sc.state == SCE_B_COMMENT || sc.state == SCE_B_PREPROCESSOR) { if (sc.atLineEnd) { sc.SetState(SCE_B_DEFAULT); } } else if (sc.state == SCE_B_DOCLINE) { if (sc.atLineEnd) { sc.SetState(SCE_B_DEFAULT); } else if (sc.ch == '\\' || sc.ch == '@') { if (IsLetter(sc.chNext) && sc.chPrev != '\\') { styleBeforeKeyword = sc.state; sc.SetState(SCE_B_DOCKEYWORD); }; } } else if (sc.state == SCE_B_DOCKEYWORD) { if (IsSpace(sc.ch)) { sc.SetState(styleBeforeKeyword); } else if (sc.atLineEnd && styleBeforeKeyword == SCE_B_DOCLINE) { sc.SetState(SCE_B_DEFAULT); } } else if (sc.state == SCE_B_COMMENTBLOCK) { if (sc.Match("\'/")) { sc.Forward(); sc.ForwardSetState(SCE_B_DEFAULT); } } else if (sc.state == SCE_B_DOCBLOCK) { if (sc.Match("\'/")) { sc.Forward(); sc.ForwardSetState(SCE_B_DEFAULT); } else if (sc.ch == '\\' || sc.ch == '@') { if (IsLetter(sc.chNext) && sc.chPrev != '\\') { styleBeforeKeyword = sc.state; sc.SetState(SCE_B_DOCKEYWORD); }; } } if (sc.atLineStart) isfirst = true; if (sc.state == SCE_B_DEFAULT || sc.state == SCE_B_ERROR) { if (isfirst && sc.Match('.') && comment_char != '\'') { sc.SetState(SCE_B_LABEL); } else if (isfirst && sc.Match('#')) { wasfirst = isfirst; sc.SetState(SCE_B_IDENTIFIER); } else if (sc.Match(comment_char)) { // Hack to make deprecated QBASIC '$Include show // up in freebasic with SCE_B_PREPROCESSOR. if (comment_char == '\'' && sc.Match(comment_char, '$')) sc.SetState(SCE_B_PREPROCESSOR); else if (sc.Match("\'*") || sc.Match("\'!")) { sc.SetState(SCE_B_DOCLINE); } else { sc.SetState(SCE_B_COMMENT); } } else if (sc.Match("/\'")) { if (sc.Match("/\'*") || sc.Match("/\'!")) { // Support of gtk-doc/Doxygen doc. style sc.SetState(SCE_B_DOCBLOCK); } else { sc.SetState(SCE_B_COMMENTBLOCK); } sc.Forward(); // Eat the ' so it isn't used for the end of the comment } else if (sc.Match('"')) { sc.SetState(SCE_B_STRING); } else if (IsDigit(sc.ch)) { sc.SetState(SCE_B_NUMBER); } else if (sc.Match('$') || sc.Match("&h") || sc.Match("&H") || sc.Match("&o") || sc.Match("&O")) { sc.SetState(SCE_B_HEXNUMBER); } else if (sc.Match('%') || sc.Match("&b") || sc.Match("&B")) { sc.SetState(SCE_B_BINNUMBER); } else if (sc.Match('#')) { sc.SetState(SCE_B_CONSTANT); } else if (IsOperator(sc.ch)) { sc.SetState(SCE_B_OPERATOR); } else if (IsIdentifier(sc.ch)) { wasfirst = isfirst; sc.SetState(SCE_B_IDENTIFIER); } else if (!IsSpace(sc.ch)) { sc.SetState(SCE_B_ERROR); } } if (!IsSpace(sc.ch)) isfirst = false; if (!sc.More()) break; } sc.Complete(); } void SCI_METHOD LexerBasic::Fold(Sci_PositionU startPos, Sci_Position length, int /* initStyle */, IDocument *pAccess) { if (!options.fold) return; LexAccessor styler(pAccess); Sci_Position line = styler.GetLine(startPos); int level = styler.LevelAt(line); int go = 0, done = 0; Sci_Position endPos = startPos + length; char word[256]; int wordlen = 0; const bool userDefinedFoldMarkers = !options.foldExplicitStart.empty() && !options.foldExplicitEnd.empty(); int cNext = styler[startPos]; // Scan for tokens at the start of the line (they may include // whitespace, for tokens like "End Function" for (Sci_Position i = startPos; i < endPos; i++) { int c = cNext; cNext = styler.SafeGetCharAt(i + 1); bool atEOL = (c == '\r' && cNext != '\n') || (c == '\n'); if (options.foldSyntaxBased && !done && !go) { if (wordlen) { // are we scanning a token already? word[wordlen] = static_cast(LowerCase(c)); if (!IsIdentifier(c)) { // done with token word[wordlen] = '\0'; go = CheckFoldPoint(word, level); if (!go) { // Treat any whitespace as single blank, for // things like "End Function". if (IsSpace(c) && IsIdentifier(word[wordlen - 1])) { word[wordlen] = ' '; if (wordlen < 255) wordlen++; } else // done with this line done = 1; } } else if (wordlen < 255) { wordlen++; } } else { // start scanning at first non-whitespace character if (!IsSpace(c)) { if (IsIdentifier(c)) { word[0] = static_cast(LowerCase(c)); wordlen = 1; } else // done with this line done = 1; } } } if (options.foldCommentExplicit && ((styler.StyleAt(i) == SCE_B_COMMENT) || options.foldExplicitAnywhere)) { if (userDefinedFoldMarkers) { if (styler.Match(i, options.foldExplicitStart.c_str())) { level |= SC_FOLDLEVELHEADERFLAG; go = 1; } else if (styler.Match(i, options.foldExplicitEnd.c_str())) { go = -1; } } else { if (c == comment_char) { if (cNext == '{') { level |= SC_FOLDLEVELHEADERFLAG; go = 1; } else if (cNext == '}') { go = -1; } } } } if (atEOL) { // line end if (!done && wordlen == 0 && options.foldCompact) // line was only space level |= SC_FOLDLEVELWHITEFLAG; if (level != styler.LevelAt(line)) styler.SetLevel(line, level); level += go; line++; // reset state wordlen = 0; level &= ~SC_FOLDLEVELHEADERFLAG; level &= ~SC_FOLDLEVELWHITEFLAG; go = 0; done = 0; } } } LexerModule lmBlitzBasic(SCLEX_BLITZBASIC, LexerBasic::LexerFactoryBlitzBasic, "blitzbasic", blitzbasicWordListDesc); LexerModule lmPureBasic(SCLEX_PUREBASIC, LexerBasic::LexerFactoryPureBasic, "purebasic", purebasicWordListDesc); LexerModule lmFreeBasic(SCLEX_FREEBASIC, LexerBasic::LexerFactoryFreeBasic, "freebasic", freebasicWordListDesc); lexilla/lexers/LexModula.cxx0000664000175000017500000004043714647367374015127 0ustar neilneil// -*- coding: utf-8 -*- // Scintilla source code edit control /** * @file LexModula.cxx * @author Dariusz "DKnoto" Knociński * @date 2011/02/03 * @brief Lexer for Modula-2/3 documents. */ // The License.txt file describes the conditions under which this software may // be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "PropSetSimple.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; #ifdef DEBUG_LEX_MODULA #define DEBUG_STATE( p, c )\ fprintf( stderr, "Unknown state: currentPos = %u, char = '%c'\n", static_cast(p), c ); #else #define DEBUG_STATE( p, c ) #endif static inline bool IsDigitOfBase( unsigned ch, unsigned base ) { if( ch < '0' || ch > 'f' ) return false; if( base <= 10 ) { if( ch >= ( '0' + base ) ) return false; } else { if( ch > '9' ) { unsigned nb = base - 10; if( ( ch < 'A' ) || ( ch >= ( 'A' + nb ) ) ) { if( ( ch < 'a' ) || ( ch >= ( 'a' + nb ) ) ) { return false; } } } } return true; } static inline unsigned IsOperator( StyleContext & sc, WordList & op ) { int i; char s[3]; s[0] = sc.ch; s[1] = sc.chNext; s[2] = 0; for( i = 0; i < op.Length(); i++ ) { if( ( strlen( op.WordAt(i) ) == 2 ) && ( s[0] == op.WordAt(i)[0] && s[1] == op.WordAt(i)[1] ) ) { return 2; } } s[1] = 0; for( i = 0; i < op.Length(); i++ ) { if( ( strlen( op.WordAt(i) ) == 1 ) && ( s[0] == op.WordAt(i)[0] ) ) { return 1; } } return 0; } static inline bool IsEOL( Accessor &styler, Sci_PositionU curPos ) { unsigned ch = styler.SafeGetCharAt( curPos ); if( ( ch == '\r' && styler.SafeGetCharAt( curPos + 1 ) == '\n' ) || ( ch == '\n' && styler.SafeGetCharAt( curPos - 1 ) != '\r' ) ) { return true; } return false; } static inline bool checkStatement( Accessor &styler, Sci_Position &curPos, const char *stt, bool spaceAfter = true ) { int len = static_cast(strlen( stt )); int i; for( i = 0; i < len; i++ ) { if( styler.SafeGetCharAt( curPos + i ) != stt[i] ) { return false; } } if( spaceAfter ) { if( ! isspace( styler.SafeGetCharAt( curPos + i ) ) ) { return false; } } curPos += ( len - 1 ); return true; } static inline bool checkEndSemicolon( Accessor &styler, Sci_Position &curPos, Sci_Position endPos ) { const char *stt = "END"; int len = static_cast(strlen( stt )); int i; for( i = 0; i < len; i++ ) { if( styler.SafeGetCharAt( curPos + i ) != stt[i] ) { return false; } } while( isspace( styler.SafeGetCharAt( curPos + i ) ) ) { i++; if( ( curPos + i ) >= endPos ) return false; } if( styler.SafeGetCharAt( curPos + i ) != ';' ) { return false; } curPos += ( i - 1 ); return true; } static inline bool checkKeyIdentOper( Accessor &styler, Sci_Position &curPos, Sci_Position endPos, const char *stt, const char etk ) { Sci_Position newPos = curPos; if( ! checkStatement( styler, newPos, stt ) ) return false; newPos++; if( newPos >= endPos ) return false; if( ! isspace( styler.SafeGetCharAt( newPos ) ) ) return false; newPos++; if( newPos >= endPos ) return false; while( isspace( styler.SafeGetCharAt( newPos ) ) ) { newPos++; if( newPos >= endPos ) return false; } if( ! isalpha( styler.SafeGetCharAt( newPos ) ) ) return false; newPos++; if( newPos >= endPos ) return false; char ch; ch = styler.SafeGetCharAt( newPos ); while( isalpha( ch ) || isdigit( ch ) || ch == '_' ) { newPos++; if( newPos >= endPos ) return false; ch = styler.SafeGetCharAt( newPos ); } while( isspace( styler.SafeGetCharAt( newPos ) ) ) { newPos++; if( newPos >= endPos ) return false; } if( styler.SafeGetCharAt( newPos ) != etk ) return false; curPos = newPos; return true; } static void FoldModulaDoc( Sci_PositionU startPos, Sci_Position length, int , WordList *[], Accessor &styler) { Sci_Position curLine = styler.GetLine(startPos); int curLevel = SC_FOLDLEVELBASE; Sci_Position endPos = startPos + length; if( curLine > 0 ) curLevel = styler.LevelAt( curLine - 1 ) >> 16; Sci_Position curPos = startPos; int style = styler.StyleAt( curPos ); int visChars = 0; int nextLevel = curLevel; while( curPos < endPos ) { if( ! isspace( styler.SafeGetCharAt( curPos ) ) ) visChars++; switch( style ) { case SCE_MODULA_COMMENT: if( checkStatement( styler, curPos, "(*" ) ) nextLevel++; else if( checkStatement( styler, curPos, "*)" ) ) nextLevel--; break; case SCE_MODULA_DOXYCOMM: if( checkStatement( styler, curPos, "(**", false ) ) nextLevel++; else if( checkStatement( styler, curPos, "*)" ) ) nextLevel--; break; case SCE_MODULA_KEYWORD: if( checkStatement( styler, curPos, "IF" ) ) nextLevel++; else if( checkStatement( styler, curPos, "BEGIN" ) ) nextLevel++; else if( checkStatement( styler, curPos, "TRY" ) ) nextLevel++; else if( checkStatement( styler, curPos, "LOOP" ) ) nextLevel++; else if( checkStatement( styler, curPos, "FOR" ) ) nextLevel++; else if( checkStatement( styler, curPos, "WHILE" ) ) nextLevel++; else if( checkStatement( styler, curPos, "REPEAT" ) ) nextLevel++; else if( checkStatement( styler, curPos, "UNTIL" ) ) nextLevel--; else if( checkStatement( styler, curPos, "WITH" ) ) nextLevel++; else if( checkStatement( styler, curPos, "CASE" ) ) nextLevel++; else if( checkStatement( styler, curPos, "TYPECASE" ) ) nextLevel++; else if( checkStatement( styler, curPos, "LOCK" ) ) nextLevel++; else if( checkKeyIdentOper( styler, curPos, endPos, "PROCEDURE", '(' ) ) nextLevel++; else if( checkKeyIdentOper( styler, curPos, endPos, "END", ';' ) ) { Sci_Position cln = curLine; int clv_old = curLevel; Sci_Position pos; char ch; int clv_new; while( cln > 0 ) { clv_new = styler.LevelAt( cln - 1 ) >> 16; if( clv_new < clv_old ) { nextLevel--; pos = styler.LineStart( cln ); while( ( ch = styler.SafeGetCharAt( pos, '\n' )) != '\n') { if( ch == 'P' ) { if( styler.StyleAt(pos) == SCE_MODULA_KEYWORD ) { if( checkKeyIdentOper( styler, pos, endPos, "PROCEDURE", '(' ) ) { break; } } } pos++; } clv_old = clv_new; } cln--; } } else if( checkKeyIdentOper( styler, curPos, endPos, "END", '.' ) ) nextLevel--; else if( checkEndSemicolon( styler, curPos, endPos ) ) nextLevel--; else { while( styler.StyleAt( curPos + 1 ) == SCE_MODULA_KEYWORD ) curPos++; } break; default: break; } if( IsEOL( styler, curPos ) || ( curPos == endPos - 1 ) ) { int efectiveLevel = curLevel | nextLevel << 16; if( visChars == 0 ) efectiveLevel |= SC_FOLDLEVELWHITEFLAG; if( curLevel < nextLevel ) efectiveLevel |= SC_FOLDLEVELHEADERFLAG; if( efectiveLevel != styler.LevelAt(curLine) ) { styler.SetLevel(curLine, efectiveLevel ); } curLine++; curLevel = nextLevel; if( IsEOL( styler, curPos ) && ( curPos == endPos - 1 ) ) { styler.SetLevel( curLine, ( curLevel | curLevel << 16) | SC_FOLDLEVELWHITEFLAG); } visChars = 0; } curPos++; style = styler.StyleAt( curPos ); } } static inline bool skipWhiteSpaces( StyleContext & sc ) { while( isspace( sc.ch ) ) { sc.SetState( SCE_MODULA_DEFAULT ); if( sc.More() ) sc.Forward(); else return false; } return true; } static void ColouriseModulaDoc( Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *wl[], Accessor &styler ) { WordList& keyWords = *wl[0]; WordList& reservedWords = *wl[1]; WordList& operators = *wl[2]; WordList& pragmaWords = *wl[3]; WordList& escapeCodes = *wl[4]; WordList& doxyKeys = *wl[5]; const int BUFLEN = 128; char buf[BUFLEN]; int i, kl; Sci_Position charPos = 0; StyleContext sc( startPos, length, initStyle, styler ); while( sc.More() ) { switch( sc.state ) { case SCE_MODULA_DEFAULT: if( ! skipWhiteSpaces( sc ) ) break; if( sc.ch == '(' && sc.chNext == '*' ) { if( sc.GetRelative(2) == '*' ) { sc.SetState( SCE_MODULA_DOXYCOMM ); sc.Forward(); } else { sc.SetState( SCE_MODULA_COMMENT ); } sc.Forward(); } else if( isalpha( sc.ch ) ) { if( isupper( sc.ch ) && isupper( sc.chNext ) ) { for( i = 0; i < BUFLEN - 1; i++ ) { buf[i] = sc.GetRelative(i); if( !isalpha( buf[i] ) && !(buf[i] == '_') ) break; } kl = i; buf[kl] = 0; if( keyWords.InList( buf ) ) { sc.SetState( SCE_MODULA_KEYWORD ); sc.Forward( kl ); sc.SetState( SCE_MODULA_DEFAULT ); continue; } else if( reservedWords.InList( buf ) ) { sc.SetState( SCE_MODULA_RESERVED ); sc.Forward( kl ); sc.SetState( SCE_MODULA_DEFAULT ); continue; } else { /** check procedure identifier */ sc.Forward( kl ); continue; } } else { for( i = 0; i < BUFLEN - 1; i++ ) { buf[i] = sc.GetRelative(i); if( !isalpha( buf[i] ) && !isdigit( buf[i] ) && !(buf[i] == '_') ) break; } kl = i; buf[kl] = 0; sc.SetState( SCE_MODULA_DEFAULT ); sc.Forward( kl ); continue; } } else if( isdigit( sc.ch ) ) { sc.SetState( SCE_MODULA_NUMBER ); continue; } else if( sc.ch == '\"' ) { sc.SetState( SCE_MODULA_STRING ); } else if( sc.ch == '\'' ) { charPos = sc.currentPos; sc.SetState( SCE_MODULA_CHAR ); } else if( sc.ch == '<' && sc.chNext == '*' ) { sc.SetState( SCE_MODULA_PRAGMA ); sc.Forward(); } else { unsigned len = IsOperator( sc, operators ); if( len > 0 ) { sc.SetState( SCE_MODULA_OPERATOR ); sc.Forward( len ); sc.SetState( SCE_MODULA_DEFAULT ); continue; } else { DEBUG_STATE( sc.currentPos, sc.ch ); } } break; case SCE_MODULA_COMMENT: if( sc.ch == '*' && sc.chNext == ')' ) { sc.Forward( 2 ); sc.SetState( SCE_MODULA_DEFAULT ); continue; } break; case SCE_MODULA_DOXYCOMM: switch( sc.ch ) { case '*': if( sc.chNext == ')' ) { sc.Forward( 2 ); sc.SetState( SCE_MODULA_DEFAULT ); continue; } break; case '@': if( islower( sc.chNext ) ) { for( i = 0; i < BUFLEN - 1; i++ ) { buf[i] = sc.GetRelative(i+1); if( isspace( buf[i] ) ) break; } buf[i] = 0; kl = i; if( doxyKeys.InList( buf ) ) { sc.SetState( SCE_MODULA_DOXYKEY ); sc.Forward( kl + 1 ); sc.SetState( SCE_MODULA_DOXYCOMM ); } } break; default: break; } break; case SCE_MODULA_NUMBER: { buf[0] = sc.ch; for( i = 1; i < BUFLEN - 1; i++ ) { buf[i] = sc.GetRelative(i); if( ! isdigit( buf[i] ) ) break; } kl = i; buf[kl] = 0; switch( sc.GetRelative(kl) ) { case '_': { int base = atoi( buf ); if( base < 2 || base > 16 ) { sc.SetState( SCE_MODULA_BADSTR ); } else { int imax; kl++; for( i = 0; i < BUFLEN - 1; i++ ) { buf[i] = sc.GetRelative(kl+i); if( ! IsDigitOfBase( buf[i], 16 ) ) { break; } } imax = i; for( i = 0; i < imax; i++ ) { if( ! IsDigitOfBase( buf[i], base ) ) { sc.SetState( SCE_MODULA_BADSTR ); break; } } kl += imax; } sc.SetState( SCE_MODULA_BASENUM ); for( i = 0; i < kl; i++ ) { sc.Forward(); } sc.SetState( SCE_MODULA_DEFAULT ); continue; } break; case '.': if( sc.GetRelative(kl+1) == '.' ) { kl--; for( i = 0; i < kl; i++ ) { sc.Forward(); } sc.Forward(); sc.SetState( SCE_MODULA_DEFAULT ); continue; } else { bool doNext = false; kl++; buf[0] = sc.GetRelative(kl); if( isdigit( buf[0] ) ) { for( i = 0;; i++ ) { if( !isdigit(sc.GetRelative(kl+i)) ) break; } kl += i; buf[0] = sc.GetRelative(kl); switch( buf[0] ) { case 'E': case 'e': case 'D': case 'd': case 'X': case 'x': kl++; buf[0] = sc.GetRelative(kl); if( buf[0] == '-' || buf[0] == '+' ) { kl++; } buf[0] = sc.GetRelative(kl); if( isdigit( buf[0] ) ) { for( i = 0;; i++ ) { if( !isdigit(sc.GetRelative(kl+i)) ) { buf[0] = sc.GetRelative(kl+i); break; } } kl += i; doNext = true; } else { sc.SetState( SCE_MODULA_BADSTR ); } break; default: doNext = true; break; } } else { sc.SetState( SCE_MODULA_BADSTR ); } if( doNext ) { if( ! isspace( buf[0] ) && buf[0] != ')' && buf[0] != '>' && buf[0] != '<' && buf[0] != '=' && buf[0] != '#' && buf[0] != '+' && buf[0] != '-' && buf[0] != '*' && buf[0] != '/' && buf[0] != ',' && buf[0] != ';' ) { sc.SetState( SCE_MODULA_BADSTR ); } else { kl--; } } } sc.SetState( SCE_MODULA_FLOAT ); for( i = 0; i < kl; i++ ) { sc.Forward(); } sc.SetState( SCE_MODULA_DEFAULT ); continue; break; default: for( i = 0; i < kl; i++ ) { sc.Forward(); } break; } sc.SetState( SCE_MODULA_DEFAULT ); continue; } break; case SCE_MODULA_STRING: if( sc.ch == '\"' ) { sc.Forward(); sc.SetState( SCE_MODULA_DEFAULT ); continue; } else { if( sc.ch == '\\' ) { i = 1; if( IsDigitOfBase( sc.chNext, 8 ) ) { for( i = 1; i < BUFLEN - 1; i++ ) { if( ! IsDigitOfBase(sc.GetRelative(i+1), 8 ) ) break; } if( i == 3 ) { sc.SetState( SCE_MODULA_STRSPEC ); } else { sc.SetState( SCE_MODULA_BADSTR ); } } else { buf[0] = sc.chNext; buf[1] = 0; if( escapeCodes.InList( buf ) ) { sc.SetState( SCE_MODULA_STRSPEC ); } else { sc.SetState( SCE_MODULA_BADSTR ); } } sc.Forward(i+1); sc.SetState( SCE_MODULA_STRING ); continue; } } break; case SCE_MODULA_CHAR: if( sc.ch == '\'' ) { sc.Forward(); sc.SetState( SCE_MODULA_DEFAULT ); continue; } else if( ( sc.currentPos - charPos ) == 1 ) { if( sc.ch == '\\' ) { i = 1; if( IsDigitOfBase( sc.chNext, 8 ) ) { for( i = 1; i < BUFLEN - 1; i++ ) { if( ! IsDigitOfBase(sc.GetRelative(i+1), 8 ) ) break; } if( i == 3 ) { sc.SetState( SCE_MODULA_CHARSPEC ); } else { sc.SetState( SCE_MODULA_BADSTR ); } } else { buf[0] = sc.chNext; buf[1] = 0; if( escapeCodes.InList( buf ) ) { sc.SetState( SCE_MODULA_CHARSPEC ); } else { sc.SetState( SCE_MODULA_BADSTR ); } } sc.Forward(i+1); sc.SetState( SCE_MODULA_CHAR ); continue; } } else { sc.SetState( SCE_MODULA_BADSTR ); sc.Forward(); sc.SetState( SCE_MODULA_CHAR ); continue; } break; case SCE_MODULA_PRAGMA: if( sc.ch == '*' && sc.chNext == '>' ) { sc.Forward(); sc.Forward(); sc.SetState( SCE_MODULA_DEFAULT ); continue; } else if( isupper( sc.ch ) && isupper( sc.chNext ) ) { buf[0] = sc.ch; buf[1] = sc.chNext; for( i = 2; i < BUFLEN - 1; i++ ) { buf[i] = sc.GetRelative(i); if( !isupper( buf[i] ) ) break; } kl = i; buf[kl] = 0; if( pragmaWords.InList( buf ) ) { sc.SetState( SCE_MODULA_PRGKEY ); sc.Forward( kl ); sc.SetState( SCE_MODULA_PRAGMA ); continue; } } break; default: break; } sc.Forward(); } sc.Complete(); } static const char *const modulaWordListDesc[] = { "Keywords", "ReservedKeywords", "Operators", "PragmaKeyswords", "EscapeCodes", "DoxygeneKeywords", 0 }; LexerModule lmModula( SCLEX_MODULA, ColouriseModulaDoc, "modula", FoldModulaDoc, modulaWordListDesc); lexilla/lexers/LexECL.cxx0000664000175000017500000003651714647367374014315 0ustar neilneil// Scintilla source code edit control /** @file LexECL.cxx ** Lexer for ECL. **/ // Copyright 1998-2001 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #ifdef _MSC_VER #pragma warning(disable: 4786) #endif #ifdef __BORLANDC__ // Borland C++ displays warnings in vector header without this #pragma option -w-ccc -w-rch #endif #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "PropSetSimple.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" #include "OptionSet.h" #define SET_LOWER "abcdefghijklmnopqrstuvwxyz" #define SET_UPPER "ABCDEFGHIJKLMNOPQRSTUVWXYZ" #define SET_DIGITS "0123456789" using namespace Lexilla; static bool IsSpaceEquiv(int state) { switch (state) { case SCE_ECL_DEFAULT: case SCE_ECL_COMMENT: case SCE_ECL_COMMENTLINE: case SCE_ECL_COMMENTLINEDOC: case SCE_ECL_COMMENTDOCKEYWORD: case SCE_ECL_COMMENTDOCKEYWORDERROR: case SCE_ECL_COMMENTDOC: return true; default: return false; } } static void ColouriseEclDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { WordList &keywords0 = *keywordlists[0]; WordList &keywords1 = *keywordlists[1]; WordList &keywords2 = *keywordlists[2]; WordList &keywords3 = *keywordlists[3]; //Value Types WordList &keywords4 = *keywordlists[4]; WordList &keywords5 = *keywordlists[5]; WordList &keywords6 = *keywordlists[6]; //Javadoc Tags WordList cplusplus; cplusplus.Set("beginc endc"); bool stylingWithinPreprocessor = false; CharacterSet setOKBeforeRE(CharacterSet::setNone, "(=,"); CharacterSet setDoxygen(CharacterSet::setLower, "$@\\&<>#{}[]"); CharacterSet setWordStart(CharacterSet::setAlpha, "_", 0x80, true); CharacterSet setWord(CharacterSet::setAlphaNum, "._", 0x80, true); CharacterSet setQualified(CharacterSet::setNone, "uUxX"); int chPrevNonWhite = ' '; int visibleChars = 0; bool lastWordWasUUID = false; int styleBeforeDCKeyword = SCE_ECL_DEFAULT; bool continuationLine = false; if (initStyle == SCE_ECL_PREPROCESSOR) { // Set continuationLine if last character of previous line is '\' Sci_Position lineCurrent = styler.GetLine(startPos); if (lineCurrent > 0) { int chBack = styler.SafeGetCharAt(startPos-1, 0); int chBack2 = styler.SafeGetCharAt(startPos-2, 0); int lineEndChar = '!'; if (chBack2 == '\r' && chBack == '\n') { lineEndChar = styler.SafeGetCharAt(startPos-3, 0); } else if (chBack == '\n' || chBack == '\r') { lineEndChar = chBack2; } continuationLine = lineEndChar == '\\'; } } // look back to set chPrevNonWhite properly for better regex colouring if (startPos > 0) { Sci_Position back = startPos; while (--back && IsSpaceEquiv(styler.StyleAt(back))) ; if (styler.StyleAt(back) == SCE_ECL_OPERATOR) { chPrevNonWhite = styler.SafeGetCharAt(back); } } StyleContext sc(startPos, length, initStyle, styler); for (; sc.More(); sc.Forward()) { if (sc.atLineStart) { if (sc.state == SCE_ECL_STRING) { // Prevent SCE_ECL_STRINGEOL from leaking back to previous line which // ends with a line continuation by locking in the state upto this position. sc.SetState(SCE_ECL_STRING); } // Reset states to begining of colourise so no surprises // if different sets of lines lexed. visibleChars = 0; lastWordWasUUID = false; } // Handle line continuation generically. if (sc.ch == '\\') { if (sc.chNext == '\n' || sc.chNext == '\r') { sc.Forward(); if (sc.ch == '\r' && sc.chNext == '\n') { sc.Forward(); } continuationLine = true; continue; } } // Determine if the current state should terminate. switch (sc.state) { case SCE_ECL_ADDED: case SCE_ECL_DELETED: case SCE_ECL_CHANGED: case SCE_ECL_MOVED: if (sc.atLineStart) sc.SetState(SCE_ECL_DEFAULT); break; case SCE_ECL_OPERATOR: sc.SetState(SCE_ECL_DEFAULT); break; case SCE_ECL_NUMBER: // We accept almost anything because of hex. and number suffixes if (!setWord.Contains(sc.ch)) { sc.SetState(SCE_ECL_DEFAULT); } break; case SCE_ECL_IDENTIFIER: if (!setWord.Contains(sc.ch) || (sc.ch == '.')) { char s[1000]; sc.GetCurrentLowered(s, sizeof(s)); if (keywords0.InList(s)) { lastWordWasUUID = strcmp(s, "uuid") == 0; sc.ChangeState(SCE_ECL_WORD0); } else if (keywords1.InList(s)) { sc.ChangeState(SCE_ECL_WORD1); } else if (keywords2.InList(s)) { sc.ChangeState(SCE_ECL_WORD2); } else if (keywords4.InList(s)) { sc.ChangeState(SCE_ECL_WORD4); } else if (keywords5.InList(s)) { sc.ChangeState(SCE_ECL_WORD5); } else //Data types are of from KEYWORD## { int i = static_cast(strlen(s)) - 1; while(i >= 0 && (isdigit(s[i]) || s[i] == '_')) --i; char s2[1000]; strncpy(s2, s, i + 1); s2[i + 1] = 0; if (keywords3.InList(s2)) { sc.ChangeState(SCE_ECL_WORD3); } } sc.SetState(SCE_ECL_DEFAULT); } break; case SCE_ECL_PREPROCESSOR: if (sc.atLineStart && !continuationLine) { sc.SetState(SCE_ECL_DEFAULT); } else if (stylingWithinPreprocessor) { if (IsASpace(sc.ch)) { sc.SetState(SCE_ECL_DEFAULT); } } else { if (sc.Match('/', '*') || sc.Match('/', '/')) { sc.SetState(SCE_ECL_DEFAULT); } } break; case SCE_ECL_COMMENT: if (sc.Match('*', '/')) { sc.Forward(); sc.ForwardSetState(SCE_ECL_DEFAULT); } break; case SCE_ECL_COMMENTDOC: if (sc.Match('*', '/')) { sc.Forward(); sc.ForwardSetState(SCE_ECL_DEFAULT); } else if (sc.ch == '@' || sc.ch == '\\') { // JavaDoc and Doxygen support // Verify that we have the conditions to mark a comment-doc-keyword if ((IsASpace(sc.chPrev) || sc.chPrev == '*') && (!IsASpace(sc.chNext))) { styleBeforeDCKeyword = SCE_ECL_COMMENTDOC; sc.SetState(SCE_ECL_COMMENTDOCKEYWORD); } } break; case SCE_ECL_COMMENTLINE: if (sc.atLineStart) { sc.SetState(SCE_ECL_DEFAULT); } break; case SCE_ECL_COMMENTLINEDOC: if (sc.atLineStart) { sc.SetState(SCE_ECL_DEFAULT); } else if (sc.ch == '@' || sc.ch == '\\') { // JavaDoc and Doxygen support // Verify that we have the conditions to mark a comment-doc-keyword if ((IsASpace(sc.chPrev) || sc.chPrev == '/' || sc.chPrev == '!') && (!IsASpace(sc.chNext))) { styleBeforeDCKeyword = SCE_ECL_COMMENTLINEDOC; sc.SetState(SCE_ECL_COMMENTDOCKEYWORD); } } break; case SCE_ECL_COMMENTDOCKEYWORD: if ((styleBeforeDCKeyword == SCE_ECL_COMMENTDOC) && sc.Match('*', '/')) { sc.ChangeState(SCE_ECL_COMMENTDOCKEYWORDERROR); sc.Forward(); sc.ForwardSetState(SCE_ECL_DEFAULT); } else if (!setDoxygen.Contains(sc.ch)) { char s[1000]; sc.GetCurrentLowered(s, sizeof(s)); if (!IsASpace(sc.ch) || !keywords6.InList(s+1)) { sc.ChangeState(SCE_ECL_COMMENTDOCKEYWORDERROR); } sc.SetState(styleBeforeDCKeyword); } break; case SCE_ECL_STRING: if (sc.atLineEnd) { sc.ChangeState(SCE_ECL_STRINGEOL); } else if (sc.ch == '\\') { if (sc.chNext == '\"' || sc.chNext == '\'' || sc.chNext == '\\') { sc.Forward(); } } else if (sc.ch == '\"') { sc.ForwardSetState(SCE_ECL_DEFAULT); } break; case SCE_ECL_CHARACTER: if (sc.atLineEnd) { sc.ChangeState(SCE_ECL_STRINGEOL); } else if (sc.ch == '\\') { if (sc.chNext == '\"' || sc.chNext == '\'' || sc.chNext == '\\') { sc.Forward(); } } else if (sc.ch == '\'') { sc.ForwardSetState(SCE_ECL_DEFAULT); } break; case SCE_ECL_REGEX: if (sc.atLineStart) { sc.SetState(SCE_ECL_DEFAULT); } else if (sc.ch == '/') { sc.Forward(); while ((sc.ch < 0x80) && islower(sc.ch)) sc.Forward(); // gobble regex flags sc.SetState(SCE_ECL_DEFAULT); } else if (sc.ch == '\\') { // Gobble up the quoted character if (sc.chNext == '\\' || sc.chNext == '/') { sc.Forward(); } } break; case SCE_ECL_STRINGEOL: if (sc.atLineStart) { sc.SetState(SCE_ECL_DEFAULT); } break; case SCE_ECL_VERBATIM: if (sc.ch == '\"') { if (sc.chNext == '\"') { sc.Forward(); } else { sc.ForwardSetState(SCE_ECL_DEFAULT); } } break; case SCE_ECL_UUID: if (sc.ch == '\r' || sc.ch == '\n' || sc.ch == ')') { sc.SetState(SCE_ECL_DEFAULT); } break; } // Determine if a new state should be entered. Sci_Position lineCurrent = styler.GetLine(sc.currentPos); int lineState = styler.GetLineState(lineCurrent); if (sc.state == SCE_ECL_DEFAULT) { if (lineState) { sc.SetState(lineState); } else if (sc.Match('@', '\"')) { sc.SetState(SCE_ECL_VERBATIM); sc.Forward(); } else if (setQualified.Contains(sc.ch) && sc.chNext == '\'') { sc.SetState(SCE_ECL_CHARACTER); sc.Forward(); } else if (IsADigit(sc.ch) || (sc.ch == '.' && IsADigit(sc.chNext))) { if (lastWordWasUUID) { sc.SetState(SCE_ECL_UUID); lastWordWasUUID = false; } else { sc.SetState(SCE_ECL_NUMBER); } } else if (setWordStart.Contains(sc.ch) || (sc.ch == '@')) { if (lastWordWasUUID) { sc.SetState(SCE_ECL_UUID); lastWordWasUUID = false; } else { sc.SetState(SCE_ECL_IDENTIFIER); } } else if (sc.Match('/', '*')) { if (sc.Match("/**") || sc.Match("/*!")) { // Support of Qt/Doxygen doc. style sc.SetState(SCE_ECL_COMMENTDOC); } else { sc.SetState(SCE_ECL_COMMENT); } sc.Forward(); // Eat the * so it isn't used for the end of the comment } else if (sc.Match('/', '/')) { if ((sc.Match("///") && !sc.Match("////")) || sc.Match("//!")) // Support of Qt/Doxygen doc. style sc.SetState(SCE_ECL_COMMENTLINEDOC); else sc.SetState(SCE_ECL_COMMENTLINE); } else if (sc.ch == '/' && setOKBeforeRE.Contains(chPrevNonWhite)) { sc.SetState(SCE_ECL_REGEX); // JavaScript's RegEx // } else if (sc.ch == '\"') { // sc.SetState(SCE_ECL_STRING); } else if (sc.ch == '\'') { sc.SetState(SCE_ECL_CHARACTER); } else if (sc.ch == '#' && visibleChars == 0) { // Preprocessor commands are alone on their line sc.SetState(SCE_ECL_PREPROCESSOR); // Skip whitespace between # and preprocessor word do { sc.Forward(); } while ((sc.ch == ' ' || sc.ch == '\t') && sc.More()); if (sc.atLineEnd) { sc.SetState(SCE_ECL_DEFAULT); } } else if (isoperator(static_cast(sc.ch))) { sc.SetState(SCE_ECL_OPERATOR); } } if (!IsASpace(sc.ch) && !IsSpaceEquiv(sc.state)) { chPrevNonWhite = sc.ch; visibleChars++; } continuationLine = false; } sc.Complete(); } static bool IsStreamCommentStyle(int style) { return style == SCE_ECL_COMMENT || style == SCE_ECL_COMMENTDOC || style == SCE_ECL_COMMENTDOCKEYWORD || style == SCE_ECL_COMMENTDOCKEYWORDERROR; } static bool MatchNoCase(Accessor & styler, Sci_PositionU & pos, const char *s) { Sci_Position i=0; for (; *s; i++) { char compare_char = tolower(*s); char styler_char = tolower(styler.SafeGetCharAt(pos+i)); if (compare_char != styler_char) return false; s++; } pos+=i-1; return true; } // Store both the current line's fold level and the next lines in the // level store to make it easy to pick up with each increment // and to make it possible to fiddle the current level for "} else {". static void FoldEclDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *[], Accessor &styler) { bool foldComment = true; bool foldPreprocessor = true; bool foldCompact = true; bool foldAtElse = true; Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelCurrent = SC_FOLDLEVELBASE; if (lineCurrent > 0) levelCurrent = styler.LevelAt(lineCurrent-1) >> 16; int levelMinCurrent = levelCurrent; int levelNext = levelCurrent; char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); int style = initStyle; for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); int stylePrev = style; style = styleNext; styleNext = styler.StyleAt(i + 1); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (foldComment && IsStreamCommentStyle(style)) { if (!IsStreamCommentStyle(stylePrev) && (stylePrev != SCE_ECL_COMMENTLINEDOC)) { levelNext++; } else if (!IsStreamCommentStyle(styleNext) && (styleNext != SCE_ECL_COMMENTLINEDOC) && !atEOL) { // Comments don't end at end of line and the next character may be unstyled. levelNext--; } } if (foldComment && (style == SCE_ECL_COMMENTLINE)) { if ((ch == '/') && (chNext == '/')) { char chNext2 = styler.SafeGetCharAt(i + 2); if (chNext2 == '{') { levelNext++; } else if (chNext2 == '}') { levelNext--; } } } if (foldPreprocessor && (style == SCE_ECL_PREPROCESSOR)) { if (ch == '#') { Sci_PositionU j = i + 1; while ((j < endPos) && IsASpaceOrTab(styler.SafeGetCharAt(j))) { j++; } if (MatchNoCase(styler, j, "region") || MatchNoCase(styler, j, "if")) { levelNext++; } else if (MatchNoCase(styler, j, "endregion") || MatchNoCase(styler, j, "end")) { levelNext--; } } } if (style == SCE_ECL_OPERATOR) { if (ch == '{') { // Measure the minimum before a '{' to allow // folding on "} else {" if (levelMinCurrent > levelNext) { levelMinCurrent = levelNext; } levelNext++; } else if (ch == '}') { levelNext--; } } if (style == SCE_ECL_WORD2) { if (MatchNoCase(styler, i, "record") || MatchNoCase(styler, i, "transform") || MatchNoCase(styler, i, "type") || MatchNoCase(styler, i, "function") || MatchNoCase(styler, i, "module") || MatchNoCase(styler, i, "service") || MatchNoCase(styler, i, "interface") || MatchNoCase(styler, i, "ifblock") || MatchNoCase(styler, i, "macro") || MatchNoCase(styler, i, "beginc++")) { levelNext++; } else if (MatchNoCase(styler, i, "endmacro") || MatchNoCase(styler, i, "endc++") || MatchNoCase(styler, i, "end")) { levelNext--; } } if (atEOL || (i == endPos-1)) { int levelUse = levelCurrent; if (foldAtElse) { levelUse = levelMinCurrent; } int lev = levelUse | levelNext << 16; if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if (levelUse < levelNext) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelCurrent = levelNext; levelMinCurrent = levelCurrent; if (atEOL && (i == static_cast(styler.Length()-1))) { // There is an empty line at end of file so give it same level and empty styler.SetLevel(lineCurrent, (levelCurrent | levelCurrent << 16) | SC_FOLDLEVELWHITEFLAG); } visibleChars = 0; } if (!IsASpace(ch)) visibleChars++; } } static const char * const EclWordListDesc[] = { "Keywords", 0 }; LexerModule lmECL( SCLEX_ECL, ColouriseEclDoc, "ecl", FoldEclDoc, EclWordListDesc); lexilla/lexers/LexEiffel.cxx0000664000175000017500000001673114647367374015100 0ustar neilneil// Scintilla source code edit control /** @file LexEiffel.cxx ** Lexer for Eiffel. **/ // Copyright 1998-2001 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static inline bool isEiffelOperator(unsigned int ch) { // '.' left out as it is used to make up numbers return ch == '*' || ch == '/' || ch == '\\' || ch == '-' || ch == '+' || ch == '(' || ch == ')' || ch == '=' || ch == '{' || ch == '}' || ch == '~' || ch == '[' || ch == ']' || ch == ';' || ch == '<' || ch == '>' || ch == ',' || ch == '.' || ch == '^' || ch == '%' || ch == ':' || ch == '!' || ch == '@' || ch == '?'; } static inline bool IsAWordChar(unsigned int ch) { return (ch < 0x80) && (isalnum(ch) || ch == '_'); } static inline bool IsAWordStart(unsigned int ch) { return (ch < 0x80) && (isalnum(ch) || ch == '_'); } static void ColouriseEiffelDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { WordList &keywords = *keywordlists[0]; StyleContext sc(startPos, length, initStyle, styler); for (; sc.More(); sc.Forward()) { if (sc.state == SCE_EIFFEL_STRINGEOL) { if (sc.ch != '\r' && sc.ch != '\n') { sc.SetState(SCE_EIFFEL_DEFAULT); } } else if (sc.state == SCE_EIFFEL_OPERATOR) { sc.SetState(SCE_EIFFEL_DEFAULT); } else if (sc.state == SCE_EIFFEL_WORD) { if (!IsAWordChar(sc.ch)) { char s[100]; sc.GetCurrentLowered(s, sizeof(s)); if (!keywords.InList(s)) { sc.ChangeState(SCE_EIFFEL_IDENTIFIER); } sc.SetState(SCE_EIFFEL_DEFAULT); } } else if (sc.state == SCE_EIFFEL_NUMBER) { if (!IsAWordChar(sc.ch)) { sc.SetState(SCE_EIFFEL_DEFAULT); } } else if (sc.state == SCE_EIFFEL_COMMENTLINE) { if (sc.ch == '\r' || sc.ch == '\n') { sc.SetState(SCE_EIFFEL_DEFAULT); } } else if (sc.state == SCE_EIFFEL_STRING) { if (sc.ch == '%') { sc.Forward(); } else if (sc.ch == '\"') { sc.Forward(); sc.SetState(SCE_EIFFEL_DEFAULT); } } else if (sc.state == SCE_EIFFEL_CHARACTER) { if (sc.ch == '\r' || sc.ch == '\n') { sc.SetState(SCE_EIFFEL_STRINGEOL); } else if (sc.ch == '%') { sc.Forward(); } else if (sc.ch == '\'') { sc.Forward(); sc.SetState(SCE_EIFFEL_DEFAULT); } } if (sc.state == SCE_EIFFEL_DEFAULT) { if (sc.ch == '-' && sc.chNext == '-') { sc.SetState(SCE_EIFFEL_COMMENTLINE); } else if (sc.ch == '\"') { sc.SetState(SCE_EIFFEL_STRING); } else if (sc.ch == '\'') { sc.SetState(SCE_EIFFEL_CHARACTER); } else if (IsADigit(sc.ch) || (sc.ch == '.')) { sc.SetState(SCE_EIFFEL_NUMBER); } else if (IsAWordStart(sc.ch)) { sc.SetState(SCE_EIFFEL_WORD); } else if (isEiffelOperator(sc.ch)) { sc.SetState(SCE_EIFFEL_OPERATOR); } } } sc.Complete(); } static bool IsEiffelComment(Accessor &styler, Sci_Position pos, Sci_Position len) { return len>1 && styler[pos]=='-' && styler[pos+1]=='-'; } static void FoldEiffelDocIndent(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { Sci_Position lengthDoc = startPos + length; // Backtrack to previous line in case need to fix its fold status Sci_Position lineCurrent = styler.GetLine(startPos); if (startPos > 0) { if (lineCurrent > 0) { lineCurrent--; startPos = styler.LineStart(lineCurrent); } } int spaceFlags = 0; int indentCurrent = styler.IndentAmount(lineCurrent, &spaceFlags, IsEiffelComment); char chNext = styler[startPos]; for (Sci_Position i = startPos; i < lengthDoc; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); if ((ch == '\r' && chNext != '\n') || (ch == '\n') || (i == lengthDoc)) { int lev = indentCurrent; int indentNext = styler.IndentAmount(lineCurrent + 1, &spaceFlags, IsEiffelComment); if (!(indentCurrent & SC_FOLDLEVELWHITEFLAG)) { // Only non whitespace lines can be headers if ((indentCurrent & SC_FOLDLEVELNUMBERMASK) < (indentNext & SC_FOLDLEVELNUMBERMASK)) { lev |= SC_FOLDLEVELHEADERFLAG; } else if (indentNext & SC_FOLDLEVELWHITEFLAG) { // Line after is blank so check the next - maybe should continue further? int spaceFlags2 = 0; int indentNext2 = styler.IndentAmount(lineCurrent + 2, &spaceFlags2, IsEiffelComment); if ((indentCurrent & SC_FOLDLEVELNUMBERMASK) < (indentNext2 & SC_FOLDLEVELNUMBERMASK)) { lev |= SC_FOLDLEVELHEADERFLAG; } } } indentCurrent = indentNext; styler.SetLevel(lineCurrent, lev); lineCurrent++; } } } static void FoldEiffelDocKeyWords(Sci_PositionU startPos, Sci_Position length, int /* initStyle */, WordList *[], Accessor &styler) { Sci_PositionU lengthDoc = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelPrev = styler.LevelAt(lineCurrent) & SC_FOLDLEVELNUMBERMASK; int levelCurrent = levelPrev; char chNext = styler[startPos]; int stylePrev = 0; int styleNext = styler.StyleAt(startPos); // lastDeferred should be determined by looking back to last keyword in case // the "deferred" is on a line before "class" bool lastDeferred = false; for (Sci_PositionU i = startPos; i < lengthDoc; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); int style = styleNext; styleNext = styler.StyleAt(i + 1); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if ((stylePrev != SCE_EIFFEL_WORD) && (style == SCE_EIFFEL_WORD)) { char s[20]; Sci_PositionU j = 0; while ((j < (sizeof(s) - 1)) && (iswordchar(styler[i + j]))) { s[j] = styler[i + j]; j++; } s[j] = '\0'; if ( (strcmp(s, "check") == 0) || (strcmp(s, "debug") == 0) || (strcmp(s, "deferred") == 0) || (strcmp(s, "do") == 0) || (strcmp(s, "from") == 0) || (strcmp(s, "if") == 0) || (strcmp(s, "inspect") == 0) || (strcmp(s, "once") == 0) ) levelCurrent++; if (!lastDeferred && (strcmp(s, "class") == 0)) levelCurrent++; if (strcmp(s, "end") == 0) levelCurrent--; lastDeferred = strcmp(s, "deferred") == 0; } if (atEOL) { int lev = levelPrev; if (visibleChars == 0) lev |= SC_FOLDLEVELWHITEFLAG; if ((levelCurrent > levelPrev) && (visibleChars > 0)) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelPrev = levelCurrent; visibleChars = 0; } if (!isspacechar(ch)) visibleChars++; stylePrev = style; } // Fill in the real level of the next line, keeping the current flags as they will be filled in later int flagsNext = styler.LevelAt(lineCurrent) & ~SC_FOLDLEVELNUMBERMASK; styler.SetLevel(lineCurrent, levelPrev | flagsNext); } static const char * const eiffelWordListDesc[] = { "Keywords", 0 }; LexerModule lmEiffel(SCLEX_EIFFEL, ColouriseEiffelDoc, "eiffel", FoldEiffelDocIndent, eiffelWordListDesc); LexerModule lmEiffelkw(SCLEX_EIFFELKW, ColouriseEiffelDoc, "eiffelkw", FoldEiffelDocKeyWords, eiffelWordListDesc); lexilla/lexers/LexBaan.cxx0000664000175000017500000007417414647367374014554 0ustar neilneil// Scintilla source code edit control /** @file LexBaan.cxx ** Lexer for Baan. ** Based heavily on LexCPP.cxx **/ // Copyright 2001- by Vamsi Potluru & Praveen Ambekar // Maintainer Email: oirfeodent@yahoo.co.in // The License.txt file describes the conditions under which this software may be distributed. // C standard library #include #include // C++ wrappers of C standard library #include // C++ standard library #include #include #include #include // Scintilla headers // Non-platform-specific headers // include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" // lexlib #include "WordList.h" #include "LexAccessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" #include "OptionSet.h" #include "DefaultLexer.h" using namespace Scintilla; using namespace Lexilla; namespace { // Use an unnamed namespace to protect the functions and classes from name conflicts // Options used for LexerBaan struct OptionsBaan { bool fold; bool foldComment; bool foldPreprocessor; bool foldCompact; bool baanFoldSyntaxBased; bool baanFoldKeywordsBased; bool baanFoldSections; bool baanFoldInnerLevel; bool baanStylingWithinPreprocessor; OptionsBaan() { fold = false; foldComment = false; foldPreprocessor = false; foldCompact = false; baanFoldSyntaxBased = false; baanFoldKeywordsBased = false; baanFoldSections = false; baanFoldInnerLevel = false; baanStylingWithinPreprocessor = false; } }; const char *const baanWordLists[] = { "Baan & BaanSQL Reserved Keywords ", "Baan Standard functions", "Baan Functions Abridged", "Baan Main Sections ", "Baan Sub Sections", "PreDefined Variables", "PreDefined Attributes", "Enumerates", 0, }; struct OptionSetBaan : public OptionSet { OptionSetBaan() { DefineProperty("fold", &OptionsBaan::fold); DefineProperty("fold.comment", &OptionsBaan::foldComment); DefineProperty("fold.preprocessor", &OptionsBaan::foldPreprocessor); DefineProperty("fold.compact", &OptionsBaan::foldCompact); DefineProperty("fold.baan.syntax.based", &OptionsBaan::baanFoldSyntaxBased, "Set this property to 0 to disable syntax based folding, which is folding based on '{' & '('."); DefineProperty("fold.baan.keywords.based", &OptionsBaan::baanFoldKeywordsBased, "Set this property to 0 to disable keywords based folding, which is folding based on " " for, if, on (case), repeat, select, while and fold ends based on endfor, endif, endcase, until, endselect, endwhile respectively." "Also folds declarations which are grouped together."); DefineProperty("fold.baan.sections", &OptionsBaan::baanFoldSections, "Set this property to 0 to disable folding of Main Sections as well as Sub Sections."); DefineProperty("fold.baan.inner.level", &OptionsBaan::baanFoldInnerLevel, "Set this property to 1 to enable folding of inner levels of select statements." "Disabled by default. case and if statements are also eligible" ); DefineProperty("lexer.baan.styling.within.preprocessor", &OptionsBaan::baanStylingWithinPreprocessor, "For Baan code, determines whether all preprocessor code is styled in the " "preprocessor style (0, the default) or only from the initial # to the end " "of the command word(1)."); DefineWordListSets(baanWordLists); } }; static inline bool IsAWordChar(const int ch) { return (ch < 0x80) && (isalnum(ch) || ch == '.' || ch == '_' || ch == '$'); } static inline bool IsAnOperator(int ch) { if (IsAlphaNumeric(ch)) return false; if (ch == '#' || ch == '^' || ch == '&' || ch == '*' || ch == '(' || ch == ')' || ch == '-' || ch == '+' || ch == '=' || ch == '|' || ch == '{' || ch == '}' || ch == '[' || ch == ']' || ch == ':' || ch == ';' || ch == '<' || ch == '>' || ch == ',' || ch == '/' || ch == '?' || ch == '!' || ch == '"' || ch == '~' || ch == '\\') return true; return false; } static inline int IsAnyOtherIdentifier(char *s, Sci_Position sLength) { /* IsAnyOtherIdentifier uses standard templates used in baan. The matching template is shown as comments just above the return condition. ^ - refers to any character [a-z]. # - refers to any number [0-9]. Other characters shown are compared as is. Tried implementing with Regex... it was too complicated for me. Any other implementation suggestion welcome. */ switch (sLength) { case 8: if (isalpha(s[0]) && isalpha(s[1]) && isalpha(s[2]) && isalpha(s[3]) && isalpha(s[4]) && IsADigit(s[5]) && IsADigit(s[6]) && IsADigit(s[7])) { //^^^^^### return(SCE_BAAN_TABLEDEF); } break; case 9: if (s[0] == 't' && isalpha(s[1]) && isalpha(s[2]) && isalpha(s[3]) && isalpha(s[4]) && isalpha(s[5]) && IsADigit(s[6]) && IsADigit(s[7]) && IsADigit(s[8])) { //t^^^^^### return(SCE_BAAN_TABLEDEF); } else if (s[8] == '.' && isalpha(s[0]) && isalpha(s[1]) && isalpha(s[2]) && isalpha(s[3]) && isalpha(s[4]) && IsADigit(s[5]) && IsADigit(s[6]) && IsADigit(s[7])) { //^^^^^###. return(SCE_BAAN_TABLESQL); } break; case 13: if (s[8] == '.' && isalpha(s[0]) && isalpha(s[1]) && isalpha(s[2]) && isalpha(s[3]) && isalpha(s[4]) && IsADigit(s[5]) && IsADigit(s[6]) && IsADigit(s[7])) { //^^^^^###.**** return(SCE_BAAN_TABLESQL); } else if (s[0] == 'r' && s[1] == 'c' && s[2] == 'd' && s[3] == '.' && s[4] == 't' && isalpha(s[5]) && isalpha(s[6]) && isalpha(s[7]) && isalpha(s[8]) && isalpha(s[9]) && IsADigit(s[10]) && IsADigit(s[11]) && IsADigit(s[12])) { //rcd.t^^^^^### return(SCE_BAAN_TABLEDEF); } break; case 14: case 15: if (s[8] == '.' && isalpha(s[0]) && isalpha(s[1]) && isalpha(s[2]) && isalpha(s[3]) && isalpha(s[4]) && IsADigit(s[5]) && IsADigit(s[6]) && IsADigit(s[7])) { if (s[13] != ':') { //^^^^^###.****** return(SCE_BAAN_TABLESQL); } } break; case 16: case 17: if (s[8] == '.' && s[9] == '_' && s[10] == 'i' && s[11] == 'n' && s[12] == 'd' && s[13] == 'e' && s[14] == 'x' && IsADigit(s[15]) && isalpha(s[0]) && isalpha(s[1]) && isalpha(s[2]) && isalpha(s[3]) && isalpha(s[4]) && IsADigit(s[5]) && IsADigit(s[6]) && IsADigit(s[7])) { //^^^^^###._index## return(SCE_BAAN_TABLEDEF); } else if (s[8] == '.' && s[9] == '_' && s[10] == 'c' && s[11] == 'o' && s[12] == 'm' && s[13] == 'p' && s[14] == 'n' && s[15] == 'r' && isalpha(s[0]) && isalpha(s[1]) && isalpha(s[2]) && isalpha(s[3]) && isalpha(s[4]) && IsADigit(s[5]) && IsADigit(s[6]) && IsADigit(s[7])) { //^^^^^###._compnr return(SCE_BAAN_TABLEDEF); } break; default: break; } if (sLength > 14 && s[5] == '.' && s[6] == 'd' && s[7] == 'l' && s[8] == 'l' && s[13] == '.' && isalpha(s[0]) && isalpha(s[1]) && isalpha(s[2]) && isalpha(s[3]) && isalpha(s[4]) && IsADigit(s[9]) && IsADigit(s[10]) && IsADigit(s[11]) && IsADigit(s[12])) { //^^^^^.dll####. return(SCE_BAAN_FUNCTION); } else if (sLength > 15 && s[2] == 'i' && s[3] == 'n' && s[4] == 't' && s[5] == '.' && s[6] == 'd' && s[7] == 'l' && s[8] == 'l' && isalpha(s[0]) && isalpha(s[1]) && isalpha(s[9]) && isalpha(s[10]) && isalpha(s[11]) && isalpha(s[12]) && isalpha(s[13])) { //^^int.dll^^^^^. return(SCE_BAAN_FUNCTION); } else if (sLength > 11 && s[0] == 'i' && s[10] == '.' && isalpha(s[1]) && isalpha(s[2]) && isalpha(s[3]) && isalpha(s[4]) && isalpha(s[5]) && IsADigit(s[6]) && IsADigit(s[7]) && IsADigit(s[8]) && IsADigit(s[9])) { //i^^^^^####. return(SCE_BAAN_FUNCTION); } return(SCE_BAAN_DEFAULT); } static bool IsCommentLine(Sci_Position line, LexAccessor &styler) { Sci_Position pos = styler.LineStart(line); Sci_Position eol_pos = styler.LineStart(line + 1) - 1; for (Sci_Position i = pos; i < eol_pos; i++) { char ch = styler[i]; int style = styler.StyleAt(i); if (ch == '|' && style == SCE_BAAN_COMMENT) return true; else if (!IsASpaceOrTab(ch)) return false; } return false; } static bool IsPreProcLine(Sci_Position line, LexAccessor &styler) { Sci_Position pos = styler.LineStart(line); Sci_Position eol_pos = styler.LineStart(line + 1) - 1; for (Sci_Position i = pos; i < eol_pos; i++) { char ch = styler[i]; int style = styler.StyleAt(i); if (ch == '#' && style == SCE_BAAN_PREPROCESSOR) { if (styler.Match(i, "#elif") || styler.Match(i, "#else") || styler.Match(i, "#endif") || styler.Match(i, "#if") || styler.Match(i, "#ifdef") || styler.Match(i, "#ifndef")) // Above PreProcessors has a seperate fold mechanism. return false; else return true; } else if (ch == '^') return true; else if (!IsASpaceOrTab(ch)) return false; } return false; } static int mainOrSubSectionLine(Sci_Position line, LexAccessor &styler) { Sci_Position pos = styler.LineStart(line); Sci_Position eol_pos = styler.LineStart(line + 1) - 1; for (Sci_Position i = pos; i < eol_pos; i++) { char ch = styler[i]; int style = styler.StyleAt(i); if (style == SCE_BAAN_WORD5 || style == SCE_BAAN_WORD4) return style; else if (IsASpaceOrTab(ch)) continue; else break; } return 0; } static bool priorSectionIsSubSection(Sci_Position line, LexAccessor &styler){ while (line > 0) { Sci_Position pos = styler.LineStart(line); Sci_Position eol_pos = styler.LineStart(line + 1) - 1; for (Sci_Position i = pos; i < eol_pos; i++) { char ch = styler[i]; int style = styler.StyleAt(i); if (style == SCE_BAAN_WORD4) return true; else if (style == SCE_BAAN_WORD5) return false; else if (IsASpaceOrTab(ch)) continue; else break; } line--; } return false; } static bool nextSectionIsSubSection(Sci_Position line, LexAccessor &styler) { while (line > 0) { Sci_Position pos = styler.LineStart(line); Sci_Position eol_pos = styler.LineStart(line + 1) - 1; for (Sci_Position i = pos; i < eol_pos; i++) { char ch = styler[i]; int style = styler.StyleAt(i); if (style == SCE_BAAN_WORD4) return true; else if (style == SCE_BAAN_WORD5) return false; else if (IsASpaceOrTab(ch)) continue; else break; } line++; } return false; } static bool IsDeclarationLine(Sci_Position line, LexAccessor &styler) { Sci_Position pos = styler.LineStart(line); Sci_Position eol_pos = styler.LineStart(line + 1) - 1; for (Sci_Position i = pos; i < eol_pos; i++) { char ch = styler[i]; int style = styler.StyleAt(i); if (style == SCE_BAAN_WORD) { if (styler.Match(i, "table") || styler.Match(i, "extern") || styler.Match(i, "long") || styler.Match(i, "double") || styler.Match(i, "boolean") || styler.Match(i, "string") || styler.Match(i, "domain")) { for (Sci_Position j = eol_pos; j > pos; j--) { int styleFromEnd = styler.StyleAt(j); if (styleFromEnd == SCE_BAAN_COMMENT) continue; else if (IsASpace(styler[j])) continue; else if (styler[j] != ',') //Above conditions ensures, Declaration is not part of any function parameters. return true; else return false; } } else return false; } else if (!IsASpaceOrTab(ch)) return false; } return false; } static bool IsInnerLevelFold(Sci_Position line, LexAccessor &styler) { Sci_Position pos = styler.LineStart(line); Sci_Position eol_pos = styler.LineStart(line + 1) - 1; for (Sci_Position i = pos; i < eol_pos; i++) { char ch = styler[i]; int style = styler.StyleAt(i); if (style == SCE_BAAN_WORD && (styler.Match(i, "else" ) || styler.Match(i, "case") || styler.Match(i, "default") || styler.Match(i, "selectdo") || styler.Match(i, "selecteos") || styler.Match(i, "selectempty") || styler.Match(i, "selecterror"))) return true; else if (IsASpaceOrTab(ch)) continue; else return false; } return false; } static inline bool wordInArray(const std::string& value, std::string *array, int length) { for (int i = 0; i < length; i++) { if (value == array[i]) { return true; } } return false; } class WordListAbridged : public WordList { public: WordListAbridged() { kwAbridged = false; kwHasSection = false; }; ~WordListAbridged() { Clear(); }; bool kwAbridged; bool kwHasSection; bool Contains(const char *s) { return kwAbridged ? InListAbridged(s, '~') : InList(s); }; }; } class LexerBaan : public DefaultLexer { WordListAbridged keywords; WordListAbridged keywords2; WordListAbridged keywords3; WordListAbridged keywords4; WordListAbridged keywords5; WordListAbridged keywords6; WordListAbridged keywords7; WordListAbridged keywords8; WordListAbridged keywords9; OptionsBaan options; OptionSetBaan osBaan; public: LexerBaan() : DefaultLexer("baan", SCLEX_BAAN) { } virtual ~LexerBaan() { } int SCI_METHOD Version() const override { return lvRelease5; } void SCI_METHOD Release() override { delete this; } const char * SCI_METHOD PropertyNames() override { return osBaan.PropertyNames(); } int SCI_METHOD PropertyType(const char * name) override { return osBaan.PropertyType(name); } const char * SCI_METHOD DescribeProperty(const char * name) override { return osBaan.DescribeProperty(name); } Sci_Position SCI_METHOD PropertySet(const char *key, const char *val) override; const char * SCI_METHOD PropertyGet(const char *key) override { return osBaan.PropertyGet(key); } const char * SCI_METHOD DescribeWordListSets() override { return osBaan.DescribeWordListSets(); } Sci_Position SCI_METHOD WordListSet(int n, const char *wl) override; void SCI_METHOD Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void SCI_METHOD Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void * SCI_METHOD PrivateCall(int, void *) override { return NULL; } static ILexer5 * LexerFactoryBaan() { return new LexerBaan(); } }; Sci_Position SCI_METHOD LexerBaan::PropertySet(const char *key, const char *val) { if (osBaan.PropertySet(&options, key, val)) { return 0; } return -1; } Sci_Position SCI_METHOD LexerBaan::WordListSet(int n, const char *wl) { WordListAbridged *WordListAbridgedN = 0; switch (n) { case 0: WordListAbridgedN = &keywords; break; case 1: WordListAbridgedN = &keywords2; break; case 2: WordListAbridgedN = &keywords3; break; case 3: WordListAbridgedN = &keywords4; break; case 4: WordListAbridgedN = &keywords5; break; case 5: WordListAbridgedN = &keywords6; break; case 6: WordListAbridgedN = &keywords7; break; case 7: WordListAbridgedN = &keywords8; break; case 8: WordListAbridgedN = &keywords9; break; } Sci_Position firstModification = -1; if (WordListAbridgedN) { WordListAbridged wlNew; wlNew.Set(wl); if (*WordListAbridgedN != wlNew) { WordListAbridgedN->Set(wl); WordListAbridgedN->kwAbridged = strchr(wl, '~') != NULL; WordListAbridgedN->kwHasSection = strchr(wl, ':') != NULL; firstModification = 0; } } return firstModification; } void SCI_METHOD LexerBaan::Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { if (initStyle == SCE_BAAN_STRINGEOL) // Does not leak onto next line initStyle = SCE_BAAN_DEFAULT; int visibleChars = 0; bool lineHasDomain = false; bool lineHasFunction = false; bool lineHasPreProc = false; bool lineIgnoreString = false; bool lineHasDefines = false; bool numberIsHex = false; char word[1000]; int wordlen = 0; std::string preProcessorTags[13] = { "#context_off", "#context_on", "#define", "#elif", "#else", "#endif", "#ident", "#if", "#ifdef", "#ifndef", "#include", "#pragma", "#undef" }; LexAccessor styler(pAccess); StyleContext sc(startPos, length, initStyle, styler); for (; sc.More(); sc.Forward()) { // Determine if the current state should terminate. switch (sc.state) { case SCE_BAAN_OPERATOR: sc.SetState(SCE_BAAN_DEFAULT); break; case SCE_BAAN_NUMBER: if (IsASpaceOrTab(sc.ch) || sc.ch == '\r' || sc.ch == '\n' || IsAnOperator(sc.ch)) { sc.SetState(SCE_BAAN_DEFAULT); } else if ((numberIsHex && !(MakeLowerCase(sc.ch) == 'x' || MakeLowerCase(sc.ch) == 'e' || IsADigit(sc.ch, 16) || sc.ch == '.' || sc.ch == '-' || sc.ch == '+')) || (!numberIsHex && !(MakeLowerCase(sc.ch) == 'e' || IsADigit(sc.ch) || sc.ch == '.' || sc.ch == '-' || sc.ch == '+'))) { // check '-' for possible -10e-5. Add '+' as well. numberIsHex = false; sc.ChangeState(SCE_BAAN_IDENTIFIER); sc.SetState(SCE_BAAN_DEFAULT); } break; case SCE_BAAN_IDENTIFIER: if (!IsAWordChar(sc.ch)) { char s[1000]; char s1[1000]; sc.GetCurrentLowered(s, sizeof(s)); if (sc.ch == ':') { memcpy(s1, s, sizeof(s)); s1[sc.LengthCurrent()] = sc.ch; s1[sc.LengthCurrent() + 1] = '\0'; } if ((keywords.kwHasSection && (sc.ch == ':')) ? keywords.Contains(s1) : keywords.Contains(s)) { sc.ChangeState(SCE_BAAN_WORD); if (0 == strcmp(s, "domain")) { lineHasDomain = true; } else if (0 == strcmp(s, "function")) { lineHasFunction = true; } } else if (lineHasDomain) { sc.ChangeState(SCE_BAAN_DOMDEF); lineHasDomain = false; } else if (lineHasFunction) { sc.ChangeState(SCE_BAAN_FUNCDEF); lineHasFunction = false; } else if ((keywords2.kwHasSection && (sc.ch == ':')) ? keywords2.Contains(s1) : keywords2.Contains(s)) { sc.ChangeState(SCE_BAAN_WORD2); } else if ((keywords3.kwHasSection && (sc.ch == ':')) ? keywords3.Contains(s1) : keywords3.Contains(s)) { if (sc.ch == '(') sc.ChangeState(SCE_BAAN_WORD3); else sc.ChangeState(SCE_BAAN_IDENTIFIER); } else if ((keywords4.kwHasSection && (sc.ch == ':')) ? keywords4.Contains(s1) : keywords4.Contains(s)) { sc.ChangeState(SCE_BAAN_WORD4); } else if ((keywords5.kwHasSection && (sc.ch == ':')) ? keywords5.Contains(s1) : keywords5.Contains(s)) { sc.ChangeState(SCE_BAAN_WORD5); } else if ((keywords6.kwHasSection && (sc.ch == ':')) ? keywords6.Contains(s1) : keywords6.Contains(s)) { sc.ChangeState(SCE_BAAN_WORD6); } else if ((keywords7.kwHasSection && (sc.ch == ':')) ? keywords7.Contains(s1) : keywords7.Contains(s)) { sc.ChangeState(SCE_BAAN_WORD7); } else if ((keywords8.kwHasSection && (sc.ch == ':')) ? keywords8.Contains(s1) : keywords8.Contains(s)) { sc.ChangeState(SCE_BAAN_WORD8); } else if ((keywords9.kwHasSection && (sc.ch == ':')) ? keywords9.Contains(s1) : keywords9.Contains(s)) { sc.ChangeState(SCE_BAAN_WORD9); } else if (lineHasPreProc) { sc.ChangeState(SCE_BAAN_OBJECTDEF); lineHasPreProc = false; } else if (lineHasDefines) { sc.ChangeState(SCE_BAAN_DEFINEDEF); lineHasDefines = false; } else { int state = IsAnyOtherIdentifier(s, sc.LengthCurrent()); if (state > 0) { sc.ChangeState(state); } } sc.SetState(SCE_BAAN_DEFAULT); } break; case SCE_BAAN_PREPROCESSOR: if (options.baanStylingWithinPreprocessor) { if (IsASpace(sc.ch) || IsAnOperator(sc.ch)) { sc.SetState(SCE_BAAN_DEFAULT); } } else { if (sc.atLineEnd && (sc.chNext != '^')) { sc.SetState(SCE_BAAN_DEFAULT); } } break; case SCE_BAAN_COMMENT: if (sc.ch == '\r' || sc.ch == '\n') { sc.SetState(SCE_BAAN_DEFAULT); } break; case SCE_BAAN_COMMENTDOC: if (sc.MatchIgnoreCase("enddllusage")) { for (unsigned int i = 0; i < 10; i++) { sc.Forward(); } sc.ForwardSetState(SCE_BAAN_DEFAULT); } else if (sc.MatchIgnoreCase("endfunctionusage")) { for (unsigned int i = 0; i < 15; i++) { sc.Forward(); } sc.ForwardSetState(SCE_BAAN_DEFAULT); } break; case SCE_BAAN_STRING: if (sc.ch == '\"') { sc.ForwardSetState(SCE_BAAN_DEFAULT); } else if ((sc.atLineEnd) && (sc.chNext != '^')) { sc.ChangeState(SCE_BAAN_STRINGEOL); sc.ForwardSetState(SCE_BAAN_DEFAULT); visibleChars = 0; } break; } // Determine if a new state should be entered. if (sc.state == SCE_BAAN_DEFAULT) { if (IsADigit(sc.ch) || (sc.ch == '.' && IsADigit(sc.chNext)) || ((sc.ch == '-' || sc.ch == '+') && (IsADigit(sc.chNext) || sc.chNext == '.')) || (MakeLowerCase(sc.ch) == 'e' && (IsADigit(sc.chNext) || sc.chNext == '+' || sc.chNext == '-'))) { if ((sc.ch == '0' && MakeLowerCase(sc.chNext) == 'x') || ((sc.ch == '-' || sc.ch == '+') && sc.chNext == '0' && MakeLowerCase(sc.GetRelativeCharacter(2)) == 'x')){ numberIsHex = true; } sc.SetState(SCE_BAAN_NUMBER); } else if (sc.MatchIgnoreCase("dllusage") || sc.MatchIgnoreCase("functionusage")) { sc.SetState(SCE_BAAN_COMMENTDOC); do { sc.Forward(); } while ((!sc.atLineEnd) && sc.More()); } else if (iswordstart(sc.ch)) { sc.SetState(SCE_BAAN_IDENTIFIER); } else if (sc.Match('|')) { sc.SetState(SCE_BAAN_COMMENT); } else if (sc.ch == '\"' && !(lineIgnoreString)) { sc.SetState(SCE_BAAN_STRING); } else if (sc.ch == '#' && visibleChars == 0) { // Preprocessor commands are alone on their line sc.SetState(SCE_BAAN_PREPROCESSOR); word[0] = '\0'; wordlen = 0; while (sc.More() && !(IsASpace(sc.chNext) || IsAnOperator(sc.chNext))) { sc.Forward(); wordlen++; } sc.GetCurrentLowered(word, sizeof(word)); if (!sc.atLineEnd) { word[wordlen++] = sc.ch; word[wordlen++] = '\0'; } if (!wordInArray(word, preProcessorTags, 13)) // Colorise only preprocessor built in Baan. sc.ChangeState(SCE_BAAN_IDENTIFIER); if (strcmp(word, "#pragma") == 0 || strcmp(word, "#include") == 0) { lineHasPreProc = true; lineIgnoreString = true; } else if (strcmp(word, "#define") == 0 || strcmp(word, "#undef") == 0 || strcmp(word, "#ifdef") == 0 || strcmp(word, "#if") == 0 || strcmp(word, "#ifndef") == 0) { lineHasDefines = true; lineIgnoreString = false; } } else if (IsAnOperator(static_cast(sc.ch))) { sc.SetState(SCE_BAAN_OPERATOR); } } if (sc.atLineEnd) { // Reset states to begining of colourise so no surprises // if different sets of lines lexed. visibleChars = 0; lineHasDomain = false; lineHasFunction = false; lineHasPreProc = false; lineIgnoreString = false; lineHasDefines = false; numberIsHex = false; } if (!IsASpace(sc.ch)) { visibleChars++; } } sc.Complete(); } void SCI_METHOD LexerBaan::Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { if (!options.fold) return; char word[100]; int wordlen = 0; bool foldStart = true; bool foldNextSelect = true; bool afterFunctionSection = false; bool beforeDeclarationSection = false; int currLineStyle = 0; int nextLineStyle = 0; std::string startTags[6] = { "for", "if", "on", "repeat", "select", "while" }; std::string endTags[6] = { "endcase", "endfor", "endif", "endselect", "endwhile", "until" }; std::string selectCloseTags[5] = { "selectdo", "selecteos", "selectempty", "selecterror", "endselect" }; LexAccessor styler(pAccess); Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); // Backtrack to previous line in case need to fix its fold status if (startPos > 0) { if (lineCurrent > 0) { lineCurrent--; startPos = styler.LineStart(lineCurrent); } } int levelPrev = SC_FOLDLEVELBASE; if (lineCurrent > 0) levelPrev = styler.LevelAt(lineCurrent - 1) >> 16; int levelCurrent = levelPrev; char chNext = styler[startPos]; int style = initStyle; int styleNext = styler.StyleAt(startPos); for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); style = styleNext; styleNext = styler.StyleAt(i + 1); int stylePrev = (i) ? styler.StyleAt(i - 1) : SCE_BAAN_DEFAULT; bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); // Comment folding if (options.foldComment && style == SCE_BAAN_COMMENTDOC) { if (style != stylePrev) { levelCurrent++; } else if (style != styleNext) { levelCurrent--; } } if (options.foldComment && atEOL && IsCommentLine(lineCurrent, styler)) { if (!IsCommentLine(lineCurrent - 1, styler) && IsCommentLine(lineCurrent + 1, styler)) levelCurrent++; else if (IsCommentLine(lineCurrent - 1, styler) && !IsCommentLine(lineCurrent + 1, styler)) levelCurrent--; } // PreProcessor Folding if (options.foldPreprocessor) { if (atEOL && IsPreProcLine(lineCurrent, styler)) { if (!IsPreProcLine(lineCurrent - 1, styler) && IsPreProcLine(lineCurrent + 1, styler)) levelCurrent++; else if (IsPreProcLine(lineCurrent - 1, styler) && !IsPreProcLine(lineCurrent + 1, styler)) levelCurrent--; } else if (style == SCE_BAAN_PREPROCESSOR) { // folds #ifdef/#if/#ifndef - they are not part of the IsPreProcLine folding. if (ch == '#') { if (styler.Match(i, "#ifdef") || styler.Match(i, "#if") || styler.Match(i, "#ifndef") || styler.Match(i, "#context_on")) levelCurrent++; else if (styler.Match(i, "#endif") || styler.Match(i, "#context_off")) levelCurrent--; } } } //Syntax Folding if (options.baanFoldSyntaxBased && (style == SCE_BAAN_OPERATOR)) { if (ch == '{' || ch == '(') { levelCurrent++; } else if (ch == '}' || ch == ')') { levelCurrent--; } } //Keywords Folding if (options.baanFoldKeywordsBased) { if (atEOL && IsDeclarationLine(lineCurrent, styler)) { if (!IsDeclarationLine(lineCurrent - 1, styler) && IsDeclarationLine(lineCurrent + 1, styler)) levelCurrent++; else if (IsDeclarationLine(lineCurrent - 1, styler) && !IsDeclarationLine(lineCurrent + 1, styler)) levelCurrent--; } else if (style == SCE_BAAN_WORD) { word[wordlen++] = static_cast(MakeLowerCase(ch)); if (wordlen == 100) { // prevent overflow word[0] = '\0'; wordlen = 1; } if (styleNext != SCE_BAAN_WORD) { word[wordlen] = '\0'; wordlen = 0; if (strcmp(word, "for") == 0) { Sci_PositionU j = i + 1; while ((j < endPos) && IsASpaceOrTab(styler.SafeGetCharAt(j))) { j++; } if (styler.Match(j, "update")) { // Means this is a "for update" used by Select which is already folded. foldStart = false; } } else if (strcmp(word, "on") == 0) { Sci_PositionU j = i + 1; while ((j < endPos) && IsASpaceOrTab(styler.SafeGetCharAt(j))) { j++; } if (!styler.Match(j, "case")) { // Means this is not a "on Case" statement... could be "on" used by index. foldStart = false; } } else if (strcmp(word, "select") == 0) { if (foldNextSelect) { // Next Selects are sub-clause till reach of selectCloseTags[] array. foldNextSelect = false; foldStart = true; } else { foldNextSelect = false; foldStart = false; } } else if (wordInArray(word, selectCloseTags, 5)) { // select clause ends, next select clause can be folded. foldNextSelect = true; foldStart = true; } else { foldStart = true; } if (foldStart) { if (wordInArray(word, startTags, 6)) { levelCurrent++; } else if (wordInArray(word, endTags, 6)) { levelCurrent--; } } } } } // Fold inner level of if/select/case statements if (options.baanFoldInnerLevel && atEOL) { bool currLineInnerLevel = IsInnerLevelFold(lineCurrent, styler); bool nextLineInnerLevel = IsInnerLevelFold(lineCurrent + 1, styler); if (currLineInnerLevel && currLineInnerLevel != nextLineInnerLevel) { levelCurrent++; } else if (nextLineInnerLevel && nextLineInnerLevel != currLineInnerLevel) { levelCurrent--; } } // Section Foldings. // One way of implementing Section Foldings, as there is no END markings of sections. // first section ends on the previous line of next section. // Re-written whole folding to accomodate this. if (options.baanFoldSections && atEOL) { currLineStyle = mainOrSubSectionLine(lineCurrent, styler); nextLineStyle = mainOrSubSectionLine(lineCurrent + 1, styler); if (currLineStyle != 0 && currLineStyle != nextLineStyle) { if (levelCurrent < levelPrev) --levelPrev; for (Sci_Position j = styler.LineStart(lineCurrent); j < styler.LineStart(lineCurrent + 1) - 1; j++) { if (IsASpaceOrTab(styler[j])) continue; else if (styler.StyleAt(j) == SCE_BAAN_WORD5) { if (styler.Match(j, "functions:")) { // Means functions: is the end of MainSections. // Nothing to fold after this. afterFunctionSection = true; break; } else { afterFunctionSection = false; break; } } else { afterFunctionSection = false; break; } } if (!afterFunctionSection) levelCurrent++; } else if (nextLineStyle != 0 && currLineStyle != nextLineStyle && (priorSectionIsSubSection(lineCurrent -1 ,styler) || !nextSectionIsSubSection(lineCurrent + 1, styler))) { for (Sci_Position j = styler.LineStart(lineCurrent + 1); j < styler.LineStart(lineCurrent + 1 + 1) - 1; j++) { if (IsASpaceOrTab(styler[j])) continue; else if (styler.StyleAt(j) == SCE_BAAN_WORD5) { if (styler.Match(j, "declaration:")) { // Means declaration: is the start of MainSections. // Nothing to fold before this. beforeDeclarationSection = true; break; } else { beforeDeclarationSection = false; break; } } else { beforeDeclarationSection = false; break; } } if (!beforeDeclarationSection) { levelCurrent--; if (nextLineStyle == SCE_BAAN_WORD5 && priorSectionIsSubSection(lineCurrent-1, styler)) // next levelCurrent--; is to unfold previous subsection fold. // On reaching the next main section, the previous main as well sub section ends. levelCurrent--; } } } if (atEOL) { int lev = levelPrev; lev |= levelCurrent << 16; if (visibleChars == 0 && options.foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if ((levelCurrent > levelPrev) && (visibleChars > 0)) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelPrev = levelCurrent; visibleChars = 0; } if (!isspacechar(ch)) visibleChars++; } int flagsNext = styler.LevelAt(lineCurrent) & ~SC_FOLDLEVELNUMBERMASK; styler.SetLevel(lineCurrent, levelPrev | flagsNext); } LexerModule lmBaan(SCLEX_BAAN, LexerBaan::LexerFactoryBaan, "baan", baanWordLists); lexilla/lexers/LexX12.cxx0000664000175000017500000003003114647367374014245 0ustar neilneil// Scintilla Lexer for X12 // @file LexX12.cxx // Written by Iain Clarke, IMCSoft & Inobiz AB. // X12 official documentation is behind a paywall, but there's a description of the syntax here: // http://www.rawlinsecconsulting.com/x12tutorial/x12syn.html // This code is subject to the same license terms as the rest of the scintilla project: // The License.txt file describes the conditions under which this software may be distributed. // // Header order must match order in scripts/HeaderOrder.txt #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "LexerModule.h" #include "DefaultLexer.h" using namespace Scintilla; using namespace Lexilla; class LexerX12 : public DefaultLexer { public: LexerX12(); virtual ~LexerX12() {} // virtual destructor, as we inherit from ILexer static ILexer5 *Factory() { return new LexerX12; } int SCI_METHOD Version() const override { return lvRelease5; } void SCI_METHOD Release() override { delete this; } const char * SCI_METHOD PropertyNames() override { return "fold"; } int SCI_METHOD PropertyType(const char *) override { return SC_TYPE_BOOLEAN; // Only one property! } const char * SCI_METHOD DescribeProperty(const char *name) override { if (!strcmp(name, "fold")) return "Whether to apply folding to document or not"; return ""; } Sci_Position SCI_METHOD PropertySet(const char *key, const char *val) override { if (!strcmp(key, "fold")) { m_bFold = strcmp(val, "0") ? true : false; return 0; } return -1; } const char * SCI_METHOD PropertyGet(const char *) override { return ""; } const char * SCI_METHOD DescribeWordListSets() override { return ""; } Sci_Position SCI_METHOD WordListSet(int, const char *) override { return -1; } void SCI_METHOD Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void SCI_METHOD Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void * SCI_METHOD PrivateCall(int, void *) override { return NULL; } protected: struct Terminator { int Style = SCE_X12_BAD; Sci_PositionU pos = 0; Sci_PositionU length = 0; int FoldChange = 0; }; Terminator InitialiseFromISA(IDocument *pAccess); Sci_PositionU FindPreviousSegmentStart(IDocument *pAccess, Sci_Position startPos) const; Terminator DetectSegmentHeader(IDocument *pAccess, Sci_PositionU pos) const; Terminator FindNextTerminator(IDocument *pAccess, Sci_PositionU pos, bool bJustSegmentTerminator = false) const; bool m_bFold = false; char m_SeparatorSubElement = 0; char m_SeparatorElement = 0; std::string m_SeparatorSegment; // might be multiple characters std::string m_LineFeed; }; LexerModule lmX12(SCLEX_X12, LexerX12::Factory, "x12"); /////////////////////////////////////////////////////////////////////////////// /////////////////////////////////////////////////////////////////////////////// LexerX12::LexerX12() : DefaultLexer("x12", SCLEX_X12) { } void LexerX12::Lex(Sci_PositionU startPos, Sci_Position length, int, IDocument *pAccess) { Sci_PositionU posFinish = startPos + length; Terminator T = InitialiseFromISA(pAccess); if (T.Style == SCE_X12_BAD) { if (T.pos < startPos) T.pos = startPos; // we may be colouring in batches. pAccess->StartStyling(startPos); pAccess->SetStyleFor(T.pos - startPos, SCE_X12_ENVELOPE); pAccess->SetStyleFor(posFinish - T.pos, SCE_X12_BAD); return; } // Look backwards for a segment start or a document beginning Sci_PositionU posCurrent = FindPreviousSegmentStart (pAccess, startPos); // Style buffer, so we're not issuing loads of notifications pAccess->StartStyling(posCurrent); while (posCurrent < posFinish) { // Look for first element marker, so we can denote segment T = DetectSegmentHeader(pAccess, posCurrent); if (T.Style == SCE_X12_BAD) break; pAccess->SetStyleFor(T.pos - posCurrent, T.Style); pAccess->SetStyleFor(T.length, SCE_X12_SEP_ELEMENT); posCurrent = T.pos + T.length; while (T.Style != SCE_X12_BAD && T.Style != SCE_X12_SEGMENTEND) // Break on bad or segment ending { T = FindNextTerminator(pAccess, posCurrent, false); if (T.Style == SCE_X12_BAD) break; int Style = T.Style; pAccess->SetStyleFor(T.pos - posCurrent, SCE_X12_DEFAULT); pAccess->SetStyleFor(T.length, Style); posCurrent = T.pos + T.length; } if (T.Style == SCE_X12_BAD) break; } pAccess->SetStyleFor(posFinish - posCurrent, SCE_X12_BAD); } void LexerX12::Fold(Sci_PositionU startPos, Sci_Position length, int, IDocument *pAccess) { if (!m_bFold) return; // Are we even foldable? // check for cr,lf,cr+lf. if (m_LineFeed.empty()) return; Sci_PositionU posFinish = startPos + length; // Look backwards for a segment start or a document beginning startPos = FindPreviousSegmentStart(pAccess, startPos); Terminator T; Sci_PositionU currLine = pAccess->LineFromPosition(startPos); int levelCurrentStyle = SC_FOLDLEVELBASE; int indentCurrent = 0; if (currLine > 0) { levelCurrentStyle = pAccess->GetLevel(currLine - 1); // bottom 12 bits are level indentCurrent = levelCurrentStyle & (SC_FOLDLEVELBASE - 1); // indent from previous line Sci_PositionU posLine = pAccess->LineStart(currLine - 1); T = DetectSegmentHeader(pAccess, posLine); indentCurrent += T.FoldChange; } while (startPos < posFinish) { T = DetectSegmentHeader(pAccess, startPos); int indentNext = indentCurrent + T.FoldChange; if (indentNext < 0) indentNext = 0; levelCurrentStyle = (T.FoldChange > 0) ? (SC_FOLDLEVELBASE | SC_FOLDLEVELHEADERFLAG) : SC_FOLDLEVELBASE; currLine = pAccess->LineFromPosition(startPos); pAccess->SetLevel(currLine, levelCurrentStyle | indentCurrent); T = FindNextTerminator(pAccess, startPos, true); if (T.Style == SCE_X12_BAD) break; startPos = T.pos + T.length; indentCurrent = indentNext; } } LexerX12::Terminator LexerX12::InitialiseFromISA(IDocument *pAccess) { Sci_Position length = pAccess->Length(); if (length <= 108) return { SCE_X12_BAD, 0 }; pAccess->GetCharRange(&m_SeparatorElement, 3, 1); pAccess->GetCharRange(&m_SeparatorSubElement, 104, 1); // Look for GS, as that's the next segment. Anything between 105 and GS/IEA is our segment separator. Sci_Position posNextSegment; char bufSegment[3] = { 0 }; for (posNextSegment = 105; posNextSegment < length - 3; posNextSegment++) { pAccess->GetCharRange(bufSegment, posNextSegment, 3); if (!memcmp (bufSegment, "GS", 2) || !memcmp(bufSegment, "IEA", 3)) { m_SeparatorSegment.resize(posNextSegment - 105); pAccess->GetCharRange(&m_SeparatorSegment.at(0), 105, posNextSegment - 105); // Is some of that CR+LF? size_t nPos = m_SeparatorSegment.find_last_not_of("\r\n"); m_LineFeed = m_SeparatorSegment.substr(nPos + 1); m_SeparatorSegment = m_SeparatorSegment.substr(0, nPos + 1); break; } } if (m_SeparatorSegment.empty() && m_LineFeed.empty()) { return { SCE_X12_BAD, 105 }; } // Validate we have an element separator, and it's not silly! if (m_SeparatorElement == '\0' || m_SeparatorElement == '\n' || m_SeparatorElement == '\r') return { SCE_X12_BAD, 3 }; // Validate we have an element separator, and it's not silly! if (m_SeparatorSubElement == '\0' || m_SeparatorSubElement == '\n' || m_SeparatorSubElement == '\r') return { SCE_X12_BAD, 103 }; if (m_SeparatorElement == m_SeparatorSubElement) return { SCE_X12_BAD, 104 }; for (auto& c : m_SeparatorSegment) { if (m_SeparatorElement == c) return { SCE_X12_BAD, 105 }; if (m_SeparatorSubElement == c) return { SCE_X12_BAD, 105 }; } // Check we have element markers at all the right places! ISA element has fixed entries. std::vector ElementMarkers = { 3, 6, 17, 20, 31, 34, 50, 53, 69, 76, 81, 83, 89, 99, 101, 103 }; for (auto i : ElementMarkers) { char c; pAccess->GetCharRange(&c, i, 1); if (c != m_SeparatorElement) return { SCE_X12_BAD, i }; } // Check we have no element markers anywhere else! for (Sci_PositionU i = 0; i < 105; i++) { if (std::find(ElementMarkers.begin(), ElementMarkers.end(), i) != ElementMarkers.end()) continue; char c; pAccess->GetCharRange(&c, i, 1); if (c == m_SeparatorElement) return { SCE_X12_BAD, i }; } return { SCE_X12_ENVELOPE }; } Sci_PositionU LexerX12::FindPreviousSegmentStart(IDocument *pAccess, Sci_Position startPos) const { Sci_PositionU length = pAccess->Length(); std::string bufTest = m_SeparatorSegment + m_LineFeed; // quick way of making the lengths the same std::string bufCompare = bufTest; for (; startPos > 0; startPos--) { if (startPos + bufTest.size() > length) continue; pAccess->GetCharRange(&bufTest.at(0), startPos, bufTest.size()); if (bufTest == bufCompare) { return startPos + bufTest.size(); } } // We didn't find a ', so just go with the beginning return 0; } LexerX12::Terminator LexerX12::DetectSegmentHeader(IDocument *pAccess, Sci_PositionU pos) const { Sci_PositionU Length = pAccess->Length(); Length -= pos; char c, Buf[4] = { 0 }; // max 3 + separator for (Sci_PositionU posOffset = 0; posOffset < std::size(Buf) && posOffset < Length; posOffset++) { pAccess->GetCharRange(&c, pos + posOffset, 1); if (c != m_SeparatorElement) { Buf[posOffset] = c; continue; } // check for special segments, involved in folding start/stop. if (memcmp(Buf, "ISA", 3) == 0) return { SCE_X12_ENVELOPE, pos + posOffset, 1, +1 }; if (memcmp(Buf, "IEA", 3) == 0) return { SCE_X12_ENVELOPE, pos + posOffset, 1, -1 }; if (memcmp(Buf, "GS", 2) == 0) return { SCE_X12_FUNCTIONGROUP, pos + posOffset, 1, +1 }; if (memcmp(Buf, "GE", 2) == 0) return { SCE_X12_FUNCTIONGROUP, pos + posOffset, 1, -1 }; if (memcmp(Buf, "ST", 2) == 0) return { SCE_X12_TRANSACTIONSET, pos + posOffset, 1, +1 }; if (memcmp(Buf, "SE", 2) == 0) return { SCE_X12_TRANSACTIONSET, pos + posOffset, 1, -1 }; return { SCE_X12_SEGMENTHEADER, pos + posOffset, 1, 0 }; } return { SCE_X12_BAD, pos, 0, 0 }; } LexerX12::Terminator LexerX12::FindNextTerminator(IDocument *pAccess, Sci_PositionU pos, bool bJustSegmentTerminator) const { char c; Sci_PositionU length = pAccess->Length(); std::string bufTestSegment = m_SeparatorSegment; // quick way of making the lengths the same std::string bufTestLineFeed = m_LineFeed; // quick way of making the lengths the same while (pos < (Sci_PositionU)length) { pAccess->GetCharRange(&c, pos, 1); if (pos + m_SeparatorSegment.size() > length) bufTestSegment.clear(); // going up - so once we can't get this, we're done with the buffer. else if (!bufTestSegment.empty()) pAccess->GetCharRange(&bufTestSegment.at(0), pos, bufTestSegment.size()); if (pos + m_LineFeed.size() > length) bufTestLineFeed.clear(); // going up - so once we can't get this, we're done with the buffer. else if (!bufTestLineFeed.empty()) pAccess->GetCharRange(&bufTestLineFeed.at(0), pos, bufTestLineFeed.size()); if (!bJustSegmentTerminator && c == m_SeparatorElement) return { SCE_X12_SEP_ELEMENT, pos, 1 }; else if (!bJustSegmentTerminator && c == m_SeparatorSubElement) return { SCE_X12_SEP_SUBELEMENT, pos, 1 }; else if (!m_SeparatorSegment.empty() && bufTestSegment == m_SeparatorSegment) { if (m_LineFeed.empty()) return { SCE_X12_SEGMENTEND, pos, m_SeparatorSegment.size() }; // is this the end? if (pos + m_SeparatorSegment.size() == length) return { SCE_X12_SEGMENTEND, pos, m_SeparatorSegment.size() }; // Check if we're followed by a linefeed. if (pos + m_SeparatorSegment.size() + m_LineFeed.size() > length) return { SCE_X12_BAD, pos }; bufTestSegment = m_LineFeed; pAccess->GetCharRange(&bufTestSegment.at(0), pos + m_SeparatorSegment.size(), bufTestSegment.size()); if (bufTestSegment == m_LineFeed) return { SCE_X12_SEGMENTEND, pos, m_SeparatorSegment.size() + m_LineFeed.size() }; break; } else if (m_SeparatorSegment.empty() && bufTestLineFeed == m_LineFeed) { return { SCE_X12_SEGMENTEND, pos, m_LineFeed.size() }; } pos++; } return { SCE_X12_BAD, pos }; } lexilla/lexers/LexRebol.cxx0000664000175000017500000002502114647367374014741 0ustar neilneil// Scintilla source code edit control /** @file LexRebol.cxx ** Lexer for REBOL. ** Written by Pascal Hurni, inspired from LexLua by Paul Winwood & Marcos E. Wurzius & Philippe Lhoste ** ** History: ** 2005-04-07 First release. ** 2005-04-10 Closing parens and brackets go now in default style ** String and comment nesting should be more safe **/ // Copyright 2005 by Pascal Hurni // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static inline bool IsAWordChar(const int ch) { return (isalnum(ch) || ch == '?' || ch == '!' || ch == '.' || ch == '\'' || ch == '+' || ch == '-' || ch == '*' || ch == '&' || ch == '|' || ch == '=' || ch == '_' || ch == '~'); } static inline bool IsAWordStart(const int ch, const int ch2) { return ((ch == '+' || ch == '-' || ch == '.') && !isdigit(ch2)) || (isalpha(ch) || ch == '?' || ch == '!' || ch == '\'' || ch == '*' || ch == '&' || ch == '|' || ch == '=' || ch == '_' || ch == '~'); } static inline bool IsAnOperator(const int ch, const int ch2, const int ch3) { // One char operators if (IsASpaceOrTab(ch2)) { return ch == '+' || ch == '-' || ch == '*' || ch == '/' || ch == '<' || ch == '>' || ch == '=' || ch == '?'; } // Two char operators if (IsASpaceOrTab(ch3)) { return (ch == '*' && ch2 == '*') || (ch == '/' && ch2 == '/') || (ch == '<' && (ch2 == '=' || ch2 == '>')) || (ch == '>' && ch2 == '=') || (ch == '=' && (ch2 == '=' || ch2 == '?')) || (ch == '?' && ch2 == '?'); } return false; } static inline bool IsBinaryStart(const int ch, const int ch2, const int ch3, const int ch4) { return (ch == '#' && ch2 == '{') || (IsADigit(ch) && ch2 == '#' && ch3 == '{' ) || (IsADigit(ch) && IsADigit(ch2) && ch3 == '#' && ch4 == '{' ); } static void ColouriseRebolDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { WordList &keywords = *keywordlists[0]; WordList &keywords2 = *keywordlists[1]; WordList &keywords3 = *keywordlists[2]; WordList &keywords4 = *keywordlists[3]; WordList &keywords5 = *keywordlists[4]; WordList &keywords6 = *keywordlists[5]; WordList &keywords7 = *keywordlists[6]; WordList &keywords8 = *keywordlists[7]; Sci_Position currentLine = styler.GetLine(startPos); // Initialize the braced string {.. { ... } ..} nesting level, if we are inside such a string. int stringLevel = 0; if (initStyle == SCE_REBOL_BRACEDSTRING || initStyle == SCE_REBOL_COMMENTBLOCK) { stringLevel = styler.GetLineState(currentLine - 1); } bool blockComment = initStyle == SCE_REBOL_COMMENTBLOCK; int dotCount = 0; // Do not leak onto next line if (initStyle == SCE_REBOL_COMMENTLINE) { initStyle = SCE_REBOL_DEFAULT; } StyleContext sc(startPos, length, initStyle, styler); if (startPos == 0) { sc.SetState(SCE_REBOL_PREFACE); } for (; sc.More(); sc.Forward()) { //--- What to do at line end ? if (sc.atLineEnd) { // Can be either inside a {} string or simply at eol if (sc.state != SCE_REBOL_BRACEDSTRING && sc.state != SCE_REBOL_COMMENTBLOCK && sc.state != SCE_REBOL_BINARY && sc.state != SCE_REBOL_PREFACE) sc.SetState(SCE_REBOL_DEFAULT); // Update the line state, so it can be seen by next line currentLine = styler.GetLine(sc.currentPos); switch (sc.state) { case SCE_REBOL_BRACEDSTRING: case SCE_REBOL_COMMENTBLOCK: // Inside a braced string, we set the line state styler.SetLineState(currentLine, stringLevel); break; default: // Reset the line state styler.SetLineState(currentLine, 0); break; } // continue with next char continue; } //--- What to do on white-space ? if (IsASpaceOrTab(sc.ch)) { // Return to default if any of these states if (sc.state == SCE_REBOL_OPERATOR || sc.state == SCE_REBOL_CHARACTER || sc.state == SCE_REBOL_NUMBER || sc.state == SCE_REBOL_PAIR || sc.state == SCE_REBOL_TUPLE || sc.state == SCE_REBOL_FILE || sc.state == SCE_REBOL_DATE || sc.state == SCE_REBOL_TIME || sc.state == SCE_REBOL_MONEY || sc.state == SCE_REBOL_ISSUE || sc.state == SCE_REBOL_URL || sc.state == SCE_REBOL_EMAIL) { sc.SetState(SCE_REBOL_DEFAULT); } } //--- Specialize state ? // URL, Email look like identifier if (sc.state == SCE_REBOL_IDENTIFIER) { if (sc.ch == ':' && !IsASpace(sc.chNext)) { sc.ChangeState(SCE_REBOL_URL); } else if (sc.ch == '@') { sc.ChangeState(SCE_REBOL_EMAIL); } else if (sc.ch == '$') { sc.ChangeState(SCE_REBOL_MONEY); } } // Words look like identifiers if (sc.state == SCE_REBOL_IDENTIFIER || (sc.state >= SCE_REBOL_WORD && sc.state <= SCE_REBOL_WORD8)) { // Keywords ? if (!IsAWordChar(sc.ch) || sc.Match('/')) { char s[100]; sc.GetCurrentLowered(s, sizeof(s)); blockComment = strcmp(s, "comment") == 0; if (keywords8.InList(s)) { sc.ChangeState(SCE_REBOL_WORD8); } else if (keywords7.InList(s)) { sc.ChangeState(SCE_REBOL_WORD7); } else if (keywords6.InList(s)) { sc.ChangeState(SCE_REBOL_WORD6); } else if (keywords5.InList(s)) { sc.ChangeState(SCE_REBOL_WORD5); } else if (keywords4.InList(s)) { sc.ChangeState(SCE_REBOL_WORD4); } else if (keywords3.InList(s)) { sc.ChangeState(SCE_REBOL_WORD3); } else if (keywords2.InList(s)) { sc.ChangeState(SCE_REBOL_WORD2); } else if (keywords.InList(s)) { sc.ChangeState(SCE_REBOL_WORD); } // Keep same style if there are refinements if (!sc.Match('/')) { sc.SetState(SCE_REBOL_DEFAULT); } } // special numbers } else if (sc.state == SCE_REBOL_NUMBER) { switch (sc.ch) { case 'x': sc.ChangeState(SCE_REBOL_PAIR); break; case ':': sc.ChangeState(SCE_REBOL_TIME); break; case '-': case '/': sc.ChangeState(SCE_REBOL_DATE); break; case '.': if (++dotCount >= 2) sc.ChangeState(SCE_REBOL_TUPLE); break; } } //--- Determine if the current state should terminate if (sc.state == SCE_REBOL_QUOTEDSTRING || sc.state == SCE_REBOL_CHARACTER) { if (sc.ch == '^' && sc.chNext == '\"') { sc.Forward(); } else if (sc.ch == '\"') { sc.ForwardSetState(SCE_REBOL_DEFAULT); } } else if (sc.state == SCE_REBOL_BRACEDSTRING || sc.state == SCE_REBOL_COMMENTBLOCK) { if (sc.ch == '}') { if (--stringLevel == 0) { sc.ForwardSetState(SCE_REBOL_DEFAULT); } } else if (sc.ch == '{') { stringLevel++; } } else if (sc.state == SCE_REBOL_BINARY) { if (sc.ch == '}') { sc.ForwardSetState(SCE_REBOL_DEFAULT); } } else if (sc.state == SCE_REBOL_TAG) { if (sc.ch == '>') { sc.ForwardSetState(SCE_REBOL_DEFAULT); } } else if (sc.state == SCE_REBOL_PREFACE) { if (sc.MatchIgnoreCase("rebol")) { int i; for (i=5; IsASpaceOrTab(styler.SafeGetCharAt(sc.currentPos+i, 0)); i++); if (sc.GetRelative(i) == '[') sc.SetState(SCE_REBOL_DEFAULT); } } //--- Parens and bracket changes to default style when the current is a number if (sc.state == SCE_REBOL_NUMBER || sc.state == SCE_REBOL_PAIR || sc.state == SCE_REBOL_TUPLE || sc.state == SCE_REBOL_MONEY || sc.state == SCE_REBOL_ISSUE || sc.state == SCE_REBOL_EMAIL || sc.state == SCE_REBOL_URL || sc.state == SCE_REBOL_DATE || sc.state == SCE_REBOL_TIME) { if (sc.ch == '(' || sc.ch == '[' || sc.ch == ')' || sc.ch == ']') { sc.SetState(SCE_REBOL_DEFAULT); } } //--- Determine if a new state should be entered. if (sc.state == SCE_REBOL_DEFAULT) { if (IsAnOperator(sc.ch, sc.chNext, sc.GetRelative(2))) { sc.SetState(SCE_REBOL_OPERATOR); } else if (IsBinaryStart(sc.ch, sc.chNext, sc.GetRelative(2), sc.GetRelative(3))) { sc.SetState(SCE_REBOL_BINARY); } else if (IsAWordStart(sc.ch, sc.chNext)) { sc.SetState(SCE_REBOL_IDENTIFIER); } else if (IsADigit(sc.ch) || sc.ch == '+' || sc.ch == '-' || /*Decimal*/ sc.ch == '.' || sc.ch == ',') { dotCount = 0; sc.SetState(SCE_REBOL_NUMBER); } else if (sc.ch == '\"') { sc.SetState(SCE_REBOL_QUOTEDSTRING); } else if (sc.ch == '{') { sc.SetState(blockComment ? SCE_REBOL_COMMENTBLOCK : SCE_REBOL_BRACEDSTRING); ++stringLevel; } else if (sc.ch == ';') { sc.SetState(SCE_REBOL_COMMENTLINE); } else if (sc.ch == '$') { sc.SetState(SCE_REBOL_MONEY); } else if (sc.ch == '%') { sc.SetState(SCE_REBOL_FILE); } else if (sc.ch == '<') { sc.SetState(SCE_REBOL_TAG); } else if (sc.ch == '#' && sc.chNext == '"') { sc.SetState(SCE_REBOL_CHARACTER); sc.Forward(); } else if (sc.ch == '#' && sc.chNext != '"' && sc.chNext != '{' ) { sc.SetState(SCE_REBOL_ISSUE); } } } sc.Complete(); } static void FoldRebolDoc(Sci_PositionU startPos, Sci_Position length, int /* initStyle */, WordList *[], Accessor &styler) { Sci_PositionU lengthDoc = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelPrev = styler.LevelAt(lineCurrent) & SC_FOLDLEVELNUMBERMASK; int levelCurrent = levelPrev; char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); for (Sci_PositionU i = startPos; i < lengthDoc; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); int style = styleNext; styleNext = styler.StyleAt(i + 1); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (style == SCE_REBOL_DEFAULT) { if (ch == '[') { levelCurrent++; } else if (ch == ']') { levelCurrent--; } } if (atEOL) { int lev = levelPrev; if (visibleChars == 0) lev |= SC_FOLDLEVELWHITEFLAG; if ((levelCurrent > levelPrev) && (visibleChars > 0)) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelPrev = levelCurrent; visibleChars = 0; } if (!isspacechar(ch)) visibleChars++; } // Fill in the real level of the next line, keeping the current flags as they will be filled in later int flagsNext = styler.LevelAt(lineCurrent) & ~SC_FOLDLEVELNUMBERMASK; styler.SetLevel(lineCurrent, levelPrev | flagsNext); } static const char * const rebolWordListDesc[] = { "Keywords", 0 }; LexerModule lmREBOL(SCLEX_REBOL, ColouriseRebolDoc, "rebol", FoldRebolDoc, rebolWordListDesc); lexilla/lexers/LexNim.cxx0000664000175000017500000006557514647367374014443 0ustar neilneil// Scintilla source code edit control /** @file LexNim.cxx ** Lexer for Nim ** Written by Jad Altahan (github.com/xv) ** Nim manual: https://nim-lang.org/docs/manual.html **/ // Copyright 1998-2001 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "StringCopy.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" #include "OptionSet.h" #include "DefaultLexer.h" using namespace Scintilla; using namespace Lexilla; namespace { // Use an unnamed namespace to protect the functions and classes from name conflicts enum NumType { Binary, Octal, Exponent, Hexadecimal, Decimal, FormatError }; int GetNumStyle(const int numType) noexcept { if (numType == NumType::FormatError) { return SCE_NIM_NUMERROR; } return SCE_NIM_NUMBER; } constexpr bool IsLetter(const int ch) noexcept { // 97 to 122 || 65 to 90 return (ch >= 'a' && ch <= 'z') || (ch >= 'A' && ch <= 'Z'); } bool IsAWordChar(const int ch) noexcept { return ch < 0x80 && (isalnum(ch) || ch == '_' || ch == '.'); } int IsNumHex(const StyleContext &sc) noexcept { return sc.chNext == 'x' || sc.chNext == 'X'; } int IsNumBinary(const StyleContext &sc) noexcept { return sc.chNext == 'b' || sc.chNext == 'B'; } int IsNumOctal(const StyleContext &sc) { return IsADigit(sc.chNext) || sc.chNext == 'o'; } constexpr bool IsNewline(const int ch) noexcept { return (ch == '\n' || ch == '\r'); } bool IsFuncName(const char *str) noexcept { const char *identifiers[] = { "proc", "func", "macro", "method", "template", "iterator", "converter" }; for (const char *id : identifiers) { if (strcmp(str, id) == 0) { return true; } } return false; } constexpr bool IsTripleLiteral(const int style) noexcept { return style == SCE_NIM_TRIPLE || style == SCE_NIM_TRIPLEDOUBLE; } constexpr bool IsLineComment(const int style) noexcept { return style == SCE_NIM_COMMENTLINE || style == SCE_NIM_COMMENTLINEDOC; } constexpr bool IsStreamComment(const int style) noexcept { return style == SCE_NIM_COMMENT || style == SCE_NIM_COMMENTDOC; } // Adopted from Accessor.cxx int GetIndent(const Sci_Position line, Accessor &styler) { Sci_Position startPos = styler.LineStart(line); const Sci_Position eolPos = styler.LineStart(line + 1) - 1; char ch = styler[startPos]; int style = styler.StyleAt(startPos); int indent = 0; bool inPrevPrefix = line > 0; Sci_Position posPrev = inPrevPrefix ? styler.LineStart(line - 1) : 0; // No fold points inside triple literals while ((IsASpaceOrTab(ch) || IsTripleLiteral(style)) && (startPos < eolPos)) { if (inPrevPrefix) { const char chPrev = styler[posPrev++]; if (chPrev != ' ' && chPrev != '\t') { inPrevPrefix = false; } } if (ch == '\t') { indent = (indent / 8 + 1) * 8; } else { indent++; } startPos++; ch = styler[startPos]; style = styler.StyleAt(startPos); } // Prevent creating fold lines for comments if indented if (!(IsStreamComment(style) || IsLineComment(style))) indent += SC_FOLDLEVELBASE; if (styler.LineStart(line) == styler.Length() || IsASpaceOrTab(ch) || IsNewline(ch) || IsStreamComment(style) || IsLineComment(style)) { return indent | SC_FOLDLEVELWHITEFLAG; } else { return indent; } } int IndentAmount(const Sci_Position line, Accessor &styler) { const int indent = GetIndent(line, styler); const int indentLevel = indent & SC_FOLDLEVELNUMBERMASK; return indentLevel <= SC_FOLDLEVELBASE ? indent : indentLevel | (indent & ~SC_FOLDLEVELNUMBERMASK); } struct OptionsNim { bool fold; bool foldCompact; bool highlightRawStrIdent; OptionsNim() { fold = true; foldCompact = true; highlightRawStrIdent = false; } }; static const char *const nimWordListDesc[] = { "Keywords", nullptr }; struct OptionSetNim : public OptionSet { OptionSetNim() { DefineProperty("lexer.nim.raw.strings.highlight.ident", &OptionsNim::highlightRawStrIdent, "Set to 1 to enable highlighting generalized raw string identifiers. " "Generalized raw string identifiers are anything other than r (or R)."); DefineProperty("fold", &OptionsNim::fold); DefineProperty("fold.compact", &OptionsNim::foldCompact); DefineWordListSets(nimWordListDesc); } }; LexicalClass lexicalClasses[] = { // Lexer Nim SCLEX_NIM SCE_NIM_: 0, "SCE_NIM_DEFAULT", "default", "White space", 1, "SCE_NIM_COMMENT", "comment block", "Block comment", 2, "SCE_NIM_COMMENTDOC", "comment block doc", "Block doc comment", 3, "SCE_NIM_COMMENTLINE", "comment line", "Line comment", 4, "SCE_NIM_COMMENTLINEDOC", "comment doc", "Line doc comment", 5, "SCE_NIM_NUMBER", "literal numeric", "Number", 6, "SCE_NIM_STRING", "literal string", "String", 7, "SCE_NIM_CHARACTER", "literal string", "Single quoted string", 8, "SCE_NIM_WORD", "keyword", "Keyword", 9, "SCE_NIM_TRIPLE", "literal string", "Triple quotes", 10, "SCE_NIM_TRIPLEDOUBLE", "literal string", "Triple double quotes", 11, "SCE_NIM_BACKTICKS", "operator definition", "Identifiers", 12, "SCE_NIM_FUNCNAME", "identifier", "Function name definition", 13, "SCE_NIM_STRINGEOL", "error literal string", "String is not closed", 14, "SCE_NIM_NUMERROR", "numeric error", "Numeric format error", 15, "SCE_NIM_OPERATOR", "operator", "Operators", 16, "SCE_NIM_IDENTIFIER", "identifier", "Identifiers", }; } class LexerNim : public DefaultLexer { CharacterSet setWord; WordList keywords; OptionsNim options; OptionSetNim osNim; public: LexerNim() : DefaultLexer("nim", SCLEX_NIM, lexicalClasses, ELEMENTS(lexicalClasses)), setWord(CharacterSet::setAlphaNum, "_", 0x80, true) { } virtual ~LexerNim() { } void SCI_METHOD Release() noexcept override { delete this; } int SCI_METHOD Version() const noexcept override { return lvRelease5; } const char * SCI_METHOD PropertyNames() override { return osNim.PropertyNames(); } int SCI_METHOD PropertyType(const char *name) override { return osNim.PropertyType(name); } const char * SCI_METHOD DescribeProperty(const char *name) override { return osNim.DescribeProperty(name); } Sci_Position SCI_METHOD PropertySet(const char *key, const char *val) override; const char * SCI_METHOD PropertyGet(const char* key) override { return osNim.PropertyGet(key); } const char * SCI_METHOD DescribeWordListSets() override { return osNim.DescribeWordListSets(); } Sci_Position SCI_METHOD WordListSet(int n, const char *wl) override; void SCI_METHOD Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void SCI_METHOD Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void * SCI_METHOD PrivateCall(int, void *) noexcept override { return nullptr; } int SCI_METHOD LineEndTypesSupported() noexcept override { return SC_LINE_END_TYPE_UNICODE; } int SCI_METHOD PrimaryStyleFromStyle(int style) noexcept override { return style; } static ILexer5 *LexerFactoryNim() { return new LexerNim(); } }; Sci_Position SCI_METHOD LexerNim::PropertySet(const char *key, const char *val) { if (osNim.PropertySet(&options, key, val)) { return 0; } return -1; } Sci_Position SCI_METHOD LexerNim::WordListSet(int n, const char *wl) { WordList *wordListN = nullptr; switch (n) { case 0: wordListN = &keywords; break; } Sci_Position firstModification = -1; if (wordListN) { WordList wlNew; wlNew.Set(wl); if (*wordListN != wlNew) { wordListN->Set(wl); firstModification = 0; } } return firstModification; } void SCI_METHOD LexerNim::Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { // No one likes a leaky string if (initStyle == SCE_NIM_STRINGEOL) { initStyle = SCE_NIM_DEFAULT; } Accessor styler(pAccess, nullptr); StyleContext sc(startPos, length, initStyle, styler); // Nim supports nested block comments! Sci_Position lineCurrent = styler.GetLine(startPos); int commentNestLevel = lineCurrent > 0 ? styler.GetLineState(lineCurrent - 1) : 0; int numType = NumType::Decimal; int decimalCount = 0; bool funcNameExists = false; bool isStylingRawString = false; bool isStylingRawStringIdent = false; for (; sc.More(); sc.Forward()) { if (sc.atLineStart) { if (sc.state == SCE_NIM_STRING) { sc.SetState(SCE_NIM_STRING); } lineCurrent = styler.GetLine(sc.currentPos); styler.SetLineState(lineCurrent, commentNestLevel); } // Handle string line continuation if (sc.ch == '\\' && (sc.chNext == '\n' || sc.chNext == '\r') && (sc.state == SCE_NIM_STRING || sc.state == SCE_NIM_CHARACTER) && !isStylingRawString) { sc.Forward(); if (sc.ch == '\r' && sc.chNext == '\n') { sc.Forward(); } continue; } switch (sc.state) { case SCE_NIM_OPERATOR: funcNameExists = false; sc.SetState(SCE_NIM_DEFAULT); break; case SCE_NIM_NUMBER: // For a type suffix, such as 0x80'u8 if (sc.ch == '\'') { if (sc.chNext == 'i' || sc.chNext == 'I' || sc.chNext == 'u' || sc.chNext == 'U' || sc.chNext == 'f' || sc.chNext == 'F' || sc.chNext == 'd' || sc.chNext == 'D') { sc.Forward(2); } } else if (sc.ch == '.') { if (IsADigit(sc.chNext)) { sc.Forward(); } else if (numType <= NumType::Exponent) { sc.SetState(SCE_NIM_OPERATOR); break; } else { decimalCount++; if (numType == NumType::Decimal) { if (decimalCount <= 1 && !IsAWordChar(sc.chNext)) { break; } } else if (numType == NumType::Hexadecimal) { if (decimalCount <= 1 && IsADigit(sc.chNext, 16)) { break; } sc.SetState(SCE_NIM_OPERATOR); break; } } } else if (sc.ch == '_') { // Accept only one underscore between digits if (IsADigit(sc.chNext)) { sc.Forward(); } } else if (numType == NumType::Decimal) { if (sc.chPrev != '\'' && (sc.ch == 'e' || sc.ch == 'E')) { numType = NumType::Exponent; if (sc.chNext == '-' || sc.chNext == '+') { sc.Forward(); } break; } if (IsADigit(sc.ch)) { break; } } else if (numType == NumType::Hexadecimal) { if (IsADigit(sc.ch, 16)) { break; } } else if (IsADigit(sc.ch)) { if (numType == NumType::Exponent) { break; } if (numType == NumType::Octal) { // Accept only 0-7 if (sc.ch <= '7') { break; } } else if (numType == NumType::Binary) { // Accept only 0 and 1 if (sc.ch <= '1') { break; } } numType = NumType::FormatError; break; } sc.ChangeState(GetNumStyle(numType)); sc.SetState(SCE_NIM_DEFAULT); break; case SCE_NIM_IDENTIFIER: if (sc.ch == '.' || !IsAWordChar(sc.ch)) { char s[100]; sc.GetCurrent(s, sizeof(s)); int style = SCE_NIM_IDENTIFIER; if (keywords.InList(s) && !funcNameExists) { // Prevent styling keywords if they are sub-identifiers const Sci_Position segStart = styler.GetStartSegment() - 1; if (segStart < 0 || styler.SafeGetCharAt(segStart, '\0') != '.') { style = SCE_NIM_WORD; } } else if (funcNameExists) { style = SCE_NIM_FUNCNAME; } sc.ChangeState(style); sc.SetState(SCE_NIM_DEFAULT); if (style == SCE_NIM_WORD) { funcNameExists = IsFuncName(s); } else { funcNameExists = false; } } if (IsAlphaNumeric(sc.ch) && sc.chNext == '\"') { isStylingRawStringIdent = true; if (options.highlightRawStrIdent) { if (styler.SafeGetCharAt(sc.currentPos + 2) == '\"' && styler.SafeGetCharAt(sc.currentPos + 3) == '\"') { sc.ChangeState(SCE_NIM_TRIPLEDOUBLE); } else { sc.ChangeState(SCE_NIM_STRING); } } sc.ForwardSetState(SCE_NIM_DEFAULT); } break; case SCE_NIM_FUNCNAME: if (sc.ch == '`') { funcNameExists = false; sc.ForwardSetState(SCE_NIM_DEFAULT); } else if (sc.atLineEnd) { // Prevent leaking the style to the next line if not closed funcNameExists = false; sc.ChangeState(SCE_NIM_STRINGEOL); sc.ForwardSetState(SCE_NIM_DEFAULT); } break; case SCE_NIM_COMMENT: if (sc.Match(']', '#')) { if (commentNestLevel > 0) { commentNestLevel--; } lineCurrent = styler.GetLine(sc.currentPos); styler.SetLineState(lineCurrent, commentNestLevel); sc.Forward(); if (commentNestLevel == 0) { sc.ForwardSetState(SCE_NIM_DEFAULT); } } else if (sc.Match('#', '[')) { commentNestLevel++; lineCurrent = styler.GetLine(sc.currentPos); styler.SetLineState(lineCurrent, commentNestLevel); } break; case SCE_NIM_COMMENTDOC: if (sc.Match("]##")) { if (commentNestLevel > 0) { commentNestLevel--; } lineCurrent = styler.GetLine(sc.currentPos); styler.SetLineState(lineCurrent, commentNestLevel); sc.Forward(2); if (commentNestLevel == 0) { sc.ForwardSetState(SCE_NIM_DEFAULT); } } else if (sc.Match("##[")) { commentNestLevel++; lineCurrent = styler.GetLine(sc.currentPos); styler.SetLineState(lineCurrent, commentNestLevel); } break; case SCE_NIM_COMMENTLINE: case SCE_NIM_COMMENTLINEDOC: if (sc.atLineStart) { sc.SetState(SCE_NIM_DEFAULT); } break; case SCE_NIM_STRING: if (!isStylingRawStringIdent && !isStylingRawString && sc.ch == '\\') { if (sc.chNext == '\"' || sc.chNext == '\'' || sc.chNext == '\\') { sc.Forward(); } } else if (isStylingRawString && sc.ch == '\"' && sc.chNext == '\"') { // Forward in situations such as r"a""bc\" so that "bc\" wouldn't be // considered a string of its own sc.Forward(); } else if (sc.ch == '\"') { sc.ForwardSetState(SCE_NIM_DEFAULT); } else if (sc.atLineEnd) { sc.ChangeState(SCE_NIM_STRINGEOL); sc.ForwardSetState(SCE_NIM_DEFAULT); } break; case SCE_NIM_CHARACTER: if (sc.ch == '\\') { if (sc.chNext == '\"' || sc.chNext == '\'' || sc.chNext == '\\') { sc.Forward(); } } else if (sc.ch == '\'') { sc.ForwardSetState(SCE_NIM_DEFAULT); } else if (sc.atLineEnd) { sc.ChangeState(SCE_NIM_STRINGEOL); sc.ForwardSetState(SCE_NIM_DEFAULT); } break; case SCE_NIM_BACKTICKS: if (sc.ch == '`' ) { sc.ForwardSetState(SCE_NIM_DEFAULT); } else if (sc.atLineEnd) { sc.ChangeState(SCE_NIM_STRINGEOL); sc.ForwardSetState(SCE_NIM_DEFAULT); } break; case SCE_NIM_TRIPLEDOUBLE: if (sc.Match(R"(""")")) { // Outright forward all " after the closing """ as a triple double // // A valid example where this is needed is: """8 double quotes->"""""""" // You can have as many """ at the end as you wish, as long as the actual // closing literal is there while (sc.ch == '"') { sc.Forward(); } sc.SetState(SCE_NIM_DEFAULT); } break; case SCE_NIM_TRIPLE: if (sc.Match("'''")) { sc.Forward(2); sc.ForwardSetState(SCE_NIM_DEFAULT); } break; } if (sc.state == SCE_NIM_DEFAULT) { // Number if (IsADigit(sc.ch)) { sc.SetState(SCE_NIM_NUMBER); numType = NumType::Decimal; decimalCount = 0; if (sc.ch == '0') { if (IsNumHex(sc)) { numType = NumType::Hexadecimal; } else if (IsNumBinary(sc)) { numType = NumType::Binary; } else if (IsNumOctal(sc)) { numType = NumType::Octal; } if (numType != NumType::Decimal) { sc.Forward(); } } } // Raw string else if (IsAlphaNumeric(sc.ch) && sc.chNext == '\"') { isStylingRawString = true; // Triple doubles can be raw strings too. How sweet if (styler.SafeGetCharAt(sc.currentPos + 2) == '\"' && styler.SafeGetCharAt(sc.currentPos + 3) == '\"') { sc.SetState(SCE_NIM_TRIPLEDOUBLE); } else { sc.SetState(SCE_NIM_STRING); } const int rawStrStyle = options.highlightRawStrIdent ? IsLetter(sc.ch) : (sc.ch == 'r' || sc.ch == 'R'); if (rawStrStyle) { sc.Forward(); if (sc.state == SCE_NIM_TRIPLEDOUBLE) { sc.Forward(2); } } else { // Anything other than r/R is considered a general raw string identifier isStylingRawStringIdent = true; sc.SetState(SCE_NIM_IDENTIFIER); } } // String and triple double literal else if (sc.ch == '\"') { isStylingRawString = false; if (sc.Match(R"(""")")) { sc.SetState(SCE_NIM_TRIPLEDOUBLE); // Keep forwarding until the total opening literal count is 5 // A valid example where this is needed is: """""<-5 double quotes""" while (sc.ch == '"') { sc.Forward(); if (sc.Match(R"(""")")) { sc.Forward(); break; } } } else { sc.SetState(SCE_NIM_STRING); } } // Charecter and triple literal else if (sc.ch == '\'') { if (sc.Match("'''")) { sc.SetState(SCE_NIM_TRIPLE); } else { sc.SetState(SCE_NIM_CHARACTER); } } // Operator definition else if (sc.ch == '`') { if (funcNameExists) { sc.SetState(SCE_NIM_FUNCNAME); } else { sc.SetState(SCE_NIM_BACKTICKS); } } // Keyword else if (iswordstart(sc.ch)) { sc.SetState(SCE_NIM_IDENTIFIER); } // Comments else if (sc.ch == '#') { if (sc.Match("##[") || sc.Match("#[")) { commentNestLevel++; lineCurrent = styler.GetLine(sc.currentPos); styler.SetLineState(lineCurrent, commentNestLevel); } if (sc.Match("##[")) { sc.SetState(SCE_NIM_COMMENTDOC); sc.Forward(); } else if (sc.Match("#[")) { sc.SetState(SCE_NIM_COMMENT); sc.Forward(); } else if (sc.Match("##")) { sc.SetState(SCE_NIM_COMMENTLINEDOC); } else { sc.SetState(SCE_NIM_COMMENTLINE); } } // Operators else if (strchr("()[]{}:=;-\\/&%$!+<>|^?,.*~@", sc.ch)) { sc.SetState(SCE_NIM_OPERATOR); } } if (sc.atLineEnd) { funcNameExists = false; isStylingRawString = false; isStylingRawStringIdent = false; } } sc.Complete(); } void SCI_METHOD LexerNim::Fold(Sci_PositionU startPos, Sci_Position length, int, IDocument *pAccess) { if (!options.fold) { return; } Accessor styler(pAccess, nullptr); const Sci_Position docLines = styler.GetLine(styler.Length()); const Sci_Position maxPos = startPos + length; const Sci_Position maxLines = styler.GetLine(maxPos == styler.Length() ? maxPos : maxPos - 1); Sci_Position lineCurrent = styler.GetLine(startPos); int indentCurrent = IndentAmount(lineCurrent, styler); while (lineCurrent > 0) { lineCurrent--; indentCurrent = IndentAmount(lineCurrent, styler); if (!(indentCurrent & SC_FOLDLEVELWHITEFLAG)) { break; } } int indentCurrentLevel = indentCurrent & SC_FOLDLEVELNUMBERMASK; indentCurrent = indentCurrentLevel | (indentCurrent & ~SC_FOLDLEVELNUMBERMASK); while (lineCurrent <= docLines && lineCurrent <= maxLines) { Sci_Position lineNext = lineCurrent + 1; int indentNext = indentCurrent; int lev = indentCurrent; if (lineNext <= docLines) { indentNext = IndentAmount(lineNext, styler); } if (indentNext & SC_FOLDLEVELWHITEFLAG) { indentNext = SC_FOLDLEVELWHITEFLAG | indentCurrentLevel; } while (lineNext < docLines && (indentNext & SC_FOLDLEVELWHITEFLAG)) { lineNext++; indentNext = IndentAmount(lineNext, styler); } const int indentNextLevel = indentNext & SC_FOLDLEVELNUMBERMASK; indentNext = indentNextLevel | (indentNext & ~SC_FOLDLEVELNUMBERMASK); const int levelBeforeComments = std::max(indentCurrentLevel, indentNextLevel); Sci_Position skipLine = lineNext; int skipLevel = indentNextLevel; while (--skipLine > lineCurrent) { const int skipLineIndent = IndentAmount(skipLine, styler); if (options.foldCompact) { if ((skipLineIndent & SC_FOLDLEVELNUMBERMASK) > indentNextLevel) { skipLevel = levelBeforeComments; } const int whiteFlag = skipLineIndent & SC_FOLDLEVELWHITEFLAG; styler.SetLevel(skipLine, skipLevel | whiteFlag); } else { if ((skipLineIndent & SC_FOLDLEVELNUMBERMASK) > indentNextLevel && !(skipLineIndent & SC_FOLDLEVELWHITEFLAG)) { skipLevel = levelBeforeComments; } styler.SetLevel(skipLine, skipLevel); } } if (!(indentCurrent & SC_FOLDLEVELWHITEFLAG)) { if ((indentCurrent & SC_FOLDLEVELNUMBERMASK) < (indentNext & SC_FOLDLEVELNUMBERMASK)) { lev |= SC_FOLDLEVELHEADERFLAG; } } styler.SetLevel(lineCurrent, options.foldCompact ? lev : lev & ~SC_FOLDLEVELWHITEFLAG); indentCurrent = indentNext; indentCurrentLevel = indentNextLevel; lineCurrent = lineNext; } } LexerModule lmNim(SCLEX_NIM, LexerNim::LexerFactoryNim, "nim", nimWordListDesc);lexilla/lexers/LexHollywood.cxx0000664000175000017500000003175614647367374015672 0ustar neilneil// Scintilla source code edit control /** @file LexHollywood.cxx ** Lexer for Hollywood ** Written by Andreas Falkenhahn, based on the BlitzBasic/PureBasic/Lua lexers ** Thanks to Nicholai Benalal ** For more information on Hollywood, see http://www.hollywood-mal.com/ ** Mail me (andreas airsoftsoftwair de) for any bugs. ** This code is subject to the same license terms as the rest of the Scintilla project: ** The License.txt file describes the conditions under which this software may be distributed. **/ #include #include #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" #include "OptionSet.h" #include "DefaultLexer.h" using namespace Scintilla; using namespace Lexilla; /* Bits: * 1 - whitespace * 2 - operator * 4 - identifier * 8 - decimal digit * 16 - hex digit * 32 - bin digit * 64 - letter */ static int character_classification[128] = { 0, // NUL ($0) 0, // SOH ($1) 0, // STX ($2) 0, // ETX ($3) 0, // EOT ($4) 0, // ENQ ($5) 0, // ACK ($6) 0, // BEL ($7) 0, // BS ($8) 1, // HT ($9) 1, // LF ($A) 0, // VT ($B) 0, // FF ($C) 1, // CR ($D) 0, // SO ($E) 0, // SI ($F) 0, // DLE ($10) 0, // DC1 ($11) 0, // DC2 ($12) 0, // DC3 ($13) 0, // DC4 ($14) 0, // NAK ($15) 0, // SYN ($16) 0, // ETB ($17) 0, // CAN ($18) 0, // EM ($19) 0, // SUB ($1A) 0, // ESC ($1B) 0, // FS ($1C) 0, // GS ($1D) 0, // RS ($1E) 0, // US ($1F) 1, // space ($20) 4, // ! ($21) 0, // " ($22) 0, // # ($23) 4, // $ ($24) 2, // % ($25) 2, // & ($26) 2, // ' ($27) 2, // ( ($28) 2, // ) ($29) 2, // * ($2A) 2, // + ($2B) 2, // , ($2C) 2, // - ($2D) // NB: we treat "." as an identifier although it is also an operator and a decimal digit // the reason why we treat it as an identifier is to support syntax highlighting for // plugin commands which always use a "." in their names, e.g. pdf.OpenDocument(); // we handle the decimal digit case manually below so that 3.1415 and .123 is styled correctly // the collateral damage of treating "." as an identifier is that "." is never styled // SCE_HOLLYWOOD_OPERATOR 4, // . ($2E) 2, // / ($2F) 28, // 0 ($30) 28, // 1 ($31) 28, // 2 ($32) 28, // 3 ($33) 28, // 4 ($34) 28, // 5 ($35) 28, // 6 ($36) 28, // 7 ($37) 28, // 8 ($38) 28, // 9 ($39) 2, // : ($3A) 2, // ; ($3B) 2, // < ($3C) 2, // = ($3D) 2, // > ($3E) 2, // ? ($3F) 0, // @ ($40) 84, // A ($41) 84, // B ($42) 84, // C ($43) 84, // D ($44) 84, // E ($45) 84, // F ($46) 68, // G ($47) 68, // H ($48) 68, // I ($49) 68, // J ($4A) 68, // K ($4B) 68, // L ($4C) 68, // M ($4D) 68, // N ($4E) 68, // O ($4F) 68, // P ($50) 68, // Q ($51) 68, // R ($52) 68, // S ($53) 68, // T ($54) 68, // U ($55) 68, // V ($56) 68, // W ($57) 68, // X ($58) 68, // Y ($59) 68, // Z ($5A) 2, // [ ($5B) 2, // \ ($5C) 2, // ] ($5D) 2, // ^ ($5E) 68, // _ ($5F) 2, // ` ($60) 84, // a ($61) 84, // b ($62) 84, // c ($63) 84, // d ($64) 84, // e ($65) 84, // f ($66) 68, // g ($67) 68, // h ($68) 68, // i ($69) 68, // j ($6A) 68, // k ($6B) 68, // l ($6C) 68, // m ($6D) 68, // n ($6E) 68, // o ($6F) 68, // p ($70) 68, // q ($71) 68, // r ($72) 68, // s ($73) 68, // t ($74) 68, // u ($75) 68, // v ($76) 68, // w ($77) 68, // x ($78) 68, // y ($79) 68, // z ($7A) 2, // { ($7B) 2, // | ($7C) 2, // } ($7D) 2, // ~ ($7E) 0, //  ($7F) }; static bool IsSpace(int c) { return c < 128 && (character_classification[c] & 1); } static bool IsOperator(int c) { return c < 128 && (character_classification[c] & 2); } static bool IsIdentifier(int c) { return c < 128 && (character_classification[c] & 4); } static bool IsDigit(int c) { return c < 128 && (character_classification[c] & 8); } static bool IsHexDigit(int c) { return c < 128 && (character_classification[c] & 16); } static int LowerCase(int c) { if (c >= 'A' && c <= 'Z') return 'a' + c - 'A'; return c; } static int CheckHollywoodFoldPoint(char const *token) { if (!strcmp(token, "function")) { return 1; } if (!strcmp(token, "endfunction")) { return -1; } return 0; } // An individual named option for use in an OptionSet // Options used for LexerHollywood struct OptionsHollywood { bool fold; bool foldCompact; OptionsHollywood() { fold = false; foldCompact = false; } }; static const char * const hollywoodWordListDesc[] = { "Hollywood keywords", "Hollywood standard API functions", "Hollywood plugin API functions", "Hollywood plugin methods", 0 }; struct OptionSetHollywood : public OptionSet { OptionSetHollywood(const char * const wordListDescriptions[]) { DefineProperty("fold", &OptionsHollywood::fold); DefineProperty("fold.compact", &OptionsHollywood::foldCompact); DefineWordListSets(wordListDescriptions); } }; class LexerHollywood : public DefaultLexer { int (*CheckFoldPoint)(char const *); WordList keywordlists[4]; OptionsHollywood options; OptionSetHollywood osHollywood; public: LexerHollywood(int (*CheckFoldPoint_)(char const *), const char * const wordListDescriptions[]) : DefaultLexer("hollywood", SCLEX_HOLLYWOOD), CheckFoldPoint(CheckFoldPoint_), osHollywood(wordListDescriptions) { } virtual ~LexerHollywood() { } void SCI_METHOD Release() override { delete this; } int SCI_METHOD Version() const override { return lvRelease5; } const char * SCI_METHOD PropertyNames() override { return osHollywood.PropertyNames(); } int SCI_METHOD PropertyType(const char *name) override { return osHollywood.PropertyType(name); } const char * SCI_METHOD DescribeProperty(const char *name) override { return osHollywood.DescribeProperty(name); } Sci_Position SCI_METHOD PropertySet(const char *key, const char *val) override; const char * SCI_METHOD PropertyGet(const char* key) override { return osHollywood.PropertyGet(key); } const char * SCI_METHOD DescribeWordListSets() override { return osHollywood.DescribeWordListSets(); } Sci_Position SCI_METHOD WordListSet(int n, const char *wl) override; void SCI_METHOD Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void SCI_METHOD Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void * SCI_METHOD PrivateCall(int, void *) override { return 0; } static ILexer5 *LexerFactoryHollywood() { return new LexerHollywood(CheckHollywoodFoldPoint, hollywoodWordListDesc); } }; Sci_Position SCI_METHOD LexerHollywood::PropertySet(const char *key, const char *val) { if (osHollywood.PropertySet(&options, key, val)) { return 0; } return -1; } Sci_Position SCI_METHOD LexerHollywood::WordListSet(int n, const char *wl) { WordList *wordListN = 0; switch (n) { case 0: wordListN = &keywordlists[0]; break; case 1: wordListN = &keywordlists[1]; break; case 2: wordListN = &keywordlists[2]; break; case 3: wordListN = &keywordlists[3]; break; } Sci_Position firstModification = -1; if (wordListN) { WordList wlNew; wlNew.Set(wl); if (*wordListN != wlNew) { wordListN->Set(wl); firstModification = 0; } } return firstModification; } void SCI_METHOD LexerHollywood::Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { LexAccessor styler(pAccess); styler.StartAt(startPos); bool inString = false; StyleContext sc(startPos, length, initStyle, styler); // Can't use sc.More() here else we miss the last character for (; ; sc.Forward()) { if (sc.atLineStart) inString = false; if (sc.ch == '\"' && sc.chPrev != '\\') inString = !inString; if (sc.state == SCE_HOLLYWOOD_IDENTIFIER) { if (!IsIdentifier(sc.ch)) { char s[100]; int kstates[4] = { SCE_HOLLYWOOD_KEYWORD, SCE_HOLLYWOOD_STDAPI, SCE_HOLLYWOOD_PLUGINAPI, SCE_HOLLYWOOD_PLUGINMETHOD, }; sc.GetCurrentLowered(s, sizeof(s)); for (int i = 0; i < 4; i++) { if (keywordlists[i].InList(s)) { sc.ChangeState(kstates[i]); } } sc.SetState(SCE_HOLLYWOOD_DEFAULT); } } else if (sc.state == SCE_HOLLYWOOD_OPERATOR) { // always reset to default on operators because otherwise // comments won't be recognized in sequences like "+/* Hello*/" // --> "+/*" would be recognized as a sequence of operators // if (!IsOperator(sc.ch)) sc.SetState(SCE_HOLLYWOOD_DEFAULT); sc.SetState(SCE_HOLLYWOOD_DEFAULT); } else if (sc.state == SCE_HOLLYWOOD_PREPROCESSOR) { if (!IsIdentifier(sc.ch)) sc.SetState(SCE_HOLLYWOOD_DEFAULT); } else if (sc.state == SCE_HOLLYWOOD_CONSTANT) { if (!IsIdentifier(sc.ch)) sc.SetState(SCE_HOLLYWOOD_DEFAULT); } else if (sc.state == SCE_HOLLYWOOD_NUMBER) { if (!IsDigit(sc.ch) && sc.ch != '.') sc.SetState(SCE_HOLLYWOOD_DEFAULT); } else if (sc.state == SCE_HOLLYWOOD_HEXNUMBER) { if (!IsHexDigit(sc.ch)) sc.SetState(SCE_HOLLYWOOD_DEFAULT); } else if (sc.state == SCE_HOLLYWOOD_STRING) { if (sc.ch == '"') { sc.ForwardSetState(SCE_HOLLYWOOD_DEFAULT); } if (sc.atLineEnd) { sc.SetState(SCE_HOLLYWOOD_DEFAULT); } } else if (sc.state == SCE_HOLLYWOOD_COMMENT) { if (sc.atLineEnd) { sc.SetState(SCE_HOLLYWOOD_DEFAULT); } } else if (sc.state == SCE_HOLLYWOOD_COMMENTBLOCK) { if (sc.Match("*/") && !inString) { sc.Forward(); sc.ForwardSetState(SCE_HOLLYWOOD_DEFAULT); } } else if (sc.state == SCE_HOLLYWOOD_STRINGBLOCK) { if (sc.Match("]]") && !inString) { sc.Forward(); sc.ForwardSetState(SCE_HOLLYWOOD_DEFAULT); } } if (sc.state == SCE_HOLLYWOOD_DEFAULT) { if (sc.Match(';')) { sc.SetState(SCE_HOLLYWOOD_COMMENT); } else if (sc.Match("/*")) { sc.SetState(SCE_HOLLYWOOD_COMMENTBLOCK); sc.Forward(); } else if (sc.Match("[[")) { sc.SetState(SCE_HOLLYWOOD_STRINGBLOCK); sc.Forward(); } else if (sc.Match('"')) { sc.SetState(SCE_HOLLYWOOD_STRING); } else if (sc.Match('$')) { sc.SetState(SCE_HOLLYWOOD_HEXNUMBER); } else if (sc.Match("0x") || sc.Match("0X")) { // must be before IsDigit() because of 0x sc.SetState(SCE_HOLLYWOOD_HEXNUMBER); sc.Forward(); } else if (sc.ch == '.' && (sc.chNext >= '0' && sc.chNext <= '9')) { // ".1234" style numbers sc.SetState(SCE_HOLLYWOOD_NUMBER); sc.Forward(); } else if (IsDigit(sc.ch)) { sc.SetState(SCE_HOLLYWOOD_NUMBER); } else if (sc.Match('#')) { sc.SetState(SCE_HOLLYWOOD_CONSTANT); } else if (sc.Match('@')) { sc.SetState(SCE_HOLLYWOOD_PREPROCESSOR); } else if (IsOperator(sc.ch)) { sc.SetState(SCE_HOLLYWOOD_OPERATOR); } else if (IsIdentifier(sc.ch)) { sc.SetState(SCE_HOLLYWOOD_IDENTIFIER); } } if (!sc.More()) break; } sc.Complete(); } void SCI_METHOD LexerHollywood::Fold(Sci_PositionU startPos, Sci_Position length, int /* initStyle */, IDocument *pAccess) { if (!options.fold) return; LexAccessor styler(pAccess); Sci_PositionU lengthDoc = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelPrev = styler.LevelAt(lineCurrent) & SC_FOLDLEVELNUMBERMASK; int levelCurrent = levelPrev; char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); int done = 0; char word[256]; int wordlen = 0; for (Sci_PositionU i = startPos; i < lengthDoc; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); int style = styleNext; styleNext = styler.StyleAt(i + 1); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (!done) { if (wordlen) { // are we scanning a token already? word[wordlen] = static_cast(LowerCase(ch)); if (!IsIdentifier(ch)) { // done with token word[wordlen] = '\0'; levelCurrent += CheckFoldPoint(word); done = 1; } else if (wordlen < 255) { wordlen++; } } else { // start scanning at first non-whitespace character if (!IsSpace(ch)) { if (style != SCE_HOLLYWOOD_COMMENTBLOCK && IsIdentifier(ch)) { word[0] = static_cast(LowerCase(ch)); wordlen = 1; } else // done with this line done = 1; } } } if (atEOL) { int lev = levelPrev; if (visibleChars == 0 && options.foldCompact) { lev |= SC_FOLDLEVELWHITEFLAG; } if ((levelCurrent > levelPrev) && (visibleChars > 0)) { lev |= SC_FOLDLEVELHEADERFLAG; } if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelPrev = levelCurrent; visibleChars = 0; done = 0; wordlen = 0; } if (!IsSpace(ch)) { visibleChars++; } } // Fill in the real level of the next line, keeping the current flags as they will be filled in later int flagsNext = styler.LevelAt(lineCurrent) & ~SC_FOLDLEVELNUMBERMASK; styler.SetLevel(lineCurrent, levelPrev | flagsNext); } LexerModule lmHollywood(SCLEX_HOLLYWOOD, LexerHollywood::LexerFactoryHollywood, "hollywood", hollywoodWordListDesc); lexilla/lexers/LexRuby.cxx0000664000175000017500000022553314647367374014631 0ustar neilneil// Scintilla source code edit control /** @file LexRuby.cxx ** Lexer for Ruby. **/ // Copyright 2001- by Clemens Wyss // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; namespace { //XXX Identical to Perl, put in common area constexpr bool isEOLChar(char ch) noexcept { return (ch == '\r') || (ch == '\n'); } constexpr bool isSafeASCII(char ch) noexcept { return static_cast(ch) <= 127; } // This one's redundant, but makes for more readable code constexpr bool isHighBitChar(char ch) noexcept { return static_cast(ch) > 127; } inline bool isSafeAlpha(char ch) noexcept { return (isSafeASCII(ch) && isalpha(ch)) || ch == '_'; } inline bool isSafeAlphaOrHigh(char ch) noexcept { return isHighBitChar(ch) || isalpha(ch) || ch == '_'; } inline bool isSafeAlnum(char ch) noexcept { return (isSafeASCII(ch) && isalnum(ch)) || ch == '_'; } inline bool isSafeAlnumOrHigh(char ch) noexcept { return isHighBitChar(ch) || isalnum(ch) || ch == '_'; } inline bool isSafeDigit(char ch) noexcept { return isSafeASCII(ch) && isdigit(ch); } inline bool isSafeWordcharOrHigh(char ch) noexcept { // Error: scintilla's KeyWords.h includes '.' as a word-char // we want to separate things that can take methods from the // methods. return isHighBitChar(ch) || isalnum(ch) || ch == '_'; } constexpr bool isWhiteSpace(char ch) noexcept { return ch == ' ' || ch == '\t' || ch == '\r' || ch == '\n'; } inline bool isQestionMarkChar(char chNext, char chNext2) noexcept { // followed by a single character or escape sequence that corresponds to a single codepoint if (isSafeAlnum(chNext)) { return !isSafeWordcharOrHigh(chNext2); } // multibyte character, escape sequence, punctuation return !IsASpace(chNext); } #define MAX_KEYWORD_LENGTH 200 #define STYLE_MASK 63 #define actual_style(style) ((style) & STYLE_MASK) bool followsDot(Sci_PositionU pos, Accessor &styler) { styler.Flush(); for (; pos >= 1; --pos) { const int style = actual_style(styler.StyleAt(pos)); char ch; switch (style) { case SCE_RB_DEFAULT: ch = styler[pos]; if (ch == ' ' || ch == '\t') { //continue } else { return false; } break; case SCE_RB_OPERATOR: return styler[pos] == '.'; default: return false; } } return false; } // Forward declarations bool keywordIsAmbiguous(const char *prevWord) noexcept; bool keywordDoStartsLoop(Sci_Position pos, Accessor &styler); bool keywordIsModifier(const char *word, Sci_Position pos, Accessor &styler); // pseudo style: prefer regex after identifier #define SCE_RB_IDENTIFIER_PREFERRE SCE_RB_UPPER_BOUND int ClassifyWordRb(Sci_PositionU start, Sci_PositionU end, char ch, WordList &keywords, Accessor &styler, char *prevWord) { char s[MAX_KEYWORD_LENGTH]; Sci_PositionU j = 0; Sci_PositionU lim = end - start + 1; // num chars to copy if (lim >= MAX_KEYWORD_LENGTH) { lim = MAX_KEYWORD_LENGTH - 1; } for (Sci_PositionU i = start; j < lim; i++, j++) { s[j] = styler[i]; } s[j] = '\0'; int chAttr = SCE_RB_IDENTIFIER; int style = SCE_RB_DEFAULT; if (0 == strcmp(prevWord, "class")) chAttr = SCE_RB_CLASSNAME; else if (0 == strcmp(prevWord, "module")) chAttr = SCE_RB_MODULE_NAME; else if (0 == strcmp(prevWord, "def")) { chAttr = SCE_RB_DEFNAME; if (ch == '.') { if (strcmp(s, "self") == 0) { style = SCE_RB_WORD_DEMOTED; } else { style = SCE_RB_IDENTIFIER; } } } else if (keywords.InList(s) && ((start == 0) || !followsDot(start - 1, styler))) { if (keywordIsAmbiguous(s) && keywordIsModifier(s, start, styler)) { // Demoted keywords are colored as keywords, // but do not affect changes in indentation. // // Consider the word 'if': // 1. <> : normal // 2. <> : demoted // 3. <> : normal: start a new indent level // 4. <> : color as identifier, since it follows '.' chAttr = SCE_RB_WORD_DEMOTED; } else { chAttr = SCE_RB_WORD; style = SCE_RB_WORD; strcpy(prevWord, s); } } if (style == SCE_RB_DEFAULT) { style = chAttr; prevWord[0] = 0; } styler.ColourTo(end, style); if (chAttr == SCE_RB_IDENTIFIER) { // find heredoc in lib/ruby folder: rg "\w+\s+<<[\w\-~'\"`]" // Kernel methods if (!strcmp(s, "puts") || !strcmp(s, "print") || !strcmp(s, "warn") || !strcmp(s, "eval")) { chAttr = SCE_RB_IDENTIFIER_PREFERRE; } } return chAttr; } //XXX Identical to Perl, put in common area bool isMatch(Accessor &styler, Sci_Position lengthDoc, Sci_Position pos, const char *val) { if ((pos + static_cast(strlen(val))) >= lengthDoc) { return false; } while (*val) { if (*val != styler[pos++]) { return false; } val++; } return true; } // Do Ruby better -- find the end of the line, work back, // and then check for leading white space // Precondition: the here-doc target can be indented bool lookingAtHereDocDelim(Accessor &styler, Sci_Position pos, Sci_Position lengthDoc, const char *HereDocDelim) { if (!isMatch(styler, lengthDoc, pos, HereDocDelim)) { return false; } while (--pos > 0) { const char ch = styler[pos]; if (isEOLChar(ch)) { return true; } else if (ch != ' ' && ch != '\t') { return false; } } return false; } //XXX Identical to Perl, put in common area constexpr char opposite(char ch) noexcept { if (ch == '(') return ')'; if (ch == '[') return ']'; if (ch == '{') return '}'; if (ch == '<') return '>'; return ch; } // Null transitions when we see we've reached the end // and need to relex the curr char. void redo_char(Sci_Position &i, char &ch, char &chNext, char &chNext2, int &state) noexcept { i--; chNext2 = chNext; chNext = ch; state = SCE_RB_DEFAULT; } void advance_char(Sci_Position &i, char &ch, char &chNext, char &chNext2) noexcept { i++; ch = chNext; chNext = chNext2; } // precondition: startPos points to one after the EOL char bool currLineContainsHereDelims(Sci_Position &startPos, Accessor &styler) { if (startPos <= 1) return false; Sci_Position pos; for (pos = startPos - 1; pos > 0; pos--) { const char ch = styler.SafeGetCharAt(pos); if (isEOLChar(ch)) { // Leave the pointers where they are -- there are no // here doc delims on the current line, even if // the EOL isn't default style return false; } else { styler.Flush(); if (actual_style(styler.StyleAt(pos)) == SCE_RB_HERE_DELIM) { break; } } } if (pos == 0) { return false; } // Update the pointers so we don't have to re-analyze the string startPos = pos; return true; } // This class is used by the enter and exit methods, so it needs // to be hoisted out of the function. class QuoteCls { public: int Count; char Up; char Down; QuoteCls() noexcept { New(); } void New() noexcept { Count = 0; Up = '\0'; Down = '\0'; } void Open(char u) noexcept { Count++; Up = u; Down = opposite(Up); } }; constexpr bool isPercentLiteral(int state) noexcept { return state == SCE_RB_STRING_Q || state == SCE_RB_STRING_QQ // excluded SCE_RB_STRING_QR || state == SCE_RB_STRING_W || state == SCE_RB_STRING_QW || state == SCE_RB_STRING_I || state == SCE_RB_STRING_QI || state == SCE_RB_STRING_QS || state == SCE_RB_STRING_QX; } constexpr bool isInterpolableLiteral(int state) noexcept { return state != SCE_RB_STRING_Q && state != SCE_RB_STRING_W && state != SCE_RB_STRING_I && state != SCE_RB_STRING_QS && state != SCE_RB_CHARACTER; } inline bool isSingleSpecialVariable(char ch) noexcept { // https://docs.ruby-lang.org/en/master/globals_rdoc.html return strchr("~*$?!@/\\;,.=:<>\"&`'+", ch) != nullptr; } void InterpolateVariable(LexAccessor &styler, int state, Sci_Position &i, char &ch, char &chNext, char chNext2) { Sci_Position pos = i; styler.ColourTo(pos - 1, state); styler.ColourTo(pos, SCE_RB_OPERATOR); state = SCE_RB_GLOBAL; pos += 2; unsigned len = 0; if (chNext == '$') { if (chNext2 == '-') { ++pos; len = 2; } else if (isSingleSpecialVariable(chNext2)) { ++pos; len = 1; } } else { state = SCE_RB_INSTANCE_VAR; if (chNext2 == '@') { state = SCE_RB_CLASS_VAR; ++pos; } } while (true) { chNext2 = styler.SafeGetCharAt(pos); --len; if (len == 0 || !isSafeWordcharOrHigh(chNext2)) { break; } ++pos; } --pos; styler.ColourTo(pos, state); i = pos; ch = chNext; chNext = chNext2; } bool isEmptyLine(Sci_Position pos, Accessor &styler) { int spaceFlags = 0; const Sci_Position lineCurrent = styler.GetLine(pos); const int indentCurrent = styler.IndentAmount(lineCurrent, &spaceFlags, nullptr); return (indentCurrent & SC_FOLDLEVELWHITEFLAG) != 0; } bool RE_CanFollowKeyword(const char *keyword) noexcept { if (!strcmp(keyword, "and") || !strcmp(keyword, "begin") || !strcmp(keyword, "break") || !strcmp(keyword, "case") || !strcmp(keyword, "do") || !strcmp(keyword, "else") || !strcmp(keyword, "elsif") || !strcmp(keyword, "if") || !strcmp(keyword, "next") || !strcmp(keyword, "return") || !strcmp(keyword, "when") || !strcmp(keyword, "unless") || !strcmp(keyword, "until") || !strcmp(keyword, "not") || !strcmp(keyword, "or")) { return true; } return false; } // Look at chars up to but not including endPos // Don't look at styles in case we're looking forward Sci_Position skipWhitespace(Sci_Position startPos, Sci_Position endPos, Accessor &styler) { for (Sci_Position i = startPos; i < endPos; i++) { if (!IsASpaceOrTab(styler[i])) { return i; } } return endPos; } // This routine looks for false positives like // undef foo, << // There aren't too many. // // iPrev points to the start of << bool sureThisIsHeredoc(Sci_Position iPrev, Accessor &styler, char *prevWord) { // Not so fast, since Ruby's so dynamic. Check the context // to make sure we're OK. int prevStyle; const Sci_Position lineStart = styler.GetLine(iPrev); const Sci_Position lineStartPosn = styler.LineStart(lineStart); styler.Flush(); // Find the first word after some whitespace const Sci_Position firstWordPosn = skipWhitespace(lineStartPosn, iPrev, styler); if (firstWordPosn >= iPrev) { // Have something like {^ <<} //XXX Look at the first previous non-comment non-white line // to establish the context. Not too likely though. return true; } else { prevStyle = styler.StyleAt(firstWordPosn); switch (prevStyle) { case SCE_RB_WORD: case SCE_RB_WORD_DEMOTED: case SCE_RB_IDENTIFIER: break; default: return true; } } Sci_Position firstWordEndPosn = firstWordPosn; char *dst = prevWord; for (;;) { if (firstWordEndPosn >= iPrev || styler.StyleAt(firstWordEndPosn) != prevStyle) { *dst = 0; break; } *dst++ = styler[firstWordEndPosn]; firstWordEndPosn += 1; } //XXX Write a style-aware thing to regex scintilla buffer objects if (!strcmp(prevWord, "undef") || !strcmp(prevWord, "def") || !strcmp(prevWord, "alias")) { // These keywords are what we were looking for return false; } return true; } // Routine that saves us from allocating a buffer for the here-doc target // targetEndPos points one past the end of the current target bool haveTargetMatch(Sci_Position currPos, Sci_Position lengthDoc, Sci_Position targetStartPos, Sci_Position targetEndPos, Accessor &styler) { if (lengthDoc - currPos < targetEndPos - targetStartPos) { return false; } for (Sci_Position i = targetStartPos, j = currPos; i < targetEndPos && j < lengthDoc; i++, j++) { if (styler[i] != styler[j]) { return false; } } return true; } // Finds the start position of the expression containing @p pos // @p min_pos should be a known expression start, e.g. the start of the line Sci_Position findExpressionStart(Sci_Position pos, Sci_Position min_pos, Accessor &styler) { int depth = 0; for (; pos > min_pos; pos -= 1) { const int style = styler.StyleAt(pos - 1); if (style == SCE_RB_OPERATOR) { const int ch = styler[pos - 1]; if (ch == '}' || ch == ')' || ch == ']') { depth += 1; } else if (ch == '{' || ch == '(' || ch == '[') { if (depth == 0) { break; } else { depth -= 1; } } else if (ch == ';' && depth == 0) { break; } } } return pos; } // We need a check because the form // [identifier] <<[target] // is ambiguous. The Ruby lexer/parser resolves it by // looking to see if [identifier] names a variable or a // function. If it's the first, it's the start of a here-doc. // If it's a var, it's an operator. This lexer doesn't // maintain a symbol table, so it looks ahead to see what's // going on, in cases where we have // ^[white-space]*[identifier([.|::]identifier)*][white-space]*<<[target] // // If there's no occurrence of [target] on a line, assume we don't. // return true == yes, we have no heredocs bool sureThisIsNotHeredoc(Sci_Position lt2StartPos, Accessor &styler) { // Use full document, not just part we're styling const Sci_Position lengthDoc = styler.Length(); const Sci_Position lineStart = styler.GetLine(lt2StartPos); const Sci_Position lineStartPosn = styler.LineStart(lineStart); styler.Flush(); constexpr bool definitely_not_a_here_doc = true; constexpr bool looks_like_a_here_doc = false; // find the expression start rather than the line start const Sci_Position exprStartPosn = findExpressionStart(lt2StartPos, lineStartPosn, styler); // Find the first word after some whitespace Sci_Position firstWordPosn = skipWhitespace(exprStartPosn, lt2StartPos, styler); if (firstWordPosn >= lt2StartPos) { return definitely_not_a_here_doc; } int prevStyle = styler.StyleAt(firstWordPosn); // If we have '<<' following a keyword, it's not a heredoc if (prevStyle != SCE_RB_IDENTIFIER && prevStyle != SCE_RB_GLOBAL // $stdout and $stderr && prevStyle != SCE_RB_SYMBOL && prevStyle != SCE_RB_INSTANCE_VAR && prevStyle != SCE_RB_CLASS_VAR) { return definitely_not_a_here_doc; } int newStyle = prevStyle; // Some compilers incorrectly warn about uninit newStyle for (firstWordPosn += 1; firstWordPosn <= lt2StartPos; firstWordPosn += 1) { // Inner loop looks at the name for (; firstWordPosn <= lt2StartPos; firstWordPosn += 1) { newStyle = styler.StyleAt(firstWordPosn); if (newStyle != prevStyle) { break; } } // Do we have '::' or '.'? if (firstWordPosn < lt2StartPos && newStyle == SCE_RB_OPERATOR) { const char ch = styler[firstWordPosn]; if (ch == '.') { // yes } else if (ch == ':') { if (styler.StyleAt(++firstWordPosn) != SCE_RB_OPERATOR) { return definitely_not_a_here_doc; } else if (styler[firstWordPosn] != ':') { return definitely_not_a_here_doc; } } else { break; } } else { break; } // on second and next passes, only identifiers may appear since // class and instance variable are private prevStyle = SCE_RB_IDENTIFIER; } // Skip next batch of white-space firstWordPosn = skipWhitespace(firstWordPosn, lt2StartPos, styler); // possible symbol for an implicit hash argument if (firstWordPosn < lt2StartPos && styler.StyleAt(firstWordPosn) == SCE_RB_SYMBOL) { for (; firstWordPosn <= lt2StartPos; firstWordPosn += 1) { if (styler.StyleAt(firstWordPosn) != SCE_RB_SYMBOL) { break; } } // Skip next batch of white-space firstWordPosn = skipWhitespace(firstWordPosn, lt2StartPos, styler); } if (firstWordPosn != lt2StartPos) { // Have [[^ws[identifier]ws[*something_else*]ws<< return definitely_not_a_here_doc; } // OK, now 'j' will point to the current spot moving ahead Sci_Position j = firstWordPosn + 1; if (styler.StyleAt(j) != SCE_RB_OPERATOR || styler[j] != '<') { // This shouldn't happen return definitely_not_a_here_doc; } const Sci_Position nextLineStartPosn = styler.LineStart(lineStart + 1); if (nextLineStartPosn >= lengthDoc) { return definitely_not_a_here_doc; } j = skipWhitespace(j + 1, nextLineStartPosn, styler); if (j >= lengthDoc) { return definitely_not_a_here_doc; } bool allow_indent; Sci_Position target_start; Sci_Position target_end; // From this point on no more styling, since we're looking ahead if (styler[j] == '-' || styler[j] == '~') { allow_indent = true; j++; } else { allow_indent = false; } // Allow for quoted targets. char target_quote = 0; switch (styler[j]) { case '\'': case '"': case '`': target_quote = styler[j]; j += 1; } if (isSafeAlnumOrHigh(styler[j])) { // Init target_end because some compilers think it won't // be initialized by the time it's used target_start = target_end = j; j++; } else { return definitely_not_a_here_doc; } for (; j < lengthDoc; j++) { if (!isSafeAlnumOrHigh(styler[j])) { if (target_quote && styler[j] != target_quote) { // unquoted end return definitely_not_a_here_doc; } // And for now make sure that it's a newline // don't handle arbitrary expressions yet target_end = j; if (target_quote) { // Now we can move to the character after the string delimiter. j += 1; } j = skipWhitespace(j, lengthDoc, styler); if (j >= lengthDoc) { return definitely_not_a_here_doc; } else { const char ch = styler[j]; if (ch == '#' || isEOLChar(ch) || ch == '.' || ch == ',' || IsLowerCase(ch)) { // This is OK, so break and continue; break; } else { return definitely_not_a_here_doc; } } } } // Just look at the start of each line Sci_Position last_line = styler.GetLine(lengthDoc - 1); // But don't go too far if (last_line > lineStart + 50) { last_line = lineStart + 50; } for (Sci_Position line_num = lineStart + 1; line_num <= last_line; line_num++) { j = styler.LineStart(line_num); if (allow_indent) { j = skipWhitespace(j, lengthDoc, styler); } // target_end is one past the end if (haveTargetMatch(j, lengthDoc, target_start, target_end, styler)) { // We got it return looks_like_a_here_doc; } } return definitely_not_a_here_doc; } //todo: if we aren't looking at a stdio character, // move to the start of the first line that is not in a // multi-line construct void synchronizeDocStart(Sci_PositionU &startPos, Sci_Position &length, int &initStyle, Accessor &styler, bool skipWhiteSpace=false) { styler.Flush(); const int style = actual_style(styler.StyleAt(startPos)); switch (style) { case SCE_RB_STDIN: case SCE_RB_STDOUT: case SCE_RB_STDERR: // Don't do anything else with these. return; } Sci_Position pos = startPos; // Quick way to characterize each line Sci_Position lineStart; for (lineStart = styler.GetLine(pos); lineStart > 0; lineStart--) { // Now look at the style before the previous line's EOL pos = styler.LineStart(lineStart) - 1; if (pos <= 10) { lineStart = 0; break; } const char ch = styler.SafeGetCharAt(pos); const char chPrev = styler.SafeGetCharAt(pos - 1); if (ch == '\n' && chPrev == '\r') { pos--; } if (styler.SafeGetCharAt(pos - 1) == '\\') { // Continuation line -- keep going } else if (actual_style(styler.StyleAt(pos)) != SCE_RB_DEFAULT) { // Part of multi-line construct -- keep going } else if (currLineContainsHereDelims(pos, styler)) { // Keep going, with pos and length now pointing // at the end of the here-doc delimiter } else if (skipWhiteSpace && isEmptyLine(pos, styler)) { // Keep going } else { break; } } pos = styler.LineStart(lineStart); length += (startPos - pos); startPos = pos; initStyle = SCE_RB_DEFAULT; } void ColouriseRbDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { // Lexer for Ruby often has to backtrack to start of current style to determine // which characters are being used as quotes, how deeply nested is the // start position and what the termination string is for here documents WordList &keywords = *keywordlists[0]; class HereDocCls { public: int State = 0; // States // 0: '<<' encountered // 1: collect the delimiter // 1b: text between the end of the delimiter and the EOL // 2: here doc text (lines after the delimiter) char Quote = 0; // the char after '<<' bool Quoted = false; // true if Quote in ('\'','"','`') int DelimiterLength = 0; // strlen(Delimiter) char Delimiter[256] {}; // the Delimiter, limit of 256: from Perl bool CanBeIndented = false; }; HereDocCls HereDoc; QuoteCls Quote; synchronizeDocStart(startPos, length, initStyle, styler, false); bool preferRE = true; bool afterDef = false; int state = initStyle; const Sci_Position lengthDoc = startPos + length; char prevWord[MAX_KEYWORD_LENGTH + 1] = ""; // 1 byte for zero if (length == 0) return; char chPrev = styler.SafeGetCharAt(startPos - 1); char chNext = styler.SafeGetCharAt(startPos); bool is_real_number = true; // Differentiate between constants and ?-sequences. styler.StartAt(startPos); styler.StartSegment(startPos); static constexpr int q_states[] = { SCE_RB_STRING_Q, SCE_RB_STRING_QQ, SCE_RB_STRING_QR, SCE_RB_STRING_W, SCE_RB_STRING_QW, SCE_RB_STRING_QX, SCE_RB_STRING_I, SCE_RB_STRING_QI, SCE_RB_STRING_QS, }; constexpr const char *q_chars = "qQrwWxiIs"; // In most cases a value of 2 should be ample for the code in the // Ruby library, and the code the user is likely to enter. // For example, // fu_output_message "mkdir #{options[:mode] ? ('-m %03o ' % options[:mode]) : ''}#{list.join ' '}" // if options[:verbose] // from fileutils.rb nests to a level of 2 // If the user actually hits a 6th occurrence of '#{' in a double-quoted // string (including regex'es, %Q, %, %w, and other strings // that interpolate), it will stay as a string. The problem with this // is that quotes might flip, a 7th '#{' will look like a comment, // and code-folding might be wrong. // If anyone runs into this problem, I recommend raising this // value slightly higher to replacing the fixed array with a linked // list. Keep in mind this code will be called every time the lexer // is invoked. #define INNER_STRINGS_MAX_COUNT 5 class InnerExpression { // These vars track our instances of "...#{,,,%Q<..#{,,,}...>,,,}..." int inner_string_types[INNER_STRINGS_MAX_COUNT] {}; // Track # braces when we push a new #{ thing int inner_expn_brace_counts[INNER_STRINGS_MAX_COUNT] {}; QuoteCls inner_quotes[INNER_STRINGS_MAX_COUNT]; int inner_string_count = 0; public: int brace_counts = 0; // Number of #{ ... } things within an expression bool canEnter() const noexcept { return inner_string_count < INNER_STRINGS_MAX_COUNT; } bool canExit() const noexcept { return inner_string_count > 0; } void enter(int &state, const QuoteCls &curr_quote) noexcept { inner_string_types[inner_string_count] = state; state = SCE_RB_DEFAULT; inner_expn_brace_counts[inner_string_count] = brace_counts; brace_counts = 0; inner_quotes[inner_string_count] = curr_quote; ++inner_string_count; } void exit(int &state, QuoteCls &curr_quote) noexcept { --inner_string_count; state = inner_string_types[inner_string_count]; brace_counts = inner_expn_brace_counts[inner_string_count]; curr_quote = inner_quotes[inner_string_count]; } }; InnerExpression innerExpr; for (Sci_Position i = startPos; i < lengthDoc; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); char chNext2 = styler.SafeGetCharAt(i + 2); if (styler.IsLeadByte(ch)) { chNext = chNext2; chPrev = ' '; i += 1; continue; } // skip on DOS/Windows //No, don't, because some things will get tagged on, // so we won't recognize keywords, for example #if 0 if (ch == '\r' && chNext == '\n') { continue; } #endif if (HereDoc.State == 1 && isEOLChar(ch)) { // Begin of here-doc (the line after the here-doc delimiter): HereDoc.State = 2; if (state == SCE_RB_WORD) { const Sci_Position wordStartPos = styler.GetStartSegment(); ClassifyWordRb(wordStartPos, i - 1, ch, keywords, styler, prevWord); } else { styler.ColourTo(i - 1, state); } // Don't check for a missing quote, just jump into // the here-doc state state = SCE_RB_HERE_QQ; if (HereDoc.Quoted) { if (HereDoc.Quote == '\'') { state = SCE_RB_HERE_Q; } else if (HereDoc.Quote == '`') { state = SCE_RB_HERE_QX; } } } // Regular transitions if (state == SCE_RB_DEFAULT) { if (isSafeDigit(ch)) { styler.ColourTo(i - 1, state); state = SCE_RB_NUMBER; is_real_number = true; } else if (isSafeAlphaOrHigh(ch)) { styler.ColourTo(i - 1, state); state = SCE_RB_WORD; } else if (ch == '#') { styler.ColourTo(i - 1, state); state = SCE_RB_COMMENTLINE; } else if (ch == '=') { // =begin indicates the start of a comment (doc) block if ((i == 0 || isEOLChar(chPrev)) && chNext == 'b' && styler.SafeGetCharAt(i + 2) == 'e' && styler.SafeGetCharAt(i + 3) == 'g' && styler.SafeGetCharAt(i + 4) == 'i' && styler.SafeGetCharAt(i + 5) == 'n' && !isSafeWordcharOrHigh(styler.SafeGetCharAt(i + 6))) { styler.ColourTo(i - 1, state); state = SCE_RB_POD; } else { styler.ColourTo(i - 1, state); styler.ColourTo(i, SCE_RB_OPERATOR); preferRE = true; } } else if (ch == '"') { styler.ColourTo(i - 1, state); state = SCE_RB_STRING; Quote.New(); Quote.Open(ch); } else if (ch == '\'') { styler.ColourTo(i - 1, state); state = SCE_RB_CHARACTER; Quote.New(); Quote.Open(ch); } else if (ch == '`') { styler.ColourTo(i - 1, state); state = SCE_RB_BACKTICKS; Quote.New(); Quote.Open(ch); } else if (ch == '@') { // Instance or class var styler.ColourTo(i - 1, state); if (chNext == '@') { state = SCE_RB_CLASS_VAR; advance_char(i, ch, chNext, chNext2); // pass by ref } else { state = SCE_RB_INSTANCE_VAR; } } else if (ch == '$') { // Check for a builtin global styler.ColourTo(i - 1, state); // Recognize it bit by bit state = SCE_RB_GLOBAL; } else if (ch == '/' && preferRE) { // Ambiguous operator styler.ColourTo(i - 1, state); state = SCE_RB_REGEX; Quote.New(); Quote.Open(ch); } else if (ch == '<' && chNext == '<' && chNext2 != '=') { if (afterDef) { afterDef = false; prevWord[0] = 0; } // Recognise the '<<' symbol - either a here document or a binary op styler.ColourTo(i - 1, state); i++; chNext = chNext2; styler.ColourTo(i, SCE_RB_OPERATOR); if (!(strchr("\"\'`_-~", chNext2) || isSafeAlphaOrHigh(chNext2))) { // It's definitely not a here-doc, // based on Ruby's lexer/parser in the // heredoc_identifier routine. // Nothing else to do. } else if (preferRE) { if (sureThisIsHeredoc(i - 1, styler, prevWord)) { state = SCE_RB_HERE_DELIM; HereDoc.State = 0; } // else leave it in default state } else { if (sureThisIsNotHeredoc(i - 1, styler)) { // leave state as default // We don't have all the heuristics Perl has for indications // of a here-doc, because '<<' is overloadable and used // for so many other classes. } else { state = SCE_RB_HERE_DELIM; HereDoc.State = 0; } } preferRE = (state != SCE_RB_HERE_DELIM); } else if (ch == ':') { afterDef = false; styler.ColourTo(i - 1, state); if (chNext == ':') { // Mark "::" as an operator, not symbol start styler.ColourTo(i + 1, SCE_RB_OPERATOR); advance_char(i, ch, chNext, chNext2); // pass by ref state = SCE_RB_DEFAULT; preferRE = false; } else if (isSafeWordcharOrHigh(chNext)) { state = SCE_RB_SYMBOL; } else if ((chNext == '@' || chNext == '$') && isSafeWordcharOrHigh(chNext2)) { // instance and global variable followed by an identifier advance_char(i, ch, chNext, chNext2); state = SCE_RB_SYMBOL; } else if (((chNext == '@' && chNext2 == '@') || (chNext == '$' && chNext2 == '-')) && isSafeWordcharOrHigh(styler.SafeGetCharAt(i+3))) { // class variables and special global variable "$-IDENTCHAR" state = SCE_RB_SYMBOL; // $-IDENTCHAR doesn't continue past the IDENTCHAR if (chNext == '$') { styler.ColourTo(i+3, SCE_RB_SYMBOL); state = SCE_RB_DEFAULT; } i += 3; ch = styler.SafeGetCharAt(i); chNext = styler.SafeGetCharAt(i+1); } else if (chNext == '$' && isSingleSpecialVariable(chNext2)) { // single-character special global variables i += 2; ch = chNext2; chNext = styler.SafeGetCharAt(i+1); styler.ColourTo(i, SCE_RB_SYMBOL); state = SCE_RB_DEFAULT; } else if (strchr("[*!~+-*/%=<>&^|", chNext)) { // Do the operator analysis in-line, looking ahead // Based on the table in pickaxe 2nd ed., page 339 bool doColoring = true; switch (chNext) { case '[': if (chNext2 == ']') { const char ch_tmp = styler.SafeGetCharAt(i + 3); if (ch_tmp == '=') { i += 3; ch = ch_tmp; chNext = styler.SafeGetCharAt(i + 1); } else { i += 2; ch = chNext2; chNext = ch_tmp; } } else { doColoring = false; } break; case '*': if (chNext2 == '*') { i += 2; ch = chNext2; chNext = styler.SafeGetCharAt(i + 1); } else { advance_char(i, ch, chNext, chNext2); } break; case '!': if (chNext2 == '=' || chNext2 == '~') { i += 2; ch = chNext2; chNext = styler.SafeGetCharAt(i + 1); } else { advance_char(i, ch, chNext, chNext2); } break; case '<': if (chNext2 == '<') { i += 2; ch = chNext2; chNext = styler.SafeGetCharAt(i + 1); } else if (chNext2 == '=') { const char ch_tmp = styler.SafeGetCharAt(i + 3); if (ch_tmp == '>') { // <=> operator i += 3; ch = ch_tmp; chNext = styler.SafeGetCharAt(i + 1); } else { i += 2; ch = chNext2; chNext = ch_tmp; } } else { advance_char(i, ch, chNext, chNext2); } break; default: // Simple one-character operators advance_char(i, ch, chNext, chNext2); break; } if (doColoring) { styler.ColourTo(i, SCE_RB_SYMBOL); state = SCE_RB_DEFAULT; } } else if (!preferRE && !IsASpace(chNext)) { // Don't color symbol strings (yet) // Just color the ":" and color rest as string styler.ColourTo(i, SCE_RB_SYMBOL); state = SCE_RB_DEFAULT; } else { styler.ColourTo(i, SCE_RB_OPERATOR); state = SCE_RB_DEFAULT; preferRE = true; } } else if (ch == '%' && !afterDef) { styler.ColourTo(i - 1, state); bool have_string = false; const char *hit = strchr(q_chars, chNext); if (hit != nullptr && !isSafeWordcharOrHigh(chNext2)) { Quote.New(); state = q_states[hit - q_chars]; Quote.Open(chNext2); i += 2; ch = chNext2; chNext = styler.SafeGetCharAt(i + 1); have_string = true; } else if ((preferRE || (!isWhiteSpace(chNext) && chNext != '=')) && !isSafeWordcharOrHigh(chNext)) { // Ruby doesn't allow high bit chars here, // but the editor host might Quote.New(); state = SCE_RB_STRING_QQ; Quote.Open(chNext); advance_char(i, ch, chNext, chNext2); // pass by ref have_string = true; } if (!have_string) { styler.ColourTo(i, SCE_RB_OPERATOR); // stay in default preferRE = true; } } else if (ch == '?') { afterDef = false; styler.ColourTo(i - 1, state); if (isHighBitChar(chNext)) { preferRE = false; Sci_Position width = 1; styler.MultiByteAccess()->GetCharacterAndWidth(i + 1, &width); chNext = styler.SafeGetCharAt(i + 1 + width); if (isSafeWordcharOrHigh(chNext)) { styler.ColourTo(i, SCE_RB_OPERATOR); i += width; state = SCE_RB_WORD; } else { i += width; styler.ColourTo(i, SCE_RB_NUMBER); } } else if (!isQestionMarkChar(chNext, chNext2)) { styler.ColourTo(i, SCE_RB_OPERATOR); preferRE = chNext <= ' '; } else { // It's the start of a character code escape sequence // Color it as a number. state = SCE_RB_NUMBER; is_real_number = false; } } else if (isoperator(ch) || ch == '.') { styler.ColourTo(i - 1, state); if (afterDef && ch != '.') { afterDef = false; prevWord[0] = 0; if (chNext == '@' && (ch == '+' || ch == '-' || ch == '!')) { // unary operator method ch = chNext; chNext = chNext2; i += 1; } } styler.ColourTo(i, SCE_RB_OPERATOR); // If we're ending an expression or block, // assume it ends an object, and the ambivalent // constructs are binary operators // // So if we don't have one of these chars, // we aren't ending an object exp'n, and ops // like : << / are unary operators. if (ch == '{') { ++innerExpr.brace_counts; preferRE = true; } else if (ch == '}' && --innerExpr.brace_counts < 0 && innerExpr.canExit()) { styler.ColourTo(i, SCE_RB_OPERATOR); innerExpr.exit(state, Quote); } else { preferRE = !AnyOf(ch, ')', '}', ']', '.'); } // Stay in default state } else if (isEOLChar(ch)) { afterDef = false; // Make sure it's a true line-end, with no backslash if ((ch == '\r' || (ch == '\n' && chPrev != '\r')) && chPrev != '\\') { // Assume we've hit the end of the statement. preferRE = true; } } if (afterDef && state != SCE_RB_DEFAULT) { afterDef = false; } } else if (state == SCE_RB_WORD) { if (ch == '.' || !isSafeWordcharOrHigh(ch)) { // Words include x? in all contexts, // and = after either 'def' or a dot // Move along until a complete word is on our left // Default accessor treats '.' as word-chars, // but we don't for now. if (ch == '=' && isSafeWordcharOrHigh(chPrev) && (chNext == '(' || isWhiteSpace(chNext)) && (!strcmp(prevWord, "def") || followsDot(styler.GetStartSegment(), styler))) { // = is a name only when being def'd -- Get it the next time // This means that = is always lexed as // , (op, =), } else if (ch == ':' && isSafeWordcharOrHigh(chPrev) && isWhiteSpace(chNext)) { // keyword argument, symbol Hash key styler.ColourTo(i, SCE_RB_SYMBOL); state = SCE_RB_DEFAULT; preferRE = true; } else if ((ch == '?' || ch == '!') && isSafeWordcharOrHigh(chPrev) && !isSafeWordcharOrHigh(chNext)) { // ? is a name -- Get it the next time // But ? is always lexed as // , (op, ?), // Same with ! to indicate a method that // modifies its target } else if (isEOLChar(ch) && isMatch(styler, lengthDoc, i - 7, "__END__")) { styler.ColourTo(i, SCE_RB_DATASECTION); state = SCE_RB_DATASECTION; // No need to handle this state -- we'll just move to the end preferRE = false; } else { const Sci_Position wordStartPos = styler.GetStartSegment(); const int word_style = ClassifyWordRb(wordStartPos, i - 1, ch, keywords, styler, prevWord); switch (word_style) { case SCE_RB_WORD: afterDef = strcmp(prevWord, "def") == 0; preferRE = RE_CanFollowKeyword(prevWord); break; case SCE_RB_WORD_DEMOTED: case SCE_RB_DEFNAME: case SCE_RB_IDENTIFIER_PREFERRE: preferRE = true; break; case SCE_RB_IDENTIFIER: preferRE = isEOLChar(ch); break; default: preferRE = false; } if (ch == '.') { // We might be redefining an operator-method afterDef = word_style == SCE_RB_DEFNAME; } // And if it's the first redo_char(i, ch, chNext, chNext2, state); // pass by ref } } } else if (state == SCE_RB_NUMBER) { if (!is_real_number) { if (ch != '\\' || chPrev == '\\') { styler.ColourTo(i, state); state = SCE_RB_DEFAULT; preferRE = false; } else if (strchr("\\ntrfvaebs", chNext)) { // Terminal escape sequence -- handle it next time // Nothing more to do this time through the loop } else if (chNext == 'C' || chNext == 'M') { if (chNext2 != '-') { // \C or \M ends the sequence -- handle it next time } else { // Move from abc?\C-x // ^ // to // ^ i += 2; ch = chNext2; chNext = styler.SafeGetCharAt(i + 1); } } else if (chNext == 'c') { // Stay here, \c is a combining sequence advance_char(i, ch, chNext, chNext2); // pass by ref } else { // ?\x, including ?\\ is final. styler.ColourTo(i + 1, state); state = SCE_RB_DEFAULT; preferRE = false; advance_char(i, ch, chNext, chNext2); } } else if (isSafeAlnumOrHigh(ch) || ch == '_' || (ch == '.' && isSafeDigit(chNext))) { // Keep going } else if (ch == '.' && chNext == '.') { styler.ColourTo(i - 1, state); redo_char(i, ch, chNext, chNext2, state); // pass by ref } else { styler.ColourTo(i - 1, state); redo_char(i, ch, chNext, chNext2, state); // pass by ref preferRE = false; } } else if (state == SCE_RB_COMMENTLINE) { if (isEOLChar(ch)) { styler.ColourTo(i - 1, state); state = SCE_RB_DEFAULT; // Use whatever setting we had going into the comment } } else if (state == SCE_RB_HERE_DELIM) { // See the comment for SCE_RB_HERE_DELIM in LexPerl.cxx // Slightly different: if we find an immediate '-', // the target can appear indented. if (HereDoc.State == 0) { // '<<' encountered HereDoc.State = 1; HereDoc.DelimiterLength = 0; if (ch == '-' || ch == '~') { HereDoc.CanBeIndented = true; advance_char(i, ch, chNext, chNext2); // pass by ref } else { HereDoc.CanBeIndented = false; } if (isEOLChar(ch)) { // Bail out of doing a here doc if there's no target state = SCE_RB_DEFAULT; preferRE = false; } else { HereDoc.Quote = ch; if (ch == '\'' || ch == '"' || ch == '`') { HereDoc.Quoted = true; HereDoc.Delimiter[0] = '\0'; } else { HereDoc.Quoted = false; HereDoc.Delimiter[0] = ch; HereDoc.Delimiter[1] = '\0'; HereDoc.DelimiterLength = 1; } } } else if (HereDoc.State == 1) { // collect the delimiter if (isEOLChar(ch)) { // End the quote now, and go back for more styler.ColourTo(i - 1, state); state = SCE_RB_DEFAULT; i--; chNext = ch; preferRE = false; } else if (HereDoc.Quoted) { if (ch == HereDoc.Quote) { // closing quote => end of delimiter styler.ColourTo(i, state); state = SCE_RB_DEFAULT; preferRE = false; } else { if (ch == '\\' && !isEOLChar(chNext)) { advance_char(i, ch, chNext, chNext2); } HereDoc.Delimiter[HereDoc.DelimiterLength++] = ch; HereDoc.Delimiter[HereDoc.DelimiterLength] = '\0'; } } else { // an unquoted here-doc delimiter if (isSafeAlnumOrHigh(ch) || ch == '_') { HereDoc.Delimiter[HereDoc.DelimiterLength++] = ch; HereDoc.Delimiter[HereDoc.DelimiterLength] = '\0'; } else { styler.ColourTo(i - 1, state); redo_char(i, ch, chNext, chNext2, state); preferRE = false; } } if (HereDoc.DelimiterLength >= static_cast(sizeof(HereDoc.Delimiter)) - 1) { styler.ColourTo(i - 1, state); state = SCE_RB_ERROR; preferRE = false; } } } else if (state == SCE_RB_HERE_Q || state == SCE_RB_HERE_QQ || state == SCE_RB_HERE_QX) { if (ch == '\\' && !isEOLChar(chNext)) { advance_char(i, ch, chNext, chNext2); } else if (ch == '#' && state != SCE_RB_HERE_Q && (chNext == '{' || chNext == '@' || chNext == '$')) { if (chNext == '{') { if (innerExpr.canEnter()) { // process #{ ... } styler.ColourTo(i - 1, state); styler.ColourTo(i + 1, SCE_RB_OPERATOR); innerExpr.enter(state, Quote); preferRE = true; // Skip one advance_char(i, ch, chNext, chNext2); } } else { InterpolateVariable(styler, state, i, ch, chNext, chNext2); } } // Not needed: HereDoc.State == 2 // Indentable here docs: look backwards // Non-indentable: look forwards, like in Perl // // Why: so we can quickly resolve things like <<-" abc" else if (!HereDoc.CanBeIndented) { if (isEOLChar(chPrev) && isMatch(styler, lengthDoc, i, HereDoc.Delimiter)) { styler.ColourTo(i - 1, state); i += static_cast(HereDoc.DelimiterLength) - 1; chNext = styler.SafeGetCharAt(i + 1); if (isEOLChar(chNext)) { styler.ColourTo(i, SCE_RB_HERE_DELIM); state = SCE_RB_DEFAULT; HereDoc.State = 0; preferRE = false; } // Otherwise we skipped through the here doc faster. } } else if (isEOLChar(chNext) && lookingAtHereDocDelim(styler, i - HereDoc.DelimiterLength + 1, lengthDoc, HereDoc.Delimiter)) { styler.ColourTo(i - HereDoc.DelimiterLength, state); styler.ColourTo(i, SCE_RB_HERE_DELIM); state = SCE_RB_DEFAULT; preferRE = false; HereDoc.State = 0; } } else if (state == SCE_RB_CLASS_VAR || state == SCE_RB_INSTANCE_VAR || state == SCE_RB_SYMBOL) { if (state == SCE_RB_SYMBOL && // FIDs suffices '?' and '!' (((ch == '!' || ch == '?') && chNext != '=') || // identifier suffix '=' (ch == '=' && (chNext != '~' && chNext != '>' && (chNext != '=' || chNext2 == '>'))))) { styler.ColourTo(i, state); state = SCE_RB_DEFAULT; preferRE = false; } else if (!isSafeWordcharOrHigh(ch)) { styler.ColourTo(i - 1, state); redo_char(i, ch, chNext, chNext2, state); // pass by ref preferRE = false; } } else if (state == SCE_RB_GLOBAL) { if (!isSafeWordcharOrHigh(ch)) { // handle special globals here as well if (chPrev == '$') { if (ch == '-') { // Include the next char, like $-a advance_char(i, ch, chNext, chNext2); } styler.ColourTo(i, state); state = SCE_RB_DEFAULT; } else { styler.ColourTo(i - 1, state); redo_char(i, ch, chNext, chNext2, state); // pass by ref } preferRE = false; } } else if (state == SCE_RB_POD) { // PODs end with ^=end\s, -- any whitespace can follow =end if (isWhiteSpace(ch) && i > 5 && isEOLChar(styler[i - 5]) && isMatch(styler, lengthDoc, i - 4, "=end")) { styler.ColourTo(i - 1, state); state = SCE_RB_DEFAULT; preferRE = false; } } else if (state == SCE_RB_REGEX || state == SCE_RB_STRING_QR) { if (ch == '\\' && Quote.Up != '\\') { // Skip one advance_char(i, ch, chNext, chNext2); } else if (ch == Quote.Down) { Quote.Count--; if (Quote.Count == 0) { // Include the options while (isSafeAlpha(chNext)) { i++; ch = chNext; chNext = styler.SafeGetCharAt(i + 1); } styler.ColourTo(i, state); state = SCE_RB_DEFAULT; preferRE = false; } } else if (ch == Quote.Up) { // Only if close quoter != open quoter Quote.Count++; } else if (ch == '#') { if (chNext == '{') { if (innerExpr.canEnter()) { // process #{ ... } styler.ColourTo(i - 1, state); styler.ColourTo(i + 1, SCE_RB_OPERATOR); innerExpr.enter(state, Quote); preferRE = true; // Skip one advance_char(i, ch, chNext, chNext2); } } else if (chNext == '@' || chNext == '$') { InterpolateVariable(styler, state, i, ch, chNext, chNext2); } else { //todo: distinguish comments from pound chars // for now, handle as comment styler.ColourTo(i - 1, state); bool inEscape = false; while (++i < lengthDoc) { ch = styler.SafeGetCharAt(i); if (ch == '\\') { inEscape = true; } else if (isEOLChar(ch)) { // Comment inside a regex styler.ColourTo(i - 1, SCE_RB_COMMENTLINE); break; } else if (inEscape) { inEscape = false; // don't look at char } else if (ch == Quote.Down) { // Have the regular handler deal with this // to get trailing modifiers. i--; ch = styler[i]; break; } } chNext = styler.SafeGetCharAt(i + 1); } } // Quotes of all kinds... } else if (isPercentLiteral(state) || state == SCE_RB_STRING || state == SCE_RB_CHARACTER || state == SCE_RB_BACKTICKS) { if (!Quote.Down && !isspacechar(ch)) { Quote.Open(ch); } else if (ch == '\\' && Quote.Up != '\\') { //Riddle me this: Is it safe to skip *every* escaped char? advance_char(i, ch, chNext, chNext2); } else if (ch == Quote.Down) { Quote.Count--; if (Quote.Count == 0) { styler.ColourTo(i, state); state = SCE_RB_DEFAULT; preferRE = false; } } else if (ch == Quote.Up) { Quote.Count++; } else if (ch == '#' && isInterpolableLiteral(state)) { if (chNext == '{') { if (innerExpr.canEnter()) { // process #{ ... } styler.ColourTo(i - 1, state); styler.ColourTo(i + 1, SCE_RB_OPERATOR); innerExpr.enter(state, Quote); preferRE = true; // Skip one advance_char(i, ch, chNext, chNext2); } } else if (chNext == '@' || chNext == '$') { InterpolateVariable(styler, state, i, ch, chNext, chNext2); } } } if (state == SCE_RB_ERROR) { break; } chPrev = ch; } if (state == SCE_RB_WORD) { // We've ended on a word, possibly at EOF, and need to // classify it. ClassifyWordRb(styler.GetStartSegment(), lengthDoc - 1, '\0', keywords, styler, prevWord); } else { styler.ColourTo(lengthDoc - 1, state); } } // Helper functions for folding, disambiguation keywords // Assert that there are no high-bit chars void getPrevWord(Sci_Position pos, char *prevWord, Accessor &styler, int word_state) { Sci_Position i; styler.Flush(); for (i = pos - 1; i > 0; i--) { if (actual_style(styler.StyleAt(i)) != word_state) { i++; break; } } if (i < pos - MAX_KEYWORD_LENGTH) // overflow i = pos - MAX_KEYWORD_LENGTH; char *dst = prevWord; for (; i <= pos; i++) { *dst++ = styler[i]; } *dst = 0; } bool keywordIsAmbiguous(const char *prevWord) noexcept { // Order from most likely used to least likely // Lots of ways to do a loop in Ruby besides 'while/until' if (!strcmp(prevWord, "if") || !strcmp(prevWord, "do") || !strcmp(prevWord, "while") || !strcmp(prevWord, "unless") || !strcmp(prevWord, "until") || !strcmp(prevWord, "for")) { return true; } else { return false; } } // Demote keywords in the following conditions: // if, while, unless, until modify a statement // do after a while or until, as a noise word (like then after if) bool keywordIsModifier(const char *word, Sci_Position pos, Accessor &styler) { if (word[0] == 'd' && word[1] == 'o' && !word[2]) { return keywordDoStartsLoop(pos, styler); } char ch; int style = SCE_RB_DEFAULT; Sci_Position lineStart = styler.GetLine(pos); Sci_Position lineStartPosn = styler.LineStart(lineStart); // We want to step backwards until we don't care about the current // position. But first move lineStartPosn back behind any // continuations immediately above word. while (lineStartPosn > 0) { ch = styler[lineStartPosn-1]; if (ch == '\n' || ch == '\r') { const char chPrev = styler.SafeGetCharAt(lineStartPosn-2); const char chPrev2 = styler.SafeGetCharAt(lineStartPosn-3); lineStart = styler.GetLine(lineStartPosn-1); // If we find a continuation line, include it in our analysis. if (chPrev == '\\') { lineStartPosn = styler.LineStart(lineStart); } else if (ch == '\n' && chPrev == '\r' && chPrev2 == '\\') { lineStartPosn = styler.LineStart(lineStart); } else { break; } } else { break; } } styler.Flush(); while (--pos >= lineStartPosn) { style = actual_style(styler.StyleAt(pos)); if (style == SCE_RB_DEFAULT) { ch = styler[pos]; if (IsASpaceOrTab(ch)) { //continue } else if (ch == '\r' || ch == '\n') { // Scintilla's LineStart() and GetLine() routines aren't // platform-independent, so if we have text prepared with // a different system we can't rely on it. // Also, lineStartPosn may have been moved to more than one // line above word's line while pushing past continuations. const char chPrev = styler.SafeGetCharAt(pos - 1); const char chPrev2 = styler.SafeGetCharAt(pos - 2); if (chPrev == '\\') { pos-=1; // gloss over the "\\" //continue } else if (ch == '\n' && chPrev == '\r' && chPrev2 == '\\') { pos-=2; // gloss over the "\\\r" //continue } else { return false; } } } else { break; } } if (pos < lineStartPosn) { return false; } // First things where the action is unambiguous switch (style) { case SCE_RB_DEFAULT: case SCE_RB_COMMENTLINE: case SCE_RB_POD: case SCE_RB_CLASSNAME: case SCE_RB_DEFNAME: case SCE_RB_MODULE_NAME: return false; case SCE_RB_OPERATOR: break; case SCE_RB_WORD: // Watch out for uses of 'else if' //XXX: Make a list of other keywords where 'if' isn't a modifier // and can appear legitimately // Formulate this to avoid warnings from most compilers if (strcmp(word, "if") == 0) { char prevWord[MAX_KEYWORD_LENGTH + 1]; getPrevWord(pos, prevWord, styler, SCE_RB_WORD); return strcmp(prevWord, "else") != 0; } return true; default: return true; } // Assume that if the keyword follows an operator, // usually it's a block assignment, like // a << if x then y else z ch = styler[pos]; switch (ch) { case ')': case ']': case '}': return true; default: return false; } } #define WHILE_BACKWARDS "elihw" #define UNTIL_BACKWARDS "litnu" #define FOR_BACKWARDS "rof" // Nothing fancy -- look to see if we follow a while/until somewhere // on the current line bool keywordDoStartsLoop(Sci_Position pos, Accessor &styler) { const Sci_Position lineStart = styler.GetLine(pos); const Sci_Position lineStartPosn = styler.LineStart(lineStart); styler.Flush(); while (--pos >= lineStartPosn) { const int style = actual_style(styler.StyleAt(pos)); if (style == SCE_RB_DEFAULT) { const char ch = styler[pos]; if (ch == '\r' || ch == '\n') { // Scintilla's LineStart() and GetLine() routines aren't // platform-independent, so if we have text prepared with // a different system we can't rely on it. return false; } } else if (style == SCE_RB_WORD) { // Check for while or until, but write the word in backwards char prevWord[MAX_KEYWORD_LENGTH + 1]; // 1 byte for zero char *dst = prevWord; int wordLen = 0; Sci_Position start_word; for (start_word = pos; start_word >= lineStartPosn && actual_style(styler.StyleAt(start_word)) == SCE_RB_WORD; start_word--) { if (++wordLen < MAX_KEYWORD_LENGTH) { *dst++ = styler[start_word]; } } *dst = 0; // Did we see our keyword? if (!strcmp(prevWord, WHILE_BACKWARDS) || !strcmp(prevWord, UNTIL_BACKWARDS) || !strcmp(prevWord, FOR_BACKWARDS)) { return true; } // We can move pos to the beginning of the keyword, and then // accept another decrement, as we can never have two contiguous // keywords: // word1 word2 // ^ // <- move to start_word // ^ // <- loop decrement // ^ # pointing to end of word1 is fine pos = start_word; } } return false; } bool IsCommentLine(Sci_Position line, Accessor &styler) { const Sci_Position pos = styler.LineStart(line); const Sci_Position eol_pos = styler.LineStart(line + 1) - 1; for (Sci_Position i = pos; i < eol_pos; i++) { const char ch = styler[i]; if (ch == '#') return true; else if (ch != ' ' && ch != '\t') return false; } return false; } /* * Folding Ruby * * The language is quite complex to analyze without a full parse. * For example, this line shouldn't affect fold level: * * print "hello" if feeling_friendly? * * Neither should this: * * print "hello" \ * if feeling_friendly? * * * But this should: * * if feeling_friendly? #++ * print "hello" \ * print "goodbye" * end #-- * * So we cheat, by actually looking at the existing indentation * levels for each line, and just echoing it back. Like Python. * Then if we get better at it, we'll take braces into consideration, * which always affect folding levels. * How the keywords should work: * No effect: * __FILE__ __LINE__ BEGIN END alias and * defined? false in nil not or self super then * true undef * Always increment: * begin class def do for module when { * * Always decrement: * end } * * Increment if these start a statement * if unless until while -- do nothing if they're modifiers * These end a block if there's no modifier, but don't bother * break next redo retry return yield * * These temporarily de-indent, but re-indent * case else elsif ensure rescue * * This means that the folder reflects indentation rather * than setting it. The language-service updates indentation * when users type return and finishes entering de-denters. * * Later offer to fold POD, here-docs, strings, and blocks of comments */ void FoldRbDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *[], Accessor &styler) { const bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; const bool foldComment = styler.GetPropertyInt("fold.comment") != 0; synchronizeDocStart(startPos, length, initStyle, styler, false); const Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelPrev = startPos == 0 ? 0 : (styler.LevelAt(lineCurrent) & SC_FOLDLEVELNUMBERMASK & ~SC_FOLDLEVELBASE); int levelCurrent = levelPrev; char chPrev = '\0'; char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); int stylePrev = startPos <= 1 ? SCE_RB_DEFAULT : styler.StyleAt(startPos - 1); // detect endless method definition to fix up code folding enum class MethodDefinition { None, Define, Operator, Name, Argument, }; MethodDefinition method_definition = MethodDefinition::None; int argument_paren_count = 0; bool heredocOpen = false; for (Sci_PositionU i = startPos; i < endPos; i++) { const char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); const int style = styleNext; styleNext = styler.StyleAt(i + 1); const bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); /*Mutiline comment patch*/ if (foldComment && atEOL && IsCommentLine(lineCurrent, styler)) { if (!IsCommentLine(lineCurrent - 1, styler) && IsCommentLine(lineCurrent + 1, styler)) levelCurrent++; else if (IsCommentLine(lineCurrent - 1, styler) && !IsCommentLine(lineCurrent + 1, styler)) levelCurrent--; } if (style == SCE_RB_COMMENTLINE) { if (foldComment && stylePrev != SCE_RB_COMMENTLINE) { if (chNext == '{') { levelCurrent++; } else if (chNext == '}' && levelCurrent > 0) { levelCurrent--; } } } else if (style == SCE_RB_OPERATOR) { if (AnyOf(ch, '[', '{', '(')) { levelCurrent++; } else if (AnyOf(ch, ']', '}', ')')) { // Don't decrement below 0 if (levelCurrent > 0) levelCurrent--; } } else if (style == SCE_RB_WORD && styleNext != SCE_RB_WORD) { // Look at the keyword on the left and decide what to do char prevWord[MAX_KEYWORD_LENGTH + 1]; // 1 byte for zero prevWord[0] = 0; getPrevWord(i, prevWord, styler, SCE_RB_WORD); if (!strcmp(prevWord, "end")) { // Don't decrement below 0 if (levelCurrent > 0) levelCurrent--; } else if (!strcmp(prevWord, "def")) { levelCurrent++; method_definition = MethodDefinition::Define; } else if (!strcmp(prevWord, "if") || !strcmp(prevWord, "class") || !strcmp(prevWord, "module") || !strcmp(prevWord, "begin") || !strcmp(prevWord, "case") || !strcmp(prevWord, "do") || !strcmp(prevWord, "while") || !strcmp(prevWord, "unless") || !strcmp(prevWord, "until") || !strcmp(prevWord, "for") ) { levelCurrent++; } } else if (style == SCE_RB_HERE_DELIM && !heredocOpen) { if (stylePrev == SCE_RB_OPERATOR && chPrev == '<' && styler.SafeGetCharAt(i - 2) == '<') { levelCurrent++; heredocOpen = true; } else if (styleNext != SCE_RB_HERE_DELIM) { levelCurrent--; } } else if (style == SCE_RB_STRING_QW || style == SCE_RB_STRING_W) { if (stylePrev != style) { levelCurrent++; } if (styleNext != style) { levelCurrent--; } } if (method_definition != MethodDefinition::None) { switch (method_definition) { case MethodDefinition::Define: if (style == SCE_RB_OPERATOR) { method_definition = MethodDefinition::Operator; } else if (style == SCE_RB_DEFNAME || style == SCE_RB_WORD_DEMOTED || style == SCE_RB_CLASSNAME || style == SCE_RB_IDENTIFIER) { method_definition = MethodDefinition::Name; } else if (!(style == SCE_RB_WORD || IsASpaceOrTab(ch))) { method_definition = MethodDefinition::None; } if (method_definition <= MethodDefinition::Define) { break; } // fall through for unary operator or single letter name [[fallthrough]]; case MethodDefinition::Operator: case MethodDefinition::Name: if (isEOLChar(chNext) || chNext == '#') { method_definition = MethodDefinition::None; } else if (chNext == '(' || chNext <= ' ') { // setter method cannot be defined in an endless method definition. if (ch == '=' && (method_definition == MethodDefinition::Name || chPrev == ']')) { method_definition = MethodDefinition::None; } else { method_definition = MethodDefinition::Argument; argument_paren_count = 0; } } break; case MethodDefinition::Argument: if (style == SCE_RB_OPERATOR) { if (ch == '(') { ++argument_paren_count; } else if (ch == ')') { --argument_paren_count; } else if (argument_paren_count == 0) { method_definition = MethodDefinition::None; if (ch == '=' && levelCurrent > 0) { levelCurrent--; } } } else if (argument_paren_count == 0 && !IsASpaceOrTab(ch)) { // '=' must be first character after method name or right parenthesis method_definition = MethodDefinition::None; } break; default: break; } } if (atEOL || (i == endPos - 1)) { int lev = levelPrev; if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if ((levelCurrent > levelPrev) && (visibleChars > 0)) lev |= SC_FOLDLEVELHEADERFLAG; styler.SetLevel(lineCurrent, lev|SC_FOLDLEVELBASE); lineCurrent++; levelPrev = levelCurrent; visibleChars = 0; method_definition = MethodDefinition::None; argument_paren_count = 0; heredocOpen = false; } else if (!isspacechar(ch)) { visibleChars++; } chPrev = ch; stylePrev = style; } } const char *const rubyWordListDesc[] = { "Keywords", nullptr }; } LexerModule lmRuby(SCLEX_RUBY, ColouriseRbDoc, "ruby", FoldRbDoc, rubyWordListDesc); lexilla/lexers/LexPO.cxx0000664000175000017500000001500414647367374014214 0ustar neilneil// Scintilla source code edit control /** @file LexPO.cxx ** Lexer for GetText Translation (PO) files. **/ // Copyright 2012 by Colomban Wendling // The License.txt file describes the conditions under which this software may be distributed. // see https://www.gnu.org/software/gettext/manual/gettext.html#PO-Files for the syntax reference // some details are taken from the GNU msgfmt behavior (like that indent is allows in front of lines) // TODO: // * add keywords for flags (fuzzy, c-format, ...) // * highlight formats inside c-format strings (%s, %d, etc.) // * style for previous untranslated string? ("#|" comment) #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static void ColourisePODoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *[], Accessor &styler) { StyleContext sc(startPos, length, initStyle, styler); bool escaped = false; Sci_Position curLine = styler.GetLine(startPos); // the line state holds the last state on or before the line that isn't the default style int curLineState = curLine > 0 ? styler.GetLineState(curLine - 1) : SCE_PO_DEFAULT; for (; sc.More(); sc.Forward()) { // whether we should leave a state switch (sc.state) { case SCE_PO_COMMENT: case SCE_PO_PROGRAMMER_COMMENT: case SCE_PO_REFERENCE: case SCE_PO_FLAGS: case SCE_PO_FUZZY: if (sc.atLineEnd) sc.SetState(SCE_PO_DEFAULT); else if (sc.state == SCE_PO_FLAGS && sc.Match("fuzzy")) // here we behave like the previous parser, but this should probably be highlighted // on its own like a keyword rather than changing the whole flags style sc.ChangeState(SCE_PO_FUZZY); break; case SCE_PO_MSGCTXT: case SCE_PO_MSGID: case SCE_PO_MSGSTR: if (isspacechar(sc.ch)) sc.SetState(SCE_PO_DEFAULT); break; case SCE_PO_ERROR: if (sc.atLineEnd) sc.SetState(SCE_PO_DEFAULT); break; case SCE_PO_MSGCTXT_TEXT: case SCE_PO_MSGID_TEXT: case SCE_PO_MSGSTR_TEXT: if (sc.atLineEnd) { // invalid inside a string if (sc.state == SCE_PO_MSGCTXT_TEXT) sc.ChangeState(SCE_PO_MSGCTXT_TEXT_EOL); else if (sc.state == SCE_PO_MSGID_TEXT) sc.ChangeState(SCE_PO_MSGID_TEXT_EOL); else if (sc.state == SCE_PO_MSGSTR_TEXT) sc.ChangeState(SCE_PO_MSGSTR_TEXT_EOL); sc.SetState(SCE_PO_DEFAULT); escaped = false; } else { if (escaped) escaped = false; else if (sc.ch == '\\') escaped = true; else if (sc.ch == '"') sc.ForwardSetState(SCE_PO_DEFAULT); } break; } // whether we should enter a new state if (sc.state == SCE_PO_DEFAULT) { // forward to the first non-white character on the line bool atLineStart = sc.atLineStart; if (atLineStart) { // reset line state if it is set to comment state so empty lines don't get // comment line state, and the folding code folds comments separately, // and anyway the styling don't use line state for comments if (curLineState == SCE_PO_COMMENT) curLineState = SCE_PO_DEFAULT; while (sc.More() && ! sc.atLineEnd && isspacechar(sc.ch)) sc.Forward(); } if (atLineStart && sc.ch == '#') { if (sc.chNext == '.') sc.SetState(SCE_PO_PROGRAMMER_COMMENT); else if (sc.chNext == ':') sc.SetState(SCE_PO_REFERENCE); else if (sc.chNext == ',') sc.SetState(SCE_PO_FLAGS); else sc.SetState(SCE_PO_COMMENT); } else if (atLineStart && sc.Match("msgid")) { // includes msgid_plural sc.SetState(SCE_PO_MSGID); } else if (atLineStart && sc.Match("msgstr")) { // includes [] suffixes sc.SetState(SCE_PO_MSGSTR); } else if (atLineStart && sc.Match("msgctxt")) { sc.SetState(SCE_PO_MSGCTXT); } else if (sc.ch == '"') { if (curLineState == SCE_PO_MSGCTXT || curLineState == SCE_PO_MSGCTXT_TEXT) sc.SetState(SCE_PO_MSGCTXT_TEXT); else if (curLineState == SCE_PO_MSGID || curLineState == SCE_PO_MSGID_TEXT) sc.SetState(SCE_PO_MSGID_TEXT); else if (curLineState == SCE_PO_MSGSTR || curLineState == SCE_PO_MSGSTR_TEXT) sc.SetState(SCE_PO_MSGSTR_TEXT); else sc.SetState(SCE_PO_ERROR); } else if (! isspacechar(sc.ch)) sc.SetState(SCE_PO_ERROR); if (sc.state != SCE_PO_DEFAULT) curLineState = sc.state; } if (sc.atLineEnd) { // Update the line state, so it can be seen by next line curLine = styler.GetLine(sc.currentPos); styler.SetLineState(curLine, curLineState); } } sc.Complete(); } static int FindNextNonEmptyLineState(Sci_PositionU startPos, Accessor &styler) { Sci_PositionU length = styler.Length(); for (Sci_PositionU i = startPos; i < length; i++) { if (! isspacechar(styler[i])) { return styler.GetLineState(styler.GetLine(i)); } } return 0; } static void FoldPODoc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { if (! styler.GetPropertyInt("fold")) return; bool foldCompact = styler.GetPropertyInt("fold.compact") != 0; bool foldComment = styler.GetPropertyInt("fold.comment") != 0; Sci_PositionU endPos = startPos + length; Sci_Position curLine = styler.GetLine(startPos); int lineState = styler.GetLineState(curLine); int nextLineState; int level = styler.LevelAt(curLine) & SC_FOLDLEVELNUMBERMASK; int nextLevel; int visible = 0; int chNext = styler[startPos]; for (Sci_PositionU i = startPos; i < endPos; i++) { int ch = chNext; chNext = styler.SafeGetCharAt(i+1); if (! isspacechar(ch)) { visible++; } else if ((ch == '\r' && chNext != '\n') || ch == '\n' || i+1 >= endPos) { int lvl = level; Sci_Position nextLine = curLine + 1; nextLineState = styler.GetLineState(nextLine); if ((lineState != SCE_PO_COMMENT || foldComment) && nextLineState == lineState && FindNextNonEmptyLineState(i, styler) == lineState) nextLevel = SC_FOLDLEVELBASE + 1; else nextLevel = SC_FOLDLEVELBASE; if (nextLevel > level) lvl |= SC_FOLDLEVELHEADERFLAG; if (visible == 0 && foldCompact) lvl |= SC_FOLDLEVELWHITEFLAG; styler.SetLevel(curLine, lvl); lineState = nextLineState; curLine = nextLine; level = nextLevel; visible = 0; } } } static const char *const poWordListDesc[] = { 0 }; LexerModule lmPO(SCLEX_PO, ColourisePODoc, "po", FoldPODoc, poWordListDesc); lexilla/lexers/LexVerilog.cxx0000664000175000017500000010606514647367374015315 0ustar neilneil// Scintilla source code edit control /** @file LexVerilog.cxx ** Lexer for Verilog. ** Written by Avi Yegudin, based on C++ lexer by Neil Hodgson **/ // Copyright 1998-2002 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" #include "OptionSet.h" #include "SubStyles.h" #include "DefaultLexer.h" using namespace Scintilla; using namespace Lexilla; namespace { // Use an unnamed namespace to protect the functions and classes from name conflicts struct PPDefinition { Sci_Position line; std::string key; std::string value; bool isUndef; std::string arguments; PPDefinition(Sci_Position line_, const std::string &key_, const std::string &value_, bool isUndef_ = false, const std::string &arguments_ = "") : line(line_), key(key_), value(value_), isUndef(isUndef_), arguments(arguments_) { } }; class LinePPState { int state; int ifTaken; int level; bool ValidLevel() const { return level >= 0 && level < 32; } int maskLevel() const { if (level >= 0) { return 1 << level; } else { return 1; } } public: LinePPState() : state(0), ifTaken(0), level(-1) { } bool IsInactive() const { return state != 0; } bool CurrentIfTaken() const { return (ifTaken & maskLevel()) != 0; } void StartSection(bool on) { level++; if (ValidLevel()) { if (on) { state &= ~maskLevel(); ifTaken |= maskLevel(); } else { state |= maskLevel(); ifTaken &= ~maskLevel(); } } } void EndSection() { if (ValidLevel()) { state &= ~maskLevel(); ifTaken &= ~maskLevel(); } level--; } void InvertCurrentLevel() { if (ValidLevel()) { state ^= maskLevel(); ifTaken |= maskLevel(); } } }; // Hold the preprocessor state for each line seen. // Currently one entry per line but could become sparse with just one entry per preprocessor line. class PPStates { std::vector vlls; public: LinePPState ForLine(Sci_Position line) const { if ((line > 0) && (vlls.size() > static_cast(line))) { return vlls[line]; } else { return LinePPState(); } } void Add(Sci_Position line, LinePPState lls) { vlls.resize(line+1); vlls[line] = lls; } }; // Options used for LexerVerilog struct OptionsVerilog { bool foldComment; bool foldPreprocessor; bool foldPreprocessorElse; bool foldCompact; bool foldAtElse; bool foldAtModule; bool trackPreprocessor; bool updatePreprocessor; bool portStyling; bool allUppercaseDocKeyword; OptionsVerilog() { foldComment = false; foldPreprocessor = false; foldPreprocessorElse = false; foldCompact = false; foldAtElse = false; foldAtModule = false; // for backwards compatibility, preprocessor functionality is disabled by default trackPreprocessor = false; updatePreprocessor = false; // for backwards compatibility, treat input/output/inout as regular keywords portStyling = false; // for backwards compatibility, don't treat all uppercase identifiers as documentation keywords allUppercaseDocKeyword = false; } }; struct OptionSetVerilog : public OptionSet { OptionSetVerilog() { DefineProperty("fold.comment", &OptionsVerilog::foldComment, "This option enables folding multi-line comments when using the Verilog lexer."); DefineProperty("fold.preprocessor", &OptionsVerilog::foldPreprocessor, "This option enables folding preprocessor directives when using the Verilog lexer."); DefineProperty("fold.compact", &OptionsVerilog::foldCompact); DefineProperty("fold.at.else", &OptionsVerilog::foldAtElse, "This option enables folding on the else line of an if statement."); DefineProperty("fold.verilog.flags", &OptionsVerilog::foldAtModule, "This option enables folding module definitions. Typically source files " "contain only one module definition so this option is somewhat useless."); DefineProperty("lexer.verilog.track.preprocessor", &OptionsVerilog::trackPreprocessor, "Set to 1 to interpret `if/`else/`endif to grey out code that is not active."); DefineProperty("lexer.verilog.update.preprocessor", &OptionsVerilog::updatePreprocessor, "Set to 1 to update preprocessor definitions when `define, `undef, or `undefineall found."); DefineProperty("lexer.verilog.portstyling", &OptionsVerilog::portStyling, "Set to 1 to style input, output, and inout ports differently from regular keywords."); DefineProperty("lexer.verilog.allupperkeywords", &OptionsVerilog::allUppercaseDocKeyword, "Set to 1 to style identifiers that are all uppercase as documentation keyword."); DefineProperty("lexer.verilog.fold.preprocessor.else", &OptionsVerilog::foldPreprocessorElse, "This option enables folding on `else and `elsif preprocessor directives."); } }; const char styleSubable[] = {0}; } class LexerVerilog : public DefaultLexer { CharacterSet setWord; WordList keywords; WordList keywords2; WordList keywords3; WordList keywords4; WordList keywords5; WordList ppDefinitions; PPStates vlls; std::vector ppDefineHistory; struct SymbolValue { std::string value; std::string arguments; SymbolValue(const std::string &value_="", const std::string &arguments_="") : value(value_), arguments(arguments_) { } SymbolValue &operator = (const std::string &value_) { value = value_; arguments.clear(); return *this; } bool IsMacro() const { return !arguments.empty(); } }; typedef std::map SymbolTable; SymbolTable preprocessorDefinitionsStart; OptionsVerilog options; OptionSetVerilog osVerilog; enum { activeFlag = 0x40 }; SubStyles subStyles; // states at end of line (EOL) during fold operations: // foldExternFlag: EOL while parsing an extern function/task declaration terminated by ';' // foldWaitDisableFlag: EOL while parsing wait or disable statement, terminated by "fork" or '(' // typdefFlag: EOL while parsing typedef statement, terminated by ';' enum {foldExternFlag = 0x01, foldWaitDisableFlag = 0x02, typedefFlag = 0x04, protectedFlag = 0x08}; // map using line number as key to store fold state information std::map foldState; public: LexerVerilog() : DefaultLexer("verilog", SCLEX_VERILOG), setWord(CharacterSet::setAlphaNum, "._", 0x80, true), subStyles(styleSubable, 0x80, 0x40, activeFlag) { } virtual ~LexerVerilog() {} int SCI_METHOD Version() const override { return lvRelease5; } void SCI_METHOD Release() override { delete this; } const char* SCI_METHOD PropertyNames() override { return osVerilog.PropertyNames(); } int SCI_METHOD PropertyType(const char* name) override { return osVerilog.PropertyType(name); } const char* SCI_METHOD DescribeProperty(const char* name) override { return osVerilog.DescribeProperty(name); } Sci_Position SCI_METHOD PropertySet(const char* key, const char* val) override { return osVerilog.PropertySet(&options, key, val); } const char * SCI_METHOD PropertyGet(const char *key) override { return osVerilog.PropertyGet(key); } const char* SCI_METHOD DescribeWordListSets() override { return osVerilog.DescribeWordListSets(); } Sci_Position SCI_METHOD WordListSet(int n, const char* wl) override; void SCI_METHOD Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void SCI_METHOD Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void* SCI_METHOD PrivateCall(int, void*) override { return 0; } int SCI_METHOD LineEndTypesSupported() override { return SC_LINE_END_TYPE_UNICODE; } int SCI_METHOD AllocateSubStyles(int styleBase, int numberStyles) override { return subStyles.Allocate(styleBase, numberStyles); } int SCI_METHOD SubStylesStart(int styleBase) override { return subStyles.Start(styleBase); } int SCI_METHOD SubStylesLength(int styleBase) override { return subStyles.Length(styleBase); } int SCI_METHOD StyleFromSubStyle(int subStyle) override { int styleBase = subStyles.BaseStyle(MaskActive(subStyle)); int active = subStyle & activeFlag; return styleBase | active; } int SCI_METHOD PrimaryStyleFromStyle(int style) override { return MaskActive(style); } void SCI_METHOD FreeSubStyles() override { subStyles.Free(); } void SCI_METHOD SetIdentifiers(int style, const char *identifiers) override { subStyles.SetIdentifiers(style, identifiers); } int SCI_METHOD DistanceToSecondaryStyles() override { return activeFlag; } const char * SCI_METHOD GetSubStyleBases() override { return styleSubable; } static ILexer5* LexerFactoryVerilog() { return new LexerVerilog(); } static int MaskActive(int style) { return style & ~activeFlag; } std::vector Tokenize(const std::string &expr) const; }; Sci_Position SCI_METHOD LexerVerilog::WordListSet(int n, const char *wl) { WordList *wordListN = 0; switch (n) { case 0: wordListN = &keywords; break; case 1: wordListN = &keywords2; break; case 2: wordListN = &keywords3; break; case 3: wordListN = &keywords4; break; case 4: wordListN = &keywords5; break; case 5: wordListN = &ppDefinitions; break; } Sci_Position firstModification = -1; if (wordListN) { WordList wlNew; wlNew.Set(wl); if (*wordListN != wlNew) { wordListN->Set(wl); firstModification = 0; if (n == 5) { // Rebuild preprocessorDefinitions preprocessorDefinitionsStart.clear(); for (int nDefinition = 0; nDefinition < ppDefinitions.Length(); nDefinition++) { const char *cpDefinition = ppDefinitions.WordAt(nDefinition); const char *cpEquals = strchr(cpDefinition, '='); if (cpEquals) { std::string name(cpDefinition, cpEquals - cpDefinition); std::string val(cpEquals+1); size_t bracket = name.find('('); size_t bracketEnd = name.find(')'); if ((bracket != std::string::npos) && (bracketEnd != std::string::npos)) { // Macro std::string args = name.substr(bracket + 1, bracketEnd - bracket - 1); name = name.substr(0, bracket); preprocessorDefinitionsStart[name] = SymbolValue(val, args); } else { preprocessorDefinitionsStart[name] = val; } } else { std::string name(cpDefinition); std::string val("1"); preprocessorDefinitionsStart[name] = val; } } } } } return firstModification; } static inline bool IsAWordChar(const int ch) { return (ch < 0x80) && (isalnum(ch) || ch == '_' || ch == '\''|| ch == '$'); } static inline bool IsAWordStart(const int ch) { return (ch < 0x80) && (isalnum(ch) || ch == '_' || ch == '$'); } static inline bool AllUpperCase(const char *a) { while (*a) { if (*a >= 'a' && *a <= 'z') return false; a++; } return true; } // Functor used to truncate history struct After { Sci_Position line; explicit After(Sci_Position line_) : line(line_) {} bool operator()(PPDefinition &p) const { return p.line > line; } }; static std::string GetRestOfLine(LexAccessor &styler, Sci_Position start, bool allowSpace) { std::string restOfLine; Sci_Position i =0; char ch = styler.SafeGetCharAt(start, '\n'); Sci_Position endLine = styler.LineEnd(styler.GetLine(start)); while (((start+i) < endLine) && (ch != '\r')) { char chNext = styler.SafeGetCharAt(start + i + 1, '\n'); if (ch == '/' && (chNext == '/' || chNext == '*')) break; if (allowSpace || (ch != ' ')) restOfLine += ch; i++; ch = chNext; } return restOfLine; } static bool IsSpaceOrTab(int ch) { return ch == ' ' || ch == '\t'; } void SCI_METHOD LexerVerilog::Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { LexAccessor styler(pAccess); const int kwOther=0, kwDot=0x100, kwInput=0x200, kwOutput=0x300, kwInout=0x400, kwProtected=0x800; int lineState = kwOther; bool continuationLine = false; Sci_Position curLine = styler.GetLine(startPos); if (curLine > 0) lineState = styler.GetLineState(curLine - 1); // Do not leak onto next line if (initStyle == SCE_V_STRINGEOL) initStyle = SCE_V_DEFAULT; if ((MaskActive(initStyle) == SCE_V_PREPROCESSOR) || (MaskActive(initStyle) == SCE_V_COMMENTLINE) || (MaskActive(initStyle) == SCE_V_COMMENTLINEBANG)) { // Set continuationLine if last character of previous line is '\' if (curLine > 0) { Sci_Position endLinePrevious = styler.LineEnd(curLine - 1); if (endLinePrevious > 0) { continuationLine = styler.SafeGetCharAt(endLinePrevious-1) == '\\'; } } } StyleContext sc(startPos, length, initStyle, styler); LinePPState preproc = vlls.ForLine(curLine); bool definitionsChanged = false; // Truncate ppDefineHistory before current line if (!options.updatePreprocessor) ppDefineHistory.clear(); std::vector::iterator itInvalid = std::find_if(ppDefineHistory.begin(), ppDefineHistory.end(), After(curLine-1)); if (itInvalid != ppDefineHistory.end()) { ppDefineHistory.erase(itInvalid, ppDefineHistory.end()); definitionsChanged = true; } SymbolTable preprocessorDefinitions = preprocessorDefinitionsStart; for (std::vector::iterator itDef = ppDefineHistory.begin(); itDef != ppDefineHistory.end(); ++itDef) { if (itDef->isUndef) preprocessorDefinitions.erase(itDef->key); else preprocessorDefinitions[itDef->key] = SymbolValue(itDef->value, itDef->arguments); } int activitySet = preproc.IsInactive() ? activeFlag : 0; Sci_Position lineEndNext = styler.LineEnd(curLine); bool isEscapedId = false; // true when parsing an escaped Identifier bool isProtected = (lineState&kwProtected) != 0; // true when parsing a protected region for (; sc.More(); sc.Forward()) { if (sc.atLineStart) { if (sc.state == SCE_V_STRING) { // Prevent SCE_V_STRINGEOL from leaking back to previous line sc.SetState(SCE_V_STRING); } if ((MaskActive(sc.state) == SCE_V_PREPROCESSOR) && (!continuationLine)) { sc.SetState(SCE_V_DEFAULT|activitySet); } if (preproc.IsInactive()) { activitySet = activeFlag; sc.SetState(sc.state | activitySet); } } if (sc.MatchLineEnd()) { curLine++; lineEndNext = styler.LineEnd(curLine); vlls.Add(curLine, preproc); // Update the line state, so it can be seen by next line styler.SetLineState(curLine, lineState); isEscapedId = false; // EOL terminates an escaped Identifier } // Handle line continuation generically. if (sc.ch == '\\') { if (static_cast((sc.currentPos+1)) >= lineEndNext) { curLine++; lineEndNext = styler.LineEnd(curLine); vlls.Add(curLine, preproc); // Update the line state, so it can be seen by next line styler.SetLineState(curLine, lineState); sc.Forward(); if (sc.ch == '\r' && sc.chNext == '\n') { // Even in UTF-8, \r and \n are separate sc.Forward(); } continuationLine = true; sc.Forward(); continue; } } // for comment keyword if (MaskActive(sc.state) == SCE_V_COMMENT_WORD && !IsAWordChar(sc.ch)) { char s[100]; int state = lineState & 0xff; sc.GetCurrent(s, sizeof(s)); if (keywords5.InList(s)) { sc.ChangeState(SCE_V_COMMENT_WORD|activitySet); } else { sc.ChangeState(state|activitySet); } sc.SetState(state|activitySet); } const bool atLineEndBeforeSwitch = sc.MatchLineEnd(); // Determine if the current state should terminate. switch (MaskActive(sc.state)) { case SCE_V_OPERATOR: sc.SetState(SCE_V_DEFAULT|activitySet); break; case SCE_V_NUMBER: if (!(IsAWordChar(sc.ch) || (sc.ch == '?'))) { sc.SetState(SCE_V_DEFAULT|activitySet); } break; case SCE_V_IDENTIFIER: if (!isEscapedId &&(!IsAWordChar(sc.ch) || (sc.ch == '.'))) { char s[100]; lineState &= 0xff00; sc.GetCurrent(s, sizeof(s)); if (options.portStyling && (strcmp(s, "input") == 0)) { lineState = kwInput; sc.ChangeState(SCE_V_INPUT|activitySet); } else if (options.portStyling && (strcmp(s, "output") == 0)) { lineState = kwOutput; sc.ChangeState(SCE_V_OUTPUT|activitySet); } else if (options.portStyling && (strcmp(s, "inout") == 0)) { lineState = kwInout; sc.ChangeState(SCE_V_INOUT|activitySet); } else if (lineState == kwInput) { sc.ChangeState(SCE_V_INPUT|activitySet); } else if (lineState == kwOutput) { sc.ChangeState(SCE_V_OUTPUT|activitySet); } else if (lineState == kwInout) { sc.ChangeState(SCE_V_INOUT|activitySet); } else if (lineState == kwDot) { lineState = kwOther; if (options.portStyling) sc.ChangeState(SCE_V_PORT_CONNECT|activitySet); } else if (keywords.InList(s)) { sc.ChangeState(SCE_V_WORD|activitySet); } else if (keywords2.InList(s)) { sc.ChangeState(SCE_V_WORD2|activitySet); } else if (keywords3.InList(s)) { sc.ChangeState(SCE_V_WORD3|activitySet); } else if (keywords4.InList(s)) { sc.ChangeState(SCE_V_USER|activitySet); } else if (options.allUppercaseDocKeyword && AllUpperCase(s)) { sc.ChangeState(SCE_V_USER|activitySet); } sc.SetState(SCE_V_DEFAULT|activitySet); } break; case SCE_V_PREPROCESSOR: if (!IsAWordChar(sc.ch) || sc.MatchLineEnd()) { sc.SetState(SCE_V_DEFAULT|activitySet); } break; case SCE_V_COMMENT: if (sc.Match('*', '/')) { sc.Forward(); sc.ForwardSetState(SCE_V_DEFAULT|activitySet); } else if (IsAWordStart(sc.ch)) { lineState = sc.state | (lineState & 0xff00); sc.SetState(SCE_V_COMMENT_WORD|activitySet); } break; case SCE_V_COMMENTLINE: case SCE_V_COMMENTLINEBANG: if (sc.atLineStart) { sc.SetState(SCE_V_DEFAULT|activitySet); } else if (IsAWordStart(sc.ch)) { lineState = sc.state | (lineState & 0xff00); sc.SetState(SCE_V_COMMENT_WORD|activitySet); } break; case SCE_V_STRING: if (sc.ch == '\\') { if (sc.chNext == '\"' || sc.chNext == '\'' || sc.chNext == '\\') { sc.Forward(); } } else if (sc.ch == '\"') { sc.ForwardSetState(SCE_V_DEFAULT|activitySet); } else if (sc.MatchLineEnd()) { sc.ChangeState(SCE_V_STRINGEOL|activitySet); if (sc.Match('\r', '\n')) sc.Forward(); sc.ForwardSetState(SCE_V_DEFAULT|activitySet); } break; } if (sc.MatchLineEnd() && !atLineEndBeforeSwitch) { // State exit processing consumed characters up to end of line. curLine++; lineEndNext = styler.LineEnd(curLine); vlls.Add(curLine, preproc); // Update the line state, so it can be seen by next line styler.SetLineState(curLine, lineState); isEscapedId = false; // EOL terminates an escaped Identifier } // Determine if a new state should be entered. if (MaskActive(sc.state) == SCE_V_DEFAULT) { if (sc.ch == '`') { sc.SetState(SCE_V_PREPROCESSOR|activitySet); // Skip whitespace between ` and preprocessor word do { sc.Forward(); } while ((sc.ch == ' ' || sc.ch == '\t') && sc.More()); if (sc.MatchLineEnd()) { sc.SetState(SCE_V_DEFAULT|activitySet); styler.SetLineState(curLine, lineState); } else { if (sc.Match("protected")) { isProtected = true; lineState |= kwProtected; styler.SetLineState(curLine, lineState); } else if (sc.Match("endprotected")) { isProtected = false; lineState &= ~kwProtected; styler.SetLineState(curLine, lineState); } else if (!isProtected && options.trackPreprocessor) { if (sc.Match("ifdef") || sc.Match("ifndef")) { bool isIfDef = sc.Match("ifdef"); int i = isIfDef ? 5 : 6; std::string restOfLine = GetRestOfLine(styler, sc.currentPos + i + 1, false); bool foundDef = preprocessorDefinitions.find(restOfLine) != preprocessorDefinitions.end(); preproc.StartSection(isIfDef == foundDef); } else if (sc.Match("else")) { if (!preproc.CurrentIfTaken()) { preproc.InvertCurrentLevel(); activitySet = preproc.IsInactive() ? activeFlag : 0; if (!activitySet) { sc.ChangeState(SCE_V_PREPROCESSOR|activitySet); } } else if (!preproc.IsInactive()) { preproc.InvertCurrentLevel(); activitySet = preproc.IsInactive() ? activeFlag : 0; if (!activitySet) { sc.ChangeState(SCE_V_PREPROCESSOR|activitySet); } } } else if (sc.Match("elsif")) { // Ensure only one chosen out of `if .. `elsif .. `elsif .. `else .. `endif if (!preproc.CurrentIfTaken()) { // Similar to `ifdef std::string restOfLine = GetRestOfLine(styler, sc.currentPos + 6, true); bool ifGood = preprocessorDefinitions.find(restOfLine) != preprocessorDefinitions.end(); if (ifGood) { preproc.InvertCurrentLevel(); activitySet = preproc.IsInactive() ? activeFlag : 0; if (!activitySet) sc.ChangeState(SCE_V_PREPROCESSOR|activitySet); } } else if (!preproc.IsInactive()) { preproc.InvertCurrentLevel(); activitySet = preproc.IsInactive() ? activeFlag : 0; if (!activitySet) sc.ChangeState(SCE_V_PREPROCESSOR|activitySet); } } else if (sc.Match("endif")) { preproc.EndSection(); activitySet = preproc.IsInactive() ? activeFlag : 0; sc.ChangeState(SCE_V_PREPROCESSOR|activitySet); } else if (sc.Match("define")) { if (options.updatePreprocessor && !preproc.IsInactive()) { std::string restOfLine = GetRestOfLine(styler, sc.currentPos + 6, true); size_t startName = 0; while ((startName < restOfLine.length()) && IsSpaceOrTab(restOfLine[startName])) startName++; size_t endName = startName; while ((endName < restOfLine.length()) && setWord.Contains(static_cast(restOfLine[endName]))) endName++; std::string key = restOfLine.substr(startName, endName-startName); if ((endName < restOfLine.length()) && (restOfLine.at(endName) == '(')) { // Macro size_t endArgs = endName; while ((endArgs < restOfLine.length()) && (restOfLine[endArgs] != ')')) endArgs++; std::string args = restOfLine.substr(endName + 1, endArgs - endName - 1); size_t startValue = endArgs+1; while ((startValue < restOfLine.length()) && IsSpaceOrTab(restOfLine[startValue])) startValue++; std::string value; if (startValue < restOfLine.length()) value = restOfLine.substr(startValue); preprocessorDefinitions[key] = SymbolValue(value, args); ppDefineHistory.push_back(PPDefinition(curLine, key, value, false, args)); definitionsChanged = true; } else { // Value size_t startValue = endName; while ((startValue < restOfLine.length()) && IsSpaceOrTab(restOfLine[startValue])) startValue++; std::string value = restOfLine.substr(startValue); preprocessorDefinitions[key] = value; ppDefineHistory.push_back(PPDefinition(curLine, key, value)); definitionsChanged = true; } } } else if (sc.Match("undefineall")) { if (options.updatePreprocessor && !preproc.IsInactive()) { // remove all preprocessor definitions std::map::iterator itDef; for(itDef = preprocessorDefinitions.begin(); itDef != preprocessorDefinitions.end(); ++itDef) { ppDefineHistory.push_back(PPDefinition(curLine, itDef->first, "", true)); } preprocessorDefinitions.clear(); definitionsChanged = true; } } else if (sc.Match("undef")) { if (options.updatePreprocessor && !preproc.IsInactive()) { std::string restOfLine = GetRestOfLine(styler, sc.currentPos + 5, true); std::vector tokens = Tokenize(restOfLine); std::string key; if (tokens.size() >= 1) { key = tokens[0]; preprocessorDefinitions.erase(key); ppDefineHistory.push_back(PPDefinition(curLine, key, "", true)); definitionsChanged = true; } } } } } } else if (!isProtected) { if (IsADigit(sc.ch) || (sc.ch == '\'') || (sc.ch == '.' && IsADigit(sc.chNext))) { sc.SetState(SCE_V_NUMBER|activitySet); } else if (IsAWordStart(sc.ch)) { sc.SetState(SCE_V_IDENTIFIER|activitySet); } else if (sc.Match('/', '*')) { sc.SetState(SCE_V_COMMENT|activitySet); sc.Forward(); // Eat the * so it isn't used for the end of the comment } else if (sc.Match('/', '/')) { if (sc.Match("//!")) // Nice to have a different comment style sc.SetState(SCE_V_COMMENTLINEBANG|activitySet); else sc.SetState(SCE_V_COMMENTLINE|activitySet); } else if (sc.ch == '\"') { sc.SetState(SCE_V_STRING|activitySet); } else if (sc.ch == '\\') { // escaped identifier, everything is ok up to whitespace isEscapedId = true; sc.SetState(SCE_V_IDENTIFIER|activitySet); } else if (isoperator(static_cast(sc.ch)) || sc.ch == '@' || sc.ch == '#') { sc.SetState(SCE_V_OPERATOR|activitySet); if (sc.ch == '.') lineState = kwDot; if (sc.ch == ';') lineState = kwOther; } } } if (isEscapedId && isspacechar(sc.ch)) { isEscapedId = false; } } if (definitionsChanged) { styler.ChangeLexerState(startPos, startPos + length); } sc.Complete(); } static bool IsStreamCommentStyle(int style) { return style == SCE_V_COMMENT; } static bool IsCommentLine(Sci_Position line, LexAccessor &styler) { Sci_Position pos = styler.LineStart(line); Sci_Position eolPos = styler.LineStart(line + 1) - 1; for (Sci_Position i = pos; i < eolPos; i++) { char ch = styler[i]; char chNext = styler.SafeGetCharAt(i + 1); int style = styler.StyleAt(i); if (ch == '/' && chNext == '/' && (style == SCE_V_COMMENTLINE || style == SCE_V_COMMENTLINEBANG)) { return true; } else if (!IsASpaceOrTab(ch)) { return false; } } return false; } // Store both the current line's fold level and the next lines in the // level store to make it easy to pick up with each increment // and to make it possible to fiddle the current level for "} else {". void SCI_METHOD LexerVerilog::Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { LexAccessor styler(pAccess); bool foldAtBrace = 1; bool foldAtParenthese = 1; Sci_Position lineCurrent = styler.GetLine(startPos); // Move back one line to be compatible with LexerModule::Fold behavior, fixes problem with foldComment behavior if (lineCurrent > 0) { lineCurrent--; Sci_Position newStartPos = styler.LineStart(lineCurrent); length += startPos - newStartPos; startPos = newStartPos; initStyle = 0; if (startPos > 0) { initStyle = styler.StyleAt(startPos - 1); } } Sci_PositionU endPos = startPos + length; int visibleChars = 0; int levelCurrent = SC_FOLDLEVELBASE; if (lineCurrent > 0) levelCurrent = styler.LevelAt(lineCurrent-1) >> 16; int levelMinCurrent = levelCurrent; int levelNext = levelCurrent; char chNext = styler[startPos]; int styleNext = MaskActive(styler.StyleAt(startPos)); int style = MaskActive(initStyle); // restore fold state (if it exists) for prior line int stateCurrent = 0; std::map::iterator foldStateIterator = foldState.find(lineCurrent-1); if (foldStateIterator != foldState.end()) { stateCurrent = foldStateIterator->second; } // remove all foldState entries after lineCurrent-1 foldStateIterator = foldState.upper_bound(lineCurrent-1); if (foldStateIterator != foldState.end()) { foldState.erase(foldStateIterator, foldState.end()); } for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); int stylePrev = style; style = styleNext; styleNext = MaskActive(styler.StyleAt(i + 1)); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (!(stateCurrent & protectedFlag)) { if (options.foldComment && IsStreamCommentStyle(style)) { if (!IsStreamCommentStyle(stylePrev)) { levelNext++; } else if (!IsStreamCommentStyle(styleNext) && !atEOL) { // Comments don't end at end of line and the next character may be unstyled. levelNext--; } } if (options.foldComment && atEOL && IsCommentLine(lineCurrent, styler)) { if (!IsCommentLine(lineCurrent - 1, styler) && IsCommentLine(lineCurrent + 1, styler)) levelNext++; else if (IsCommentLine(lineCurrent - 1, styler) && !IsCommentLine(lineCurrent+1, styler)) levelNext--; } if (options.foldComment && (style == SCE_V_COMMENTLINE)) { if ((ch == '/') && (chNext == '/')) { char chNext2 = styler.SafeGetCharAt(i + 2); if (chNext2 == '{') { levelNext++; } else if (chNext2 == '}') { levelNext--; } } } } if (ch == '`') { Sci_PositionU j = i + 1; while ((j < endPos) && IsASpaceOrTab(styler.SafeGetCharAt(j))) { j++; } if (styler.Match(j, "protected")) { stateCurrent |= protectedFlag; levelNext++; } else if (styler.Match(j, "endprotected")) { stateCurrent &= ~protectedFlag; levelNext--; } else if (!(stateCurrent & protectedFlag) && options.foldPreprocessor && (style == SCE_V_PREPROCESSOR)) { if (styler.Match(j, "if")) { if (options.foldPreprocessorElse) { // Measure the minimum before a begin to allow // folding on "end else begin" if (levelMinCurrent > levelNext) { levelMinCurrent = levelNext; } } levelNext++; } else if (options.foldPreprocessorElse && styler.Match(j, "else")) { levelNext--; if (levelMinCurrent > levelNext) { levelMinCurrent = levelNext; } levelNext++; } else if (options.foldPreprocessorElse && styler.Match(j, "elsif")) { levelNext--; // Measure the minimum before a begin to allow // folding on "end else begin" if (levelMinCurrent > levelNext) { levelMinCurrent = levelNext; } levelNext++; } else if (styler.Match(j, "endif")) { levelNext--; } } } if (style == SCE_V_OPERATOR) { if (foldAtParenthese) { if (ch == '(') { levelNext++; } else if (ch == ')') { levelNext--; } } // semicolons terminate external declarations if (ch == ';') { // extern and pure virtual declarations terminated by semicolon if (stateCurrent & foldExternFlag) { levelNext--; stateCurrent &= ~foldExternFlag; } // wait and disable statements terminated by semicolon if (stateCurrent & foldWaitDisableFlag) { stateCurrent &= ~foldWaitDisableFlag; } // typedef statements terminated by semicolon if (stateCurrent & typedefFlag) { stateCurrent &= ~typedefFlag; } } // wait and disable statements containing '(' will not contain "fork" keyword, special processing is not needed if (ch == '(') { if (stateCurrent & foldWaitDisableFlag) { stateCurrent &= ~foldWaitDisableFlag; } } } if (style == SCE_V_OPERATOR) { if (foldAtBrace) { if (ch == '{') { levelNext++; } else if (ch == '}') { levelNext--; } } } if (style == SCE_V_WORD && stylePrev != SCE_V_WORD) { Sci_PositionU j = i; if (styler.Match(j, "case") || styler.Match(j, "casex") || styler.Match(j, "casez") || styler.Match(j, "covergroup") || styler.Match(j, "function") || styler.Match(j, "generate") || styler.Match(j, "interface") || styler.Match(j, "package") || styler.Match(j, "primitive") || styler.Match(j, "program") || styler.Match(j, "sequence") || styler.Match(j, "specify") || styler.Match(j, "table") || styler.Match(j, "task") || (styler.Match(j, "module") && options.foldAtModule)) { levelNext++; } else if (styler.Match(j, "begin")) { // Measure the minimum before a begin to allow // folding on "end else begin" if (levelMinCurrent > levelNext) { levelMinCurrent = levelNext; } levelNext++; } else if (styler.Match(j, "class")) { // class does not introduce a block when used in a typedef statement if (!(stateCurrent & typedefFlag)) levelNext++; } else if (styler.Match(j, "fork")) { // fork does not introduce a block when used in a wait or disable statement if (stateCurrent & foldWaitDisableFlag) { stateCurrent &= ~foldWaitDisableFlag; } else levelNext++; } else if (styler.Match(j, "endcase") || styler.Match(j, "endclass") || styler.Match(j, "endfunction") || styler.Match(j, "endgenerate") || styler.Match(j, "endgroup") || styler.Match(j, "endinterface") || styler.Match(j, "endpackage") || styler.Match(j, "endprimitive") || styler.Match(j, "endprogram") || styler.Match(j, "endsequence") || styler.Match(j, "endspecify") || styler.Match(j, "endtable") || styler.Match(j, "endtask") || styler.Match(j, "join") || styler.Match(j, "join_any") || styler.Match(j, "join_none") || (styler.Match(j, "endmodule") && options.foldAtModule) || (styler.Match(j, "end") && !IsAWordChar(styler.SafeGetCharAt(j + 3)))) { levelNext--; } else if (styler.Match(j, "extern") || styler.Match(j, "pure")) { // extern and pure virtual functions/tasks are terminated by ';' not endfunction/endtask stateCurrent |= foldExternFlag; } else if (styler.Match(j, "disable") || styler.Match(j, "wait")) { // fork does not introduce a block when used in a wait or disable statement stateCurrent |= foldWaitDisableFlag; } else if (styler.Match(j, "typedef")) { stateCurrent |= typedefFlag; } } if (atEOL) { int levelUse = levelCurrent; if (options.foldAtElse||options.foldPreprocessorElse) { levelUse = levelMinCurrent; } int lev = levelUse | levelNext << 16; if (visibleChars == 0 && options.foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if (levelUse < levelNext) lev |= SC_FOLDLEVELHEADERFLAG; if (stateCurrent) { foldState[lineCurrent] = stateCurrent; } if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelCurrent = levelNext; levelMinCurrent = levelCurrent; visibleChars = 0; } if (!isspacechar(ch)) visibleChars++; } } std::vector LexerVerilog::Tokenize(const std::string &expr) const { // Break into tokens std::vector tokens; const char *cp = expr.c_str(); while (*cp) { std::string word; if (setWord.Contains(static_cast(*cp))) { // Identifiers and numbers while (setWord.Contains(static_cast(*cp))) { word += *cp; cp++; } } else if (IsSpaceOrTab(*cp)) { while (IsSpaceOrTab(*cp)) { cp++; } continue; } else { // Should handle strings, characters, and comments here word += *cp; cp++; } tokens.push_back(word); } return tokens; } static const char * const verilogWordLists[] = { "Primary keywords and identifiers", "Secondary keywords and identifiers", "System Tasks", "User defined tasks and identifiers", "Documentation comment keywords", "Preprocessor definitions", 0, }; LexerModule lmVerilog(SCLEX_VERILOG, LexerVerilog::LexerFactoryVerilog, "verilog", verilogWordLists); lexilla/lexers/LexD.cxx0000664000175000017500000004100514647367374014061 0ustar neilneil/** @file LexD.cxx ** Lexer for D. ** ** Copyright (c) 2006 by Waldemar Augustyn ** Converted to lexer object and added further folding features/properties by "Udo Lechner" **/ // Copyright 1998-2005 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" #include "OptionSet.h" #include "DefaultLexer.h" using namespace Scintilla; using namespace Lexilla; /* Nested comments require keeping the value of the nesting level for every position in the document. But since scintilla always styles line by line, we only need to store one value per line. The non-negative number indicates nesting level at the end of the line. */ // Underscore, letter, digit and universal alphas from C99 Appendix D. static bool IsWordStart(int ch) { return (IsASCII(ch) && (isalpha(ch) || ch == '_')) || !IsASCII(ch); } static bool IsWord(int ch) { return (IsASCII(ch) && (isalnum(ch) || ch == '_')) || !IsASCII(ch); } static bool IsDoxygen(int ch) { if (IsASCII(ch) && islower(ch)) return true; if (ch == '$' || ch == '@' || ch == '\\' || ch == '&' || ch == '#' || ch == '<' || ch == '>' || ch == '{' || ch == '}' || ch == '[' || ch == ']') return true; return false; } static bool IsStringSuffix(int ch) { return ch == 'c' || ch == 'w' || ch == 'd'; } static bool IsStreamCommentStyle(int style) { return style == SCE_D_COMMENT || style == SCE_D_COMMENTDOC || style == SCE_D_COMMENTDOCKEYWORD || style == SCE_D_COMMENTDOCKEYWORDERROR; } // An individual named option for use in an OptionSet // Options used for LexerD struct OptionsD { bool fold; bool foldSyntaxBased; bool foldComment; bool foldCommentMultiline; bool foldCommentExplicit; std::string foldExplicitStart; std::string foldExplicitEnd; bool foldExplicitAnywhere; bool foldCompact; int foldAtElseInt; bool foldAtElse; OptionsD() { fold = false; foldSyntaxBased = true; foldComment = false; foldCommentMultiline = true; foldCommentExplicit = true; foldExplicitStart = ""; foldExplicitEnd = ""; foldExplicitAnywhere = false; foldCompact = true; foldAtElseInt = -1; foldAtElse = false; } }; static const char * const dWordLists[] = { "Primary keywords and identifiers", "Secondary keywords and identifiers", "Documentation comment keywords", "Type definitions and aliases", "Keywords 5", "Keywords 6", "Keywords 7", 0, }; struct OptionSetD : public OptionSet { OptionSetD() { DefineProperty("fold", &OptionsD::fold); DefineProperty("fold.d.syntax.based", &OptionsD::foldSyntaxBased, "Set this property to 0 to disable syntax based folding."); DefineProperty("fold.comment", &OptionsD::foldComment); DefineProperty("fold.d.comment.multiline", &OptionsD::foldCommentMultiline, "Set this property to 0 to disable folding multi-line comments when fold.comment=1."); DefineProperty("fold.d.comment.explicit", &OptionsD::foldCommentExplicit, "Set this property to 0 to disable folding explicit fold points when fold.comment=1."); DefineProperty("fold.d.explicit.start", &OptionsD::foldExplicitStart, "The string to use for explicit fold start points, replacing the standard //{."); DefineProperty("fold.d.explicit.end", &OptionsD::foldExplicitEnd, "The string to use for explicit fold end points, replacing the standard //}."); DefineProperty("fold.d.explicit.anywhere", &OptionsD::foldExplicitAnywhere, "Set this property to 1 to enable explicit fold points anywhere, not just in line comments."); DefineProperty("fold.compact", &OptionsD::foldCompact); DefineProperty("lexer.d.fold.at.else", &OptionsD::foldAtElseInt, "This option enables D folding on a \"} else {\" line of an if statement."); DefineProperty("fold.at.else", &OptionsD::foldAtElse); DefineWordListSets(dWordLists); } }; class LexerD : public DefaultLexer { bool caseSensitive; WordList keywords; WordList keywords2; WordList keywords3; WordList keywords4; WordList keywords5; WordList keywords6; WordList keywords7; OptionsD options; OptionSetD osD; public: LexerD(bool caseSensitive_) : DefaultLexer("D", SCLEX_D), caseSensitive(caseSensitive_) { } virtual ~LexerD() { } void SCI_METHOD Release() override { delete this; } int SCI_METHOD Version() const override { return lvRelease5; } const char * SCI_METHOD PropertyNames() override { return osD.PropertyNames(); } int SCI_METHOD PropertyType(const char *name) override { return osD.PropertyType(name); } const char * SCI_METHOD DescribeProperty(const char *name) override { return osD.DescribeProperty(name); } Sci_Position SCI_METHOD PropertySet(const char *key, const char *val) override; const char * SCI_METHOD PropertyGet(const char *key) override { return osD.PropertyGet(key); } const char * SCI_METHOD DescribeWordListSets() override { return osD.DescribeWordListSets(); } Sci_Position SCI_METHOD WordListSet(int n, const char *wl) override; void SCI_METHOD Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void SCI_METHOD Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void * SCI_METHOD PrivateCall(int, void *) override { return 0; } static ILexer5 *LexerFactoryD() { return new LexerD(true); } }; Sci_Position SCI_METHOD LexerD::PropertySet(const char *key, const char *val) { if (osD.PropertySet(&options, key, val)) { return 0; } return -1; } Sci_Position SCI_METHOD LexerD::WordListSet(int n, const char *wl) { WordList *wordListN = 0; switch (n) { case 0: wordListN = &keywords; break; case 1: wordListN = &keywords2; break; case 2: wordListN = &keywords3; break; case 3: wordListN = &keywords4; break; case 4: wordListN = &keywords5; break; case 5: wordListN = &keywords6; break; case 6: wordListN = &keywords7; break; } Sci_Position firstModification = -1; if (wordListN) { WordList wlNew; wlNew.Set(wl); if (*wordListN != wlNew) { wordListN->Set(wl); firstModification = 0; } } return firstModification; } void SCI_METHOD LexerD::Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { LexAccessor styler(pAccess); int styleBeforeDCKeyword = SCE_D_DEFAULT; StyleContext sc(startPos, length, initStyle, styler); Sci_Position curLine = styler.GetLine(startPos); int curNcLevel = curLine > 0? styler.GetLineState(curLine-1): 0; bool numFloat = false; // Float literals have '+' and '-' signs bool numHex = false; for (; sc.More(); sc.Forward()) { if (sc.atLineStart) { curLine = styler.GetLine(sc.currentPos); styler.SetLineState(curLine, curNcLevel); } // Determine if the current state should terminate. switch (sc.state) { case SCE_D_OPERATOR: sc.SetState(SCE_D_DEFAULT); break; case SCE_D_NUMBER: // We accept almost anything because of hex. and number suffixes if (IsASCII(sc.ch) && (isalnum(sc.ch) || sc.ch == '_')) { continue; } else if (sc.ch == '.' && sc.chNext != '.' && !numFloat) { // Don't parse 0..2 as number. numFloat=true; continue; } else if ( ( sc.ch == '-' || sc.ch == '+' ) && ( /*sign and*/ ( !numHex && ( sc.chPrev == 'e' || sc.chPrev == 'E' ) ) || /*decimal or*/ ( sc.chPrev == 'p' || sc.chPrev == 'P' ) ) ) { /*hex*/ // Parse exponent sign in float literals: 2e+10 0x2e+10 continue; } else { sc.SetState(SCE_D_DEFAULT); } break; case SCE_D_IDENTIFIER: if (!IsWord(sc.ch)) { char s[1000]; if (caseSensitive) { sc.GetCurrent(s, sizeof(s)); } else { sc.GetCurrentLowered(s, sizeof(s)); } if (keywords.InList(s)) { sc.ChangeState(SCE_D_WORD); } else if (keywords2.InList(s)) { sc.ChangeState(SCE_D_WORD2); } else if (keywords4.InList(s)) { sc.ChangeState(SCE_D_TYPEDEF); } else if (keywords5.InList(s)) { sc.ChangeState(SCE_D_WORD5); } else if (keywords6.InList(s)) { sc.ChangeState(SCE_D_WORD6); } else if (keywords7.InList(s)) { sc.ChangeState(SCE_D_WORD7); } sc.SetState(SCE_D_DEFAULT); } break; case SCE_D_COMMENT: if (sc.Match('*', '/')) { sc.Forward(); sc.ForwardSetState(SCE_D_DEFAULT); } break; case SCE_D_COMMENTDOC: if (sc.Match('*', '/')) { sc.Forward(); sc.ForwardSetState(SCE_D_DEFAULT); } else if (sc.ch == '@' || sc.ch == '\\') { // JavaDoc and Doxygen support // Verify that we have the conditions to mark a comment-doc-keyword if ((IsASpace(sc.chPrev) || sc.chPrev == '*') && (!IsASpace(sc.chNext))) { styleBeforeDCKeyword = SCE_D_COMMENTDOC; sc.SetState(SCE_D_COMMENTDOCKEYWORD); } } break; case SCE_D_COMMENTLINE: if (sc.atLineStart) { sc.SetState(SCE_D_DEFAULT); } break; case SCE_D_COMMENTLINEDOC: if (sc.atLineStart) { sc.SetState(SCE_D_DEFAULT); } else if (sc.ch == '@' || sc.ch == '\\') { // JavaDoc and Doxygen support // Verify that we have the conditions to mark a comment-doc-keyword if ((IsASpace(sc.chPrev) || sc.chPrev == '/' || sc.chPrev == '!') && (!IsASpace(sc.chNext))) { styleBeforeDCKeyword = SCE_D_COMMENTLINEDOC; sc.SetState(SCE_D_COMMENTDOCKEYWORD); } } break; case SCE_D_COMMENTDOCKEYWORD: if ((styleBeforeDCKeyword == SCE_D_COMMENTDOC) && sc.Match('*', '/')) { sc.ChangeState(SCE_D_COMMENTDOCKEYWORDERROR); sc.Forward(); sc.ForwardSetState(SCE_D_DEFAULT); } else if (!IsDoxygen(sc.ch)) { char s[100]; if (caseSensitive) { sc.GetCurrent(s, sizeof(s)); } else { sc.GetCurrentLowered(s, sizeof(s)); } if (!IsASpace(sc.ch) || !keywords3.InList(s + 1)) { sc.ChangeState(SCE_D_COMMENTDOCKEYWORDERROR); } sc.SetState(styleBeforeDCKeyword); } break; case SCE_D_COMMENTNESTED: if (sc.Match('+', '/')) { if (curNcLevel > 0) curNcLevel -= 1; curLine = styler.GetLine(sc.currentPos); styler.SetLineState(curLine, curNcLevel); sc.Forward(); if (curNcLevel == 0) { sc.ForwardSetState(SCE_D_DEFAULT); } } else if (sc.Match('/','+')) { curNcLevel += 1; curLine = styler.GetLine(sc.currentPos); styler.SetLineState(curLine, curNcLevel); sc.Forward(); } break; case SCE_D_STRING: if (sc.ch == '\\') { if (sc.chNext == '"' || sc.chNext == '\\') { sc.Forward(); } } else if (sc.ch == '"') { if(IsStringSuffix(sc.chNext)) sc.Forward(); sc.ForwardSetState(SCE_D_DEFAULT); } break; case SCE_D_CHARACTER: if (sc.atLineEnd) { sc.ChangeState(SCE_D_STRINGEOL); } else if (sc.ch == '\\') { if (sc.chNext == '\'' || sc.chNext == '\\') { sc.Forward(); } } else if (sc.ch == '\'') { // Char has no suffixes sc.ForwardSetState(SCE_D_DEFAULT); } break; case SCE_D_STRINGEOL: if (sc.atLineStart) { sc.SetState(SCE_D_DEFAULT); } break; case SCE_D_STRINGB: if (sc.ch == '`') { if(IsStringSuffix(sc.chNext)) sc.Forward(); sc.ForwardSetState(SCE_D_DEFAULT); } break; case SCE_D_STRINGR: if (sc.ch == '"') { if(IsStringSuffix(sc.chNext)) sc.Forward(); sc.ForwardSetState(SCE_D_DEFAULT); } break; } // Determine if a new state should be entered. if (sc.state == SCE_D_DEFAULT) { if (IsADigit(sc.ch) || (sc.ch == '.' && IsADigit(sc.chNext))) { sc.SetState(SCE_D_NUMBER); numFloat = sc.ch == '.'; // Remember hex literal numHex = sc.ch == '0' && ( sc.chNext == 'x' || sc.chNext == 'X' ); } else if ( (sc.ch == 'r' || sc.ch == 'x' || sc.ch == 'q') && sc.chNext == '"' ) { // Limited support for hex and delimited strings: parse as r"" sc.SetState(SCE_D_STRINGR); sc.Forward(); } else if (IsWordStart(sc.ch) || sc.ch == '$') { sc.SetState(SCE_D_IDENTIFIER); } else if (sc.Match('/','+')) { curNcLevel += 1; curLine = styler.GetLine(sc.currentPos); styler.SetLineState(curLine, curNcLevel); sc.SetState(SCE_D_COMMENTNESTED); sc.Forward(); } else if (sc.Match('/', '*')) { if (sc.Match("/**") || sc.Match("/*!")) { // Support of Qt/Doxygen doc. style sc.SetState(SCE_D_COMMENTDOC); } else { sc.SetState(SCE_D_COMMENT); } sc.Forward(); // Eat the * so it isn't used for the end of the comment } else if (sc.Match('/', '/')) { if ((sc.Match("///") && !sc.Match("////")) || sc.Match("//!")) // Support of Qt/Doxygen doc. style sc.SetState(SCE_D_COMMENTLINEDOC); else sc.SetState(SCE_D_COMMENTLINE); } else if (sc.ch == '"') { sc.SetState(SCE_D_STRING); } else if (sc.ch == '\'') { sc.SetState(SCE_D_CHARACTER); } else if (sc.ch == '`') { sc.SetState(SCE_D_STRINGB); } else if (isoperator(static_cast(sc.ch))) { sc.SetState(SCE_D_OPERATOR); if (sc.ch == '.' && sc.chNext == '.') sc.Forward(); // Range operator } } } sc.Complete(); } // Store both the current line's fold level and the next lines in the // level store to make it easy to pick up with each increment // and to make it possible to fiddle the current level for "} else {". void SCI_METHOD LexerD::Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { if (!options.fold) return; LexAccessor styler(pAccess); Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelCurrent = SC_FOLDLEVELBASE; if (lineCurrent > 0) levelCurrent = styler.LevelAt(lineCurrent-1) >> 16; int levelMinCurrent = levelCurrent; int levelNext = levelCurrent; char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); int style = initStyle; bool foldAtElse = options.foldAtElseInt >= 0 ? options.foldAtElseInt != 0 : options.foldAtElse; const bool userDefinedFoldMarkers = !options.foldExplicitStart.empty() && !options.foldExplicitEnd.empty(); for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); int stylePrev = style; style = styleNext; styleNext = styler.StyleAt(i + 1); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (options.foldComment && options.foldCommentMultiline && IsStreamCommentStyle(style)) { if (!IsStreamCommentStyle(stylePrev)) { levelNext++; } else if (!IsStreamCommentStyle(styleNext) && !atEOL) { // Comments don't end at end of line and the next character may be unstyled. levelNext--; } } if (options.foldComment && options.foldCommentExplicit && ((style == SCE_D_COMMENTLINE) || options.foldExplicitAnywhere)) { if (userDefinedFoldMarkers) { if (styler.Match(i, options.foldExplicitStart.c_str())) { levelNext++; } else if (styler.Match(i, options.foldExplicitEnd.c_str())) { levelNext--; } } else { if ((ch == '/') && (chNext == '/')) { char chNext2 = styler.SafeGetCharAt(i + 2); if (chNext2 == '{') { levelNext++; } else if (chNext2 == '}') { levelNext--; } } } } if (options.foldSyntaxBased && (style == SCE_D_OPERATOR)) { if (ch == '{') { // Measure the minimum before a '{' to allow // folding on "} else {" if (levelMinCurrent > levelNext) { levelMinCurrent = levelNext; } levelNext++; } else if (ch == '}') { levelNext--; } } if (atEOL || (i == endPos-1)) { if (options.foldComment && options.foldCommentMultiline) { // Handle nested comments int nc; nc = styler.GetLineState(lineCurrent); nc -= lineCurrent>0? styler.GetLineState(lineCurrent-1): 0; levelNext += nc; } int levelUse = levelCurrent; if (options.foldSyntaxBased && foldAtElse) { levelUse = levelMinCurrent; } int lev = levelUse | levelNext << 16; if (visibleChars == 0 && options.foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if (levelUse < levelNext) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelCurrent = levelNext; levelMinCurrent = levelCurrent; visibleChars = 0; } if (!IsASpace(ch)) visibleChars++; } } LexerModule lmD(SCLEX_D, LexerD::LexerFactoryD, "d", dWordLists); lexilla/lexers/LexNimrod.cxx0000664000175000017500000003313714647367374015135 0ustar neilneil// Scintilla source code edit control // Nimrod lexer // (c) 2009 Andreas Rumpf /** @file LexNimrod.cxx ** Lexer for Nimrod. ** This lexer has been superceded by the "nim" lexer in LexNim.cxx. **/ // Copyright 1998-2002 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static inline bool IsAWordChar(int ch) { return (ch >= 0x80) || isalnum(ch) || ch == '_'; } static Sci_Position tillEndOfTripleQuote(Accessor &styler, Sci_Position pos, Sci_Position max) { /* search for """ */ for (;;) { if (styler.SafeGetCharAt(pos, '\0') == '\0') return pos; if (pos >= max) return pos; if (styler.Match(pos, "\"\"\"")) { return pos + 2; } pos++; } } #define CR 13 /* use both because Scite allows changing the line ending */ #define LF 10 static bool inline isNewLine(int ch) { return ch == CR || ch == LF; } static Sci_Position scanString(Accessor &styler, Sci_Position pos, Sci_Position max, bool rawMode) { for (;;) { if (pos >= max) return pos; char ch = styler.SafeGetCharAt(pos, '\0'); if (ch == CR || ch == LF || ch == '\0') return pos; if (ch == '"') return pos; if (ch == '\\' && !rawMode) { pos += 2; } else { pos++; } } } static Sci_Position scanChar(Accessor &styler, Sci_Position pos, Sci_Position max) { for (;;) { if (pos >= max) return pos; char ch = styler.SafeGetCharAt(pos, '\0'); if (ch == CR || ch == LF || ch == '\0') return pos; if (ch == '\'' && !isalnum(styler.SafeGetCharAt(pos+1, '\0')) ) return pos; if (ch == '\\') { pos += 2; } else { pos++; } } } static Sci_Position scanIdent(Accessor &styler, Sci_Position pos, WordList &keywords) { char buf[100]; /* copy to lowercase and ignore underscores */ Sci_Position i = 0; for (;;) { char ch = styler.SafeGetCharAt(pos, '\0'); if (!IsAWordChar(ch)) break; if (ch != '_' && i < ((int)sizeof(buf))-1) { buf[i] = static_cast(tolower(ch)); i++; } pos++; } buf[i] = '\0'; /* look for keyword */ if (keywords.InList(buf)) { styler.ColourTo(pos-1, SCE_P_WORD); } else { styler.ColourTo(pos-1, SCE_P_IDENTIFIER); } return pos; } static Sci_Position scanNumber(Accessor &styler, Sci_Position pos) { char ch, ch2; ch = styler.SafeGetCharAt(pos, '\0'); ch2 = styler.SafeGetCharAt(pos+1, '\0'); if (ch == '0' && (ch2 == 'b' || ch2 == 'B')) { /* binary number: */ pos += 2; for (;;) { ch = styler.SafeGetCharAt(pos, '\0'); if (ch == '_' || (ch >= '0' && ch <= '1')) ++pos; else break; } } else if (ch == '0' && (ch2 == 'o' || ch2 == 'O' || ch2 == 'c' || ch2 == 'C')) { /* octal number: */ pos += 2; for (;;) { ch = styler.SafeGetCharAt(pos, '\0'); if (ch == '_' || (ch >= '0' && ch <= '7')) ++pos; else break; } } else if (ch == '0' && (ch2 == 'x' || ch2 == 'X')) { /* hexadecimal number: */ pos += 2; for (;;) { ch = styler.SafeGetCharAt(pos, '\0'); if (ch == '_' || (ch >= '0' && ch <= '9') || (ch >= 'a' && ch <= 'f') || (ch >= 'A' && ch <= 'F')) ++pos; else break; } } else { // skip decimal part: for (;;) { ch = styler.SafeGetCharAt(pos, '\0'); if (ch == '_' || (ch >= '0' && ch <= '9')) ++pos; else break; } ch2 = styler.SafeGetCharAt(pos+1, '\0'); if (ch == '.' && ch2 >= '0' && ch2 <= '9') { ++pos; // skip '.' for (;;) { ch = styler.SafeGetCharAt(pos, '\0'); if (ch == '_' || (ch >= '0' && ch <= '9')) ++pos; else break; } } if (ch == 'e' || ch == 'E') { ++pos; ch = styler.SafeGetCharAt(pos, '\0'); if (ch == '-' || ch == '+') ++pos; for (;;) { ch = styler.SafeGetCharAt(pos, '\0'); if (ch == '_' || (ch >= '0' && ch <= '9')) ++pos; else break; } } } if (ch == '\'') { /* a type suffix: */ pos++; for (;;) { ch = styler.SafeGetCharAt(pos); if ((ch >= '0' && ch <= '9') || (ch >= 'A' && ch <= 'Z') || (ch >= 'a' && ch <= 'z') || ch == '_') ++pos; else break; } } styler.ColourTo(pos-1, SCE_P_NUMBER); return pos; } /* rewritten from scratch, because I couldn't get rid of the bugs... (A character based approach sucks!) */ static void ColouriseNimrodDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { Sci_Position pos = startPos; Sci_Position max = startPos + length; char ch; WordList &keywords = *keywordlists[0]; styler.StartAt(startPos); styler.StartSegment(startPos); switch (initStyle) { /* check where we are: */ case SCE_P_TRIPLEDOUBLE: pos = tillEndOfTripleQuote(styler, pos, max); styler.ColourTo(pos, SCE_P_TRIPLEDOUBLE); pos++; break; default: /* nothing to do: */ break; } while (pos < max) { ch = styler.SafeGetCharAt(pos, '\0'); switch (ch) { case '\0': return; case '#': { bool doccomment = (styler.SafeGetCharAt(pos+1) == '#'); while (pos < max && !isNewLine(styler.SafeGetCharAt(pos, LF))) pos++; if (doccomment) styler.ColourTo(pos, SCE_C_COMMENTLINEDOC); else styler.ColourTo(pos, SCE_P_COMMENTLINE); } break; case 'r': case 'R': { if (styler.SafeGetCharAt(pos+1) == '"') { pos = scanString(styler, pos+2, max, true); styler.ColourTo(pos, SCE_P_STRING); pos++; } else { pos = scanIdent(styler, pos, keywords); } } break; case '"': if (styler.Match(pos+1, "\"\"")) { pos = tillEndOfTripleQuote(styler, pos+3, max); styler.ColourTo(pos, SCE_P_TRIPLEDOUBLE); } else { pos = scanString(styler, pos+1, max, false); styler.ColourTo(pos, SCE_P_STRING); } pos++; break; case '\'': pos = scanChar(styler, pos+1, max); styler.ColourTo(pos, SCE_P_CHARACTER); pos++; break; default: // identifers, numbers, operators, whitespace if (ch >= '0' && ch <= '9') { pos = scanNumber(styler, pos); } else if (IsAWordChar(ch)) { pos = scanIdent(styler, pos, keywords); } else if (ch == '`') { pos++; while (pos < max) { ch = styler.SafeGetCharAt(pos, LF); if (ch == '`') { ++pos; break; } if (ch == CR || ch == LF) break; ++pos; } styler.ColourTo(pos, SCE_P_IDENTIFIER); } else if (strchr("()[]{}:=;-\\/&%$!+<>|^?,.*~@", ch)) { styler.ColourTo(pos, SCE_P_OPERATOR); pos++; } else { styler.ColourTo(pos, SCE_P_DEFAULT); pos++; } break; } } } static bool IsCommentLine(Sci_Position line, Accessor &styler) { Sci_Position pos = styler.LineStart(line); Sci_Position eol_pos = styler.LineStart(line + 1) - 1; for (Sci_Position i = pos; i < eol_pos; i++) { char ch = styler[i]; if (ch == '#') return true; else if (ch != ' ' && ch != '\t') return false; } return false; } static bool IsQuoteLine(Sci_Position line, Accessor &styler) { int style = styler.StyleAt(styler.LineStart(line)) & 31; return ((style == SCE_P_TRIPLE) || (style == SCE_P_TRIPLEDOUBLE)); } static void FoldNimrodDoc(Sci_PositionU startPos, Sci_Position length, int /*initStyle - unused*/, WordList *[], Accessor &styler) { const Sci_Position maxPos = startPos + length; const Sci_Position maxLines = styler.GetLine(maxPos - 1); // Requested last line const Sci_Position docLines = styler.GetLine(styler.Length() - 1); // Available last line const bool foldComment = styler.GetPropertyInt("fold.comment.nimrod") != 0; const bool foldQuotes = styler.GetPropertyInt("fold.quotes.nimrod") != 0; // Backtrack to previous non-blank line so we can determine indent level // for any white space lines (needed esp. within triple quoted strings) // and so we can fix any preceding fold level (which is why we go back // at least one line in all cases) int spaceFlags = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int indentCurrent = styler.IndentAmount(lineCurrent, &spaceFlags, NULL); while (lineCurrent > 0) { lineCurrent--; indentCurrent = styler.IndentAmount(lineCurrent, &spaceFlags, NULL); if (!(indentCurrent & SC_FOLDLEVELWHITEFLAG) && (!IsCommentLine(lineCurrent, styler)) && (!IsQuoteLine(lineCurrent, styler))) break; } int indentCurrentLevel = indentCurrent & SC_FOLDLEVELNUMBERMASK; // Set up initial loop state startPos = styler.LineStart(lineCurrent); int prev_state = SCE_P_DEFAULT & 31; if (lineCurrent >= 1) prev_state = styler.StyleAt(startPos - 1) & 31; int prevQuote = foldQuotes && ((prev_state == SCE_P_TRIPLE) || (prev_state == SCE_P_TRIPLEDOUBLE)); int prevComment = 0; if (lineCurrent >= 1) prevComment = foldComment && IsCommentLine(lineCurrent - 1, styler); // Process all characters to end of requested range or end of any triple quote // or comment that hangs over the end of the range. Cap processing in all cases // to end of document (in case of unclosed quote or comment at end). while ((lineCurrent <= docLines) && ((lineCurrent <= maxLines) || prevQuote || prevComment)) { // Gather info int lev = indentCurrent; Sci_Position lineNext = lineCurrent + 1; int indentNext = indentCurrent; int quote = false; if (lineNext <= docLines) { // Information about next line is only available if not at end of document indentNext = styler.IndentAmount(lineNext, &spaceFlags, NULL); int style = styler.StyleAt(styler.LineStart(lineNext)) & 31; quote = foldQuotes && ((style == SCE_P_TRIPLE) || (style == SCE_P_TRIPLEDOUBLE)); } const int quote_start = (quote && !prevQuote); const int quote_continue = (quote && prevQuote); const int comment = foldComment && IsCommentLine(lineCurrent, styler); const int comment_start = (comment && !prevComment && (lineNext <= docLines) && IsCommentLine(lineNext, styler) && (lev > SC_FOLDLEVELBASE)); const int comment_continue = (comment && prevComment); if ((!quote || !prevQuote) && !comment) indentCurrentLevel = indentCurrent & SC_FOLDLEVELNUMBERMASK; if (quote) indentNext = indentCurrentLevel; if (indentNext & SC_FOLDLEVELWHITEFLAG) indentNext = SC_FOLDLEVELWHITEFLAG | indentCurrentLevel; if (quote_start) { // Place fold point at start of triple quoted string lev |= SC_FOLDLEVELHEADERFLAG; } else if (quote_continue || prevQuote) { // Add level to rest of lines in the string lev = lev + 1; } else if (comment_start) { // Place fold point at start of a block of comments lev |= SC_FOLDLEVELHEADERFLAG; } else if (comment_continue) { // Add level to rest of lines in the block lev = lev + 1; } // Skip past any blank lines for next indent level info; we skip also // comments (all comments, not just those starting in column 0) // which effectively folds them into surrounding code rather // than screwing up folding. while (!quote && (lineNext < docLines) && ((indentNext & SC_FOLDLEVELWHITEFLAG) || (lineNext <= docLines && IsCommentLine(lineNext, styler)))) { lineNext++; indentNext = styler.IndentAmount(lineNext, &spaceFlags, NULL); } const int levelAfterComments = indentNext & SC_FOLDLEVELNUMBERMASK; const int levelBeforeComments = Maximum(indentCurrentLevel,levelAfterComments); // Now set all the indent levels on the lines we skipped // Do this from end to start. Once we encounter one line // which is indented more than the line after the end of // the comment-block, use the level of the block before Sci_Position skipLine = lineNext; int skipLevel = levelAfterComments; while (--skipLine > lineCurrent) { int skipLineIndent = styler.IndentAmount(skipLine, &spaceFlags, NULL); if ((skipLineIndent & SC_FOLDLEVELNUMBERMASK) > levelAfterComments) skipLevel = levelBeforeComments; int whiteFlag = skipLineIndent & SC_FOLDLEVELWHITEFLAG; styler.SetLevel(skipLine, skipLevel | whiteFlag); } // Set fold header on non-quote/non-comment line if (!quote && !comment && !(indentCurrent & SC_FOLDLEVELWHITEFLAG) ) { if ((indentCurrent & SC_FOLDLEVELNUMBERMASK) < (indentNext & SC_FOLDLEVELNUMBERMASK)) lev |= SC_FOLDLEVELHEADERFLAG; } // Keep track of triple quote and block comment state of previous line prevQuote = quote; prevComment = comment_start || comment_continue; // Set fold level for this line and move to next line styler.SetLevel(lineCurrent, lev); indentCurrent = indentNext; lineCurrent = lineNext; } // NOTE: Cannot set level of last line here because indentCurrent doesn't have // header flag set; the loop above is crafted to take care of this case! //styler.SetLevel(lineCurrent, indentCurrent); } static const char * const nimrodWordListDesc[] = { "Keywords", 0 }; LexerModule lmNimrod(SCLEX_NIMROD, ColouriseNimrodDoc, "nimrod", FoldNimrodDoc, nimrodWordListDesc); lexilla/lexers/LexBash.cxx0000664000175000017500000012146214647367374014561 0ustar neilneil// Scintilla source code edit control /** @file LexBash.cxx ** Lexer for Bash. **/ // Copyright 2004-2012 by Neil Hodgson // Adapted from LexPerl by Kein-Hong Man 2004 // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "StringCopy.h" #include "InList.h" #include "WordList.h" #include "LexAccessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" #include "OptionSet.h" #include "SubStyles.h" #include "DefaultLexer.h" using namespace Scintilla; using namespace Lexilla; namespace { #define HERE_DELIM_MAX 256 // define this if you want 'invalid octals' to be marked as errors // usually, this is not a good idea, permissive lexing is better #undef PEDANTIC_OCTAL #define BASH_BASE_ERROR 65 #define BASH_BASE_DECIMAL 66 #define BASH_BASE_HEX 67 #ifdef PEDANTIC_OCTAL #define BASH_BASE_OCTAL 68 #define BASH_BASE_OCTAL_ERROR 69 #endif // state constants for parts of a bash command segment enum class CmdState { Body, Start, Word, Test, // test SingleBracket, // [] DoubleBracket, // [[]] Arithmetic, Delimiter, }; enum class CommandSubstitution : int { Backtick, Inside, InsideTrack, }; // state constants for nested delimiter pairs, used by // SCE_SH_STRING, SCE_SH_PARAM and SCE_SH_BACKTICKS processing enum class QuoteStyle { Literal, // '' CString, // $'' String, // "" LString, // $"" HereDoc, // here document Backtick, // `` Parameter, // ${} Command, // $() CommandInside, // $() with styling inside Arithmetic, // $(()), $[] }; #define BASH_QUOTE_STACK_MAX 7 #define BASH_SPECIAL_PARAMETER "*@#?-$!" constexpr int commandSubstitutionFlag = 0x40; constexpr int MaskCommand(int state) noexcept { return state & ~commandSubstitutionFlag; } constexpr int translateBashDigit(int ch) noexcept { if (ch >= '0' && ch <= '9') { return ch - '0'; } else if (ch >= 'a' && ch <= 'z') { return ch - 'a' + 10; } else if (ch >= 'A' && ch <= 'Z') { return ch - 'A' + 36; } else if (ch == '@') { return 62; } else if (ch == '_') { return 63; } return BASH_BASE_ERROR; } int getBashNumberBase(char *s) noexcept { int i = 0; int base = 0; while (*s) { base = base * 10 + (*s++ - '0'); i++; } if (base > 64 || i > 2) { return BASH_BASE_ERROR; } return base; } constexpr int opposite(int ch) noexcept { if (ch == '(') return ')'; if (ch == '[') return ']'; if (ch == '{') return '}'; if (ch == '<') return '>'; return ch; } int GlobScan(StyleContext &sc) { // forward scan for zsh globs, disambiguate versus bash arrays // complex expressions may still fail, e.g. unbalanced () '' "" etc int c = 0; int sLen = 0; int pCount = 0; int hash = 0; while ((c = sc.GetRelativeCharacter(++sLen)) != 0) { if (IsASpace(c)) { return 0; } else if (c == '\'' || c == '\"') { if (hash != 2) return 0; } else if (c == '#' && hash == 0) { hash = (sLen == 1) ? 2:1; } else if (c == '(') { pCount++; } else if (c == ')') { if (pCount == 0) { if (hash) return sLen; return 0; } pCount--; } } return 0; } bool IsCommentLine(Sci_Position line, LexAccessor &styler) { const Sci_Position pos = styler.LineStart(line); const Sci_Position eol_pos = styler.LineStart(line + 1) - 1; for (Sci_Position i = pos; i < eol_pos; i++) { const char ch = styler[i]; if (ch == '#') return true; else if (ch != ' ' && ch != '\t') return false; } return false; } constexpr bool StyleForceBacktrack(int state) noexcept { return AnyOf(state, SCE_SH_CHARACTER, SCE_SH_STRING, SCE_SH_BACKTICKS, SCE_SH_HERE_Q, SCE_SH_PARAM); } struct OptionsBash { bool fold = false; bool foldComment = false; bool foldCompact = true; bool stylingInsideString = false; bool stylingInsideBackticks = false; bool stylingInsideParameter = false; bool stylingInsideHeredoc = false; bool nestedBackticks = true; CommandSubstitution commandSubstitution = CommandSubstitution::Backtick; std::string specialParameter = BASH_SPECIAL_PARAMETER; [[nodiscard]] bool stylingInside(int state) const noexcept { switch (state) { case SCE_SH_STRING: return stylingInsideString; case SCE_SH_BACKTICKS: return stylingInsideBackticks; case SCE_SH_PARAM: return stylingInsideParameter; case SCE_SH_HERE_Q: return stylingInsideHeredoc; default: return false; } } }; const char * const bashWordListDesc[] = { "Keywords", nullptr }; struct OptionSetBash : public OptionSet { OptionSetBash() { DefineProperty("fold", &OptionsBash::fold); DefineProperty("fold.comment", &OptionsBash::foldComment); DefineProperty("fold.compact", &OptionsBash::foldCompact); DefineProperty("lexer.bash.styling.inside.string", &OptionsBash::stylingInsideString, "Set this property to 1 to highlight shell expansions inside string."); DefineProperty("lexer.bash.styling.inside.backticks", &OptionsBash::stylingInsideBackticks, "Set this property to 1 to highlight shell expansions inside backticks."); DefineProperty("lexer.bash.styling.inside.parameter", &OptionsBash::stylingInsideParameter, "Set this property to 1 to highlight shell expansions inside ${} parameter expansion."); DefineProperty("lexer.bash.styling.inside.heredoc", &OptionsBash::stylingInsideHeredoc, "Set this property to 1 to highlight shell expansions inside here document."); DefineProperty("lexer.bash.command.substitution", &OptionsBash::commandSubstitution, "Set how to highlight $() command substitution. " "0 (the default) highlighted as backticks. " "1 highlighted inside. " "2 highlighted inside with extra scope tracking."); DefineProperty("lexer.bash.nested.backticks", &OptionsBash::nestedBackticks, "Set this property to 0 to disable nested backquoted command substitution."); DefineProperty("lexer.bash.special.parameter", &OptionsBash::specialParameter, "Set shell (default is Bash) special parameters."); DefineWordListSets(bashWordListDesc); } }; class QuoteCls { // Class to manage quote pairs (simplified vs LexPerl) public: int Count = 0; int Up = '\0'; int Down = '\0'; QuoteStyle Style = QuoteStyle::Literal; int Outer = SCE_SH_DEFAULT; CmdState State = CmdState::Body; void Clear() noexcept { Count = 0; Up = '\0'; Down = '\0'; Style = QuoteStyle::Literal; Outer = SCE_SH_DEFAULT; State = CmdState::Body; } void Start(int u, QuoteStyle s, int outer, CmdState state) noexcept { Count = 1; Up = u; Down = opposite(Up); Style = s; Outer = outer; State = state; } }; class QuoteStackCls { // Class to manage quote pairs that nest public: int Depth = 0; int State = SCE_SH_DEFAULT; bool lineContinuation = false; bool nestedBackticks = false; CommandSubstitution commandSubstitution = CommandSubstitution::Backtick; int insideCommand = 0; unsigned backtickLevel = 0; QuoteCls Current; QuoteCls Stack[BASH_QUOTE_STACK_MAX]; const CharacterSet &setParamStart; QuoteStackCls(const CharacterSet &setParamStart_) noexcept : setParamStart{setParamStart_} {} [[nodiscard]] bool Empty() const noexcept { return Current.Up == '\0'; } void Start(int u, QuoteStyle s, int outer, CmdState state) noexcept { if (Empty()) { Current.Start(u, s, outer, state); if (s == QuoteStyle::Backtick) { ++backtickLevel; } } else { Push(u, s, outer, state); } } void Push(int u, QuoteStyle s, int outer, CmdState state) noexcept { if (Depth >= BASH_QUOTE_STACK_MAX) { return; } Stack[Depth] = Current; Depth++; Current.Start(u, s, outer, state); if (s == QuoteStyle::Backtick) { ++backtickLevel; } } void Pop() noexcept { if (Depth == 0) { Clear(); return; } if (backtickLevel != 0 && Current.Style == QuoteStyle::Backtick) { --backtickLevel; } if (insideCommand != 0 && Current.Style == QuoteStyle::CommandInside) { insideCommand = 0; for (int i = 0; i < Depth; i++) { if (Stack[i].Style == QuoteStyle::CommandInside) { insideCommand = commandSubstitutionFlag; break; } } } Depth--; Current = Stack[Depth]; } void Clear() noexcept { Depth = 0; State = SCE_SH_DEFAULT; insideCommand = 0; backtickLevel = 0; Current.Clear(); } bool CountDown(StyleContext &sc, CmdState &cmdState) { Current.Count--; while (Current.Count > 0 && sc.chNext == Current.Down) { Current.Count--; sc.Forward(); } if (Current.Count == 0) { cmdState = Current.State; const int outer = Current.Outer; Pop(); sc.ForwardSetState(outer | insideCommand); return true; } return false; } void Expand(StyleContext &sc, CmdState &cmdState, bool stylingInside) { const CmdState current = cmdState; const int state = sc.state; QuoteStyle style = QuoteStyle::Literal; State = state; sc.SetState(SCE_SH_SCALAR); sc.Forward(); if (sc.ch == '{') { style = QuoteStyle::Parameter; sc.ChangeState(SCE_SH_PARAM); } else if (sc.ch == '\'') { style = QuoteStyle::CString; sc.ChangeState(SCE_SH_STRING); } else if (sc.ch == '"') { style = QuoteStyle::LString; sc.ChangeState(SCE_SH_STRING); } else if (sc.ch == '(' || sc.ch == '[') { if (sc.ch == '[' || sc.chNext == '(') { style = QuoteStyle::Arithmetic; cmdState = CmdState::Arithmetic; sc.ChangeState(SCE_SH_OPERATOR); } else { if (stylingInside && commandSubstitution >= CommandSubstitution::Inside) { style = QuoteStyle::CommandInside; cmdState = CmdState::Delimiter; sc.ChangeState(SCE_SH_OPERATOR); if (commandSubstitution == CommandSubstitution::InsideTrack) { insideCommand = commandSubstitutionFlag; } } else { style = QuoteStyle::Command; sc.ChangeState(SCE_SH_BACKTICKS); } } } else { // scalar has no delimiter pair if (!setParamStart.Contains(sc.ch)) { stylingInside = false; // not scalar } } if (!stylingInside) { sc.ChangeState(state); } else { sc.ChangeState(sc.state | insideCommand); } if (style != QuoteStyle::Literal) { Start(sc.ch, style, state, current); sc.Forward(); } } void Escape(StyleContext &sc) { unsigned count = 1; while (sc.chNext == '\\') { ++count; sc.Forward(); } bool escaped = count & 1U; // odd backslash escape next character if (escaped && (sc.chNext == '\r' || sc.chNext == '\n')) { lineContinuation = true; if (sc.state == SCE_SH_IDENTIFIER) { sc.SetState(SCE_SH_OPERATOR | insideCommand); } return; } if (backtickLevel > 0 && nestedBackticks) { /* for $k$ level substitution with $N$ backslashes: * when $N/2^k$ is odd, following dollar is escaped. * when $(N - 1)/2^k$ is even, following quote is escaped. * when $N = n\times 2^{k + 1} - 1$, following backtick is escaped. * when $N = n\times 2^{k + 1} + 2^k - 1$, following backtick starts inner substitution. * when $N = m\times 2^k + 2^{k - 1} - 1$ and $k > 1$, following backtick ends current substitution. */ if (sc.chNext == '$') { escaped = (count >> backtickLevel) & 1U; } else if (sc.chNext == '\"' || sc.chNext == '\'') { escaped = (((count - 1) >> backtickLevel) & 1U) == 0; } else if (sc.chNext == '`' && escaped) { unsigned mask = 1U << (backtickLevel + 1); count += 1; escaped = (count & (mask - 1)) == 0; if (!escaped) { unsigned remain = count - (mask >> 1U); if (static_cast(remain) >= 0 && (remain & (mask - 1)) == 0) { escaped = true; ++backtickLevel; } else if (backtickLevel > 1) { mask >>= 1U; remain = count - (mask >> 1U); if (static_cast(remain) >= 0 && (remain & (mask - 1)) == 0) { escaped = true; --backtickLevel; } } } } } if (escaped) { sc.Forward(); } } }; const char styleSubable[] = { SCE_SH_IDENTIFIER, SCE_SH_SCALAR, 0 }; const LexicalClass lexicalClasses[] = { // Lexer Bash SCLEX_BASH SCE_SH_: 0, "SCE_SH_DEFAULT", "default", "White space", 1, "SCE_SH_ERROR", "error", "Error", 2, "SCE_SH_COMMENTLINE", "comment line", "Line comment: #", 3, "SCE_SH_NUMBER", "literal numeric", "Number", 4, "SCE_SH_WORD", "keyword", "Keyword", 5, "SCE_SH_STRING", "literal string", "String", 6, "SCE_SH_CHARACTER", "literal string", "Single quoted string", 7, "SCE_SH_OPERATOR", "operator", "Operators", 8, "SCE_SH_IDENTIFIER", "identifier", "Identifiers", 9, "SCE_SH_SCALAR", "identifier", "Scalar variable", 10, "SCE_SH_PARAM", "identifier", "Parameter", 11, "SCE_SH_BACKTICKS", "literal string", "Backtick quoted command", 12, "SCE_SH_HERE_DELIM", "operator", "Heredoc delimiter", 13, "SCE_SH_HERE_Q", "here-doc literal string", "Heredoc quoted string", }; } class LexerBash final : public DefaultLexer { WordList keywords; WordList cmdDelimiter; WordList bashStruct; WordList bashStruct_in; WordList testOperator; OptionsBash options; OptionSetBash osBash; CharacterSet setParamStart; enum { ssIdentifier, ssScalar }; SubStyles subStyles{styleSubable}; public: LexerBash() : DefaultLexer("bash", SCLEX_BASH, lexicalClasses, std::size(lexicalClasses)), setParamStart(CharacterSet::setAlphaNum, "_" BASH_SPECIAL_PARAMETER) { cmdDelimiter.Set("| || |& & && ; ;; ( ) { }"); bashStruct.Set("if elif fi while until else then do done esac eval"); bashStruct_in.Set("for case select"); testOperator.Set("eq ge gt le lt ne ef nt ot"); } void SCI_METHOD Release() override { delete this; } int SCI_METHOD Version() const override { return lvRelease5; } const char * SCI_METHOD PropertyNames() override { return osBash.PropertyNames(); } int SCI_METHOD PropertyType(const char* name) override { return osBash.PropertyType(name); } const char * SCI_METHOD DescribeProperty(const char *name) override { return osBash.DescribeProperty(name); } Sci_Position SCI_METHOD PropertySet(const char *key, const char *val) override; const char * SCI_METHOD PropertyGet(const char* key) override { return osBash.PropertyGet(key); } const char * SCI_METHOD DescribeWordListSets() override { return osBash.DescribeWordListSets(); } Sci_Position SCI_METHOD WordListSet(int n, const char *wl) override; void SCI_METHOD Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void SCI_METHOD Fold(Sci_PositionU startPos_, Sci_Position length, int initStyle, IDocument *pAccess) override; void * SCI_METHOD PrivateCall(int, void *) override { return nullptr; } int SCI_METHOD AllocateSubStyles(int styleBase, int numberStyles) override { return subStyles.Allocate(styleBase, numberStyles); } int SCI_METHOD SubStylesStart(int styleBase) override { return subStyles.Start(styleBase); } int SCI_METHOD SubStylesLength(int styleBase) override { return subStyles.Length(styleBase); } int SCI_METHOD StyleFromSubStyle(int subStyle) override { const int styleBase = subStyles.BaseStyle(subStyle); return styleBase; } int SCI_METHOD PrimaryStyleFromStyle(int style) override { return style; } void SCI_METHOD FreeSubStyles() override { subStyles.Free(); } void SCI_METHOD SetIdentifiers(int style, const char *identifiers) override { subStyles.SetIdentifiers(style, identifiers); } int SCI_METHOD DistanceToSecondaryStyles() override { return 0; } const char *SCI_METHOD GetSubStyleBases() override { return styleSubable; } bool IsTestOperator(const char *s, const CharacterSet &setSingleCharOp) const noexcept { return (s[2] == '\0' && setSingleCharOp.Contains(s[1])) || testOperator.InList(s + 1); } static ILexer5 *LexerFactoryBash() { return new LexerBash(); } }; Sci_Position SCI_METHOD LexerBash::PropertySet(const char *key, const char *val) { if (osBash.PropertySet(&options, key, val)) { if (strcmp(key, "lexer.bash.special.parameter") == 0) { setParamStart = CharacterSet(CharacterSet::setAlphaNum, "_"); setParamStart.AddString(options.specialParameter.empty() ? BASH_SPECIAL_PARAMETER : options.specialParameter.c_str()); } return 0; } return -1; } Sci_Position SCI_METHOD LexerBash::WordListSet(int n, const char *wl) { WordList *wordListN = nullptr; switch (n) { case 0: wordListN = &keywords; break; } Sci_Position firstModification = -1; if (wordListN) { if (wordListN->Set(wl)) { firstModification = 0; } } return firstModification; } void SCI_METHOD LexerBash::Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { const CharacterSet setWordStart(CharacterSet::setAlpha, "_"); // note that [+-] are often parts of identifiers in shell scripts const CharacterSet setWord(CharacterSet::setAlphaNum, "._+-"); CharacterSet setMetaCharacter(CharacterSet::setNone, "|&;()<> \t\r\n"); setMetaCharacter.Add(0); const CharacterSet setBashOperator(CharacterSet::setNone, "^&%()-+=|{}[]:;>,*/(ch); Delimiter[DelimiterLength] = '\0'; } }; HereDocCls HereDoc; QuoteStackCls QuoteStack(setParamStart); QuoteStack.nestedBackticks = options.nestedBackticks; QuoteStack.commandSubstitution = options.commandSubstitution; const WordClassifier &classifierIdentifiers = subStyles.Classifier(SCE_SH_IDENTIFIER); const WordClassifier &classifierScalars = subStyles.Classifier(SCE_SH_SCALAR); int numBase = 0; int digit = 0; const Sci_PositionU endPos = startPos + length; CmdState cmdState = CmdState::Start; LexAccessor styler(pAccess); // Always backtracks to the start of a line that is not a continuation // of the previous line (i.e. start of a bash command segment) Sci_Position ln = styler.GetLine(startPos); if (ln > 0 && startPos == static_cast(styler.LineStart(ln))) ln--; for (;;) { startPos = styler.LineStart(ln); if (ln == 0 || styler.GetLineState(ln) == static_cast(CmdState::Start)) break; ln--; } initStyle = SCE_SH_DEFAULT; StyleContext sc(startPos, endPos - startPos, initStyle, styler); while (sc.More()) { // handle line continuation, updates per-line stored state if (sc.atLineStart) { CmdState state = CmdState::Body; // force backtrack while retaining cmdState if (!StyleForceBacktrack(MaskCommand(sc.state))) { // retain last line's state // arithmetic expression and double bracket test can span multiline without line continuation if (!QuoteStack.lineContinuation && !AnyOf(cmdState, CmdState::DoubleBracket, CmdState::Arithmetic)) { cmdState = CmdState::Start; } if (QuoteStack.Empty()) { // force backtrack when nesting state = cmdState; } } QuoteStack.lineContinuation = false; styler.SetLineState(sc.currentLine, static_cast(state)); } // controls change of cmdState at the end of a non-whitespace element // states Body|Test|Arithmetic persist until the end of a command segment // state Word persist, but ends with 'in' or 'do' construct keywords CmdState cmdStateNew = CmdState::Body; if (cmdState >= CmdState::Word && cmdState <= CmdState::Arithmetic) cmdStateNew = cmdState; const int stylePrev = MaskCommand(sc.state); const int insideCommand = QuoteStack.insideCommand; // Determine if the current state should terminate. switch (MaskCommand(sc.state)) { case SCE_SH_OPERATOR: sc.SetState(SCE_SH_DEFAULT | insideCommand); if (cmdState == CmdState::Delimiter) // if command delimiter, start new command cmdStateNew = CmdState::Start; else if (sc.chPrev == '\\') // propagate command state if line continued cmdStateNew = cmdState; break; case SCE_SH_WORD: // "." never used in Bash variable names but used in file names if (!setWord.Contains(sc.ch) || sc.Match('+', '=') || sc.Match('.', '.')) { char s[500]; sc.GetCurrent(s, sizeof(s)); int identifierStyle = SCE_SH_IDENTIFIER | insideCommand; const int subStyle = classifierIdentifiers.ValueFor(s); if (subStyle >= 0) { identifierStyle = subStyle | insideCommand; } // allow keywords ending in a whitespace, meta character or command delimiter char s2[10]; s2[0] = static_cast(sc.ch); s2[1] = '\0'; const bool keywordEnds = IsASpace(sc.ch) || setMetaCharacter.Contains(sc.ch) || cmdDelimiter.InList(s2); // 'in' or 'do' may be construct keywords if (cmdState == CmdState::Word) { if (strcmp(s, "in") == 0 && keywordEnds) cmdStateNew = CmdState::Body; else if (strcmp(s, "do") == 0 && keywordEnds) cmdStateNew = CmdState::Start; else sc.ChangeState(identifierStyle); sc.SetState(SCE_SH_DEFAULT | insideCommand); break; } // a 'test' keyword starts a test expression if (strcmp(s, "test") == 0) { if (cmdState == CmdState::Start && keywordEnds) { cmdStateNew = CmdState::Test; } else sc.ChangeState(identifierStyle); } // detect bash construct keywords else if (bashStruct.InList(s)) { if (cmdState == CmdState::Start && keywordEnds) cmdStateNew = CmdState::Start; else sc.ChangeState(identifierStyle); } // 'for'|'case'|'select' needs 'in'|'do' to be highlighted later else if (bashStruct_in.InList(s)) { if (cmdState == CmdState::Start && keywordEnds) cmdStateNew = CmdState::Word; else sc.ChangeState(identifierStyle); } // disambiguate option items and file test operators else if (s[0] == '-') { if (!AnyOf(cmdState, CmdState::Test, CmdState::SingleBracket, CmdState::DoubleBracket) || !keywordEnds || !IsTestOperator(s, setSingleCharOp)) sc.ChangeState(identifierStyle); } // disambiguate keywords and identifiers else if (cmdState != CmdState::Start || !(keywords.InList(s) && keywordEnds)) { sc.ChangeState(identifierStyle); } sc.SetState(SCE_SH_DEFAULT | insideCommand); } break; case SCE_SH_IDENTIFIER: if (!setWord.Contains(sc.ch) || (cmdState == CmdState::Arithmetic && !setWordStart.Contains(sc.ch))) { char s[500]; sc.GetCurrent(s, sizeof(s)); const int subStyle = classifierIdentifiers.ValueFor(s); if (subStyle >= 0) { sc.ChangeState(subStyle | insideCommand); } sc.SetState(SCE_SH_DEFAULT | insideCommand); } break; case SCE_SH_NUMBER: digit = translateBashDigit(sc.ch); if (numBase == BASH_BASE_DECIMAL) { if (sc.ch == '#') { char s[10]; sc.GetCurrent(s, sizeof(s)); numBase = getBashNumberBase(s); if (numBase != BASH_BASE_ERROR) break; } else if (IsADigit(sc.ch)) break; } else if (numBase == BASH_BASE_HEX) { if (IsADigit(sc.ch, 16)) break; #ifdef PEDANTIC_OCTAL } else if (numBase == BASH_BASE_OCTAL || numBase == BASH_BASE_OCTAL_ERROR) { if (digit <= 7) break; if (digit <= 9) { numBase = BASH_BASE_OCTAL_ERROR; break; } #endif } else if (numBase == BASH_BASE_ERROR) { if (digit <= 9) break; } else { // DD#DDDD number style handling if (digit != BASH_BASE_ERROR) { if (numBase <= 36) { // case-insensitive if base<=36 if (digit >= 36) digit -= 26; } if (digit < numBase) break; if (digit <= 9) { numBase = BASH_BASE_ERROR; break; } } } // fallthrough when number is at an end or error if (numBase == BASH_BASE_ERROR #ifdef PEDANTIC_OCTAL || numBase == BASH_BASE_OCTAL_ERROR #endif ) { sc.ChangeState(SCE_SH_ERROR | insideCommand); } else if (digit < 62 || digit == 63 || (cmdState != CmdState::Arithmetic && (sc.ch == '-' || (sc.ch == '.' && sc.chNext != '.')))) { // current character is alpha numeric, underscore, hyphen or dot sc.ChangeState(SCE_SH_IDENTIFIER | insideCommand); break; } sc.SetState(SCE_SH_DEFAULT | insideCommand); break; case SCE_SH_COMMENTLINE: if (sc.MatchLineEnd()) { sc.SetState(SCE_SH_DEFAULT | insideCommand); } break; case SCE_SH_HERE_DELIM: // From Bash info: // --------------- // Specifier format is: <<[-]WORD // Optional '-' is for removal of leading tabs from here-doc. // Whitespace acceptable after <<[-] operator // if (HereDoc.State == 0) { // '<<' encountered HereDoc.Quote = sc.chNext; HereDoc.Quoted = false; HereDoc.Escaped = false; HereDoc.DelimiterLength = 0; HereDoc.Delimiter[HereDoc.DelimiterLength] = '\0'; if (sc.chNext == '\'' || sc.chNext == '\"') { // a quoted here-doc delimiter (' or ") sc.Forward(); HereDoc.Quoted = true; HereDoc.State = 1; } else if (setHereDoc.Contains(sc.chNext) || (sc.chNext == '=' && cmdState != CmdState::Arithmetic)) { // an unquoted here-doc delimiter, no special handling HereDoc.State = 1; } else if (sc.chNext == '<') { // HERE string <<< sc.Forward(); sc.ForwardSetState(SCE_SH_DEFAULT | insideCommand); } else if (IsASpace(sc.chNext)) { // eat whitespace } else if (setLeftShift.Contains(sc.chNext) || (sc.chNext == '=' && cmdState == CmdState::Arithmetic)) { // left shift <<$var or <<= cases sc.ChangeState(SCE_SH_OPERATOR | insideCommand); sc.ForwardSetState(SCE_SH_DEFAULT | insideCommand); } else { // symbols terminates; deprecated zero-length delimiter HereDoc.State = 1; } } else if (HereDoc.State == 1) { // collect the delimiter // * if single quoted, there's no escape // * if double quoted, there are \\ and \" escapes if ((HereDoc.Quote == '\'' && sc.ch != HereDoc.Quote) || (HereDoc.Quoted && sc.ch != HereDoc.Quote && sc.ch != '\\') || (HereDoc.Quote != '\'' && sc.chPrev == '\\') || (setHereDoc2.Contains(sc.ch))) { HereDoc.Append(sc.ch); } else if (HereDoc.Quoted && sc.ch == HereDoc.Quote) { // closing quote => end of delimiter sc.ForwardSetState(SCE_SH_DEFAULT); } else if (sc.ch == '\\') { HereDoc.Escaped = true; if (HereDoc.Quoted && sc.chNext != HereDoc.Quote && sc.chNext != '\\') { // in quoted prefixes only \ and the quote eat the escape HereDoc.Append(sc.ch); } else { // skip escape prefix } } else if (!HereDoc.Quoted) { sc.SetState(SCE_SH_DEFAULT | insideCommand); } if (HereDoc.DelimiterLength >= HERE_DELIM_MAX - 1) { // force blowup sc.SetState(SCE_SH_ERROR | insideCommand); HereDoc.State = 0; } } break; case SCE_SH_SCALAR: // variable names if (!setParam.Contains(sc.ch)) { char s[500]; sc.GetCurrent(s, sizeof(s)); const int subStyle = classifierScalars.ValueFor(&s[1]); // skip the $ if (subStyle >= 0) { sc.ChangeState(subStyle | insideCommand); } if (sc.LengthCurrent() == 1) { // Special variable sc.Forward(); } sc.SetState(QuoteStack.State | insideCommand); continue; } break; case SCE_SH_HERE_Q: // HereDoc.State == 2 if (sc.atLineStart && QuoteStack.Current.Style == QuoteStyle::HereDoc) { sc.SetState(SCE_SH_HERE_Q | insideCommand); if (HereDoc.Indent) { // tabulation prefix while (sc.ch == '\t') { sc.Forward(); } } if ((static_cast(sc.currentPos + HereDoc.DelimiterLength) == sc.lineEnd) && (HereDoc.DelimiterLength == 0 || sc.Match(HereDoc.Delimiter))) { if (HereDoc.DelimiterLength != 0) { sc.SetState(SCE_SH_HERE_DELIM | insideCommand); while (!sc.MatchLineEnd()) { sc.Forward(); } } QuoteStack.Pop(); sc.SetState(SCE_SH_DEFAULT | QuoteStack.insideCommand); break; } } if (HereDoc.Quoted || HereDoc.Escaped) { break; } // fall through to handle nested shell expansions [[fallthrough]]; case SCE_SH_STRING: // delimited styles, can nest case SCE_SH_PARAM: // ${parameter} case SCE_SH_BACKTICKS: if (sc.ch == '\\') { if (QuoteStack.Current.Style != QuoteStyle::Literal) QuoteStack.Escape(sc); } else if (sc.ch == QuoteStack.Current.Down) { if (QuoteStack.CountDown(sc, cmdState)) { continue; } } else if (sc.ch == QuoteStack.Current.Up) { if (QuoteStack.Current.Style != QuoteStyle::Parameter) { QuoteStack.Current.Count++; } } else { if (QuoteStack.Current.Style == QuoteStyle::String || QuoteStack.Current.Style == QuoteStyle::HereDoc || QuoteStack.Current.Style == QuoteStyle::LString ) { // do nesting for "string", $"locale-string", heredoc const bool stylingInside = options.stylingInside(MaskCommand(sc.state)); if (sc.ch == '`') { QuoteStack.Push(sc.ch, QuoteStyle::Backtick, sc.state, cmdState); if (stylingInside) { sc.SetState(SCE_SH_BACKTICKS | insideCommand); } } else if (sc.ch == '$' && !AnyOf(sc.chNext, '\"', '\'')) { QuoteStack.Expand(sc, cmdState, stylingInside); continue; } } else if (QuoteStack.Current.Style == QuoteStyle::Command || QuoteStack.Current.Style == QuoteStyle::Parameter || QuoteStack.Current.Style == QuoteStyle::Backtick ) { // do nesting for $(command), `command`, ${parameter} const bool stylingInside = options.stylingInside(MaskCommand(sc.state)); if (sc.ch == '\'') { if (stylingInside) { QuoteStack.State = sc.state; sc.SetState(SCE_SH_CHARACTER | insideCommand); } else { QuoteStack.Push(sc.ch, QuoteStyle::Literal, sc.state, cmdState); } } else if (sc.ch == '\"') { QuoteStack.Push(sc.ch, QuoteStyle::String, sc.state, cmdState); if (stylingInside) { sc.SetState(SCE_SH_STRING | insideCommand); } } else if (sc.ch == '`') { QuoteStack.Push(sc.ch, QuoteStyle::Backtick, sc.state, cmdState); if (stylingInside) { sc.SetState(SCE_SH_BACKTICKS | insideCommand); } } else if (sc.ch == '$') { QuoteStack.Expand(sc, cmdState, stylingInside); continue; } } } break; case SCE_SH_CHARACTER: // singly-quoted strings if (sc.ch == '\'') { sc.ForwardSetState(QuoteStack.State | insideCommand); continue; } break; } // Must check end of HereDoc state 1 before default state is handled if (HereDoc.State == 1 && sc.MatchLineEnd()) { // Begin of here-doc (the line after the here-doc delimiter): // Lexically, the here-doc starts from the next line after the >>, but the // first line of here-doc seem to follow the style of the last EOL sequence HereDoc.State = 2; if (HereDoc.Quoted) { if (MaskCommand(sc.state) == SCE_SH_HERE_DELIM) { // Missing quote at end of string! Syntax error in bash 4.3 // Mark this bit as an error, do not colour any here-doc sc.ChangeState(SCE_SH_ERROR | insideCommand); sc.SetState(SCE_SH_DEFAULT | insideCommand); } else { // HereDoc.Quote always == '\'' sc.SetState(SCE_SH_HERE_Q | insideCommand); QuoteStack.Start(-1, QuoteStyle::HereDoc, SCE_SH_DEFAULT, cmdState); } } else if (HereDoc.DelimiterLength == 0) { // no delimiter, illegal (but '' and "" are legal) sc.ChangeState(SCE_SH_ERROR | insideCommand); sc.SetState(SCE_SH_DEFAULT | insideCommand); } else { sc.SetState(SCE_SH_HERE_Q | insideCommand); QuoteStack.Start(-1, QuoteStyle::HereDoc, SCE_SH_DEFAULT, cmdState); } } // update cmdState about the current command segment if (stylePrev != SCE_SH_DEFAULT && MaskCommand(sc.state) == SCE_SH_DEFAULT) { cmdState = cmdStateNew; } // Determine if a new state should be entered. if (MaskCommand(sc.state) == SCE_SH_DEFAULT) { if (sc.ch == '\\') { // Bash can escape any non-newline as a literal sc.SetState(SCE_SH_IDENTIFIER | insideCommand); QuoteStack.Escape(sc); } else if (IsADigit(sc.ch)) { sc.SetState(SCE_SH_NUMBER | insideCommand); numBase = BASH_BASE_DECIMAL; if (sc.ch == '0') { // hex,octal if (sc.chNext == 'x' || sc.chNext == 'X') { numBase = BASH_BASE_HEX; sc.Forward(); } else if (IsADigit(sc.chNext)) { #ifdef PEDANTIC_OCTAL numBase = BASH_BASE_OCTAL; #endif } } } else if (setWordStart.Contains(sc.ch)) { sc.SetState(((cmdState == CmdState::Arithmetic)? SCE_SH_IDENTIFIER : SCE_SH_WORD) | insideCommand); } else if (sc.ch == '#') { if (stylePrev != SCE_SH_WORD && stylePrev != SCE_SH_IDENTIFIER && (sc.currentPos == 0 || setMetaCharacter.Contains(sc.chPrev))) { sc.SetState(SCE_SH_COMMENTLINE | insideCommand); } else { sc.SetState(SCE_SH_WORD | insideCommand); } // handle some zsh features within arithmetic expressions only if (cmdState == CmdState::Arithmetic) { if (sc.chPrev == '[') { // [#8] [##8] output digit setting sc.SetState(SCE_SH_WORD | insideCommand); if (sc.chNext == '#') { sc.Forward(); } } else if (sc.Match("##^") && IsUpperCase(sc.GetRelative(3))) { // ##^A sc.SetState(SCE_SH_IDENTIFIER | insideCommand); sc.Forward(3); } else if (sc.chNext == '#' && !IsASpace(sc.GetRelative(2))) { // ##a sc.SetState(SCE_SH_IDENTIFIER | insideCommand); sc.Forward(2); } else if (setWordStart.Contains(sc.chNext)) { // #name sc.SetState(SCE_SH_IDENTIFIER | insideCommand); } } } else if (sc.ch == '\"') { sc.SetState(SCE_SH_STRING | insideCommand); QuoteStack.Start(sc.ch, QuoteStyle::String, SCE_SH_DEFAULT, cmdState); } else if (sc.ch == '\'') { QuoteStack.State = SCE_SH_DEFAULT; sc.SetState(SCE_SH_CHARACTER | insideCommand); } else if (sc.ch == '`') { sc.SetState(SCE_SH_BACKTICKS | insideCommand); QuoteStack.Start(sc.ch, QuoteStyle::Backtick, SCE_SH_DEFAULT, cmdState); } else if (sc.ch == '$') { QuoteStack.Expand(sc, cmdState, true); continue; } else if (cmdState != CmdState::Arithmetic && sc.Match('<', '<')) { sc.SetState(SCE_SH_HERE_DELIM | insideCommand); HereDoc.State = 0; if (sc.GetRelative(2) == '-') { // <<- indent case HereDoc.Indent = true; sc.Forward(); } else { HereDoc.Indent = false; } } else if (sc.ch == '-' && // test operator or short and long option cmdState != CmdState::Arithmetic && sc.chPrev != '~' && !IsADigit(sc.chNext)) { if (IsASpace(sc.chPrev) || setMetaCharacter.Contains(sc.chPrev)) { sc.SetState(SCE_SH_WORD | insideCommand); } else { sc.SetState(SCE_SH_IDENTIFIER | insideCommand); } } else if (setBashOperator.Contains(sc.ch)) { bool isCmdDelim = false; sc.SetState(SCE_SH_OPERATOR | insideCommand); // arithmetic expansion and command substitution if (QuoteStack.Current.Style == QuoteStyle::Arithmetic || QuoteStack.Current.Style == QuoteStyle::CommandInside) { if (sc.ch == QuoteStack.Current.Down) { if (QuoteStack.CountDown(sc, cmdState)) { continue; } } else if (sc.ch == QuoteStack.Current.Up) { QuoteStack.Current.Count++; } } // globs have no whitespace, do not appear in arithmetic expressions if (cmdState != CmdState::Arithmetic && sc.ch == '(' && sc.chNext != '(') { const int i = GlobScan(sc); if (i > 1) { sc.SetState(SCE_SH_IDENTIFIER | insideCommand); sc.Forward(i + 1); continue; } } // handle opening delimiters for test/arithmetic expressions - ((,[[,[ if (cmdState == CmdState::Start || cmdState == CmdState::Body) { if (sc.Match('(', '(')) { cmdState = CmdState::Arithmetic; sc.Forward(); } else if (sc.Match('[', '[') && IsASpace(sc.GetRelative(2))) { cmdState = CmdState::DoubleBracket; sc.Forward(); } else if (sc.ch == '[' && IsASpace(sc.chNext)) { cmdState = CmdState::SingleBracket; } } // special state -- for ((x;y;z)) in ... looping if (cmdState == CmdState::Word && sc.Match('(', '(')) { cmdState = CmdState::Arithmetic; sc.Forward(2); continue; } // handle command delimiters in command Start|Body|Word state, also Test if 'test' or '[]' if (cmdState < CmdState::DoubleBracket) { char s[10]; s[0] = static_cast(sc.ch); if (setBashOperator.Contains(sc.chNext)) { s[1] = static_cast(sc.chNext); s[2] = '\0'; isCmdDelim = cmdDelimiter.InList(s); if (isCmdDelim) sc.Forward(); } if (!isCmdDelim) { s[1] = '\0'; isCmdDelim = cmdDelimiter.InList(s); } if (isCmdDelim) { cmdState = CmdState::Delimiter; sc.Forward(); continue; } } // handle closing delimiters for test/arithmetic expressions - )),]],] if (cmdState == CmdState::Arithmetic && sc.Match(')', ')')) { cmdState = CmdState::Body; sc.Forward(); } else if (sc.ch == ']' && IsASpace(sc.chPrev)) { if (cmdState == CmdState::SingleBracket) { cmdState = CmdState::Body; } else if (cmdState == CmdState::DoubleBracket && sc.chNext == ']') { cmdState = CmdState::Body; sc.Forward(); } } } }// sc.state sc.Forward(); } sc.Complete(); if (MaskCommand(sc.state) == SCE_SH_HERE_Q) { styler.ChangeLexerState(sc.currentPos, styler.Length()); } sc.Complete(); } void SCI_METHOD LexerBash::Fold(Sci_PositionU startPos_, Sci_Position length, int initStyle, IDocument *pAccess) { if(!options.fold) return; LexAccessor styler(pAccess); Sci_Position startPos = startPos_; const Sci_Position endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); // Backtrack to previous line in case need to fix its fold status if (lineCurrent > 0) { lineCurrent--; startPos = styler.LineStart(lineCurrent); initStyle = (startPos > 0) ? styler.StyleIndexAt(startPos - 1) : 0; } int levelPrev = styler.LevelAt(lineCurrent) & SC_FOLDLEVELNUMBERMASK; int levelCurrent = levelPrev; char chNext = styler[startPos]; int styleNext = MaskCommand(styler.StyleIndexAt(startPos)); int style = MaskCommand(initStyle); char word[8] = { '\0' }; // we're not interested in long words anyway size_t wordlen = 0; for (Sci_Position i = startPos; i < endPos; i++) { const char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); const int stylePrev = style; style = styleNext; styleNext = MaskCommand(styler.StyleIndexAt(i + 1)); const bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); // Comment folding if (options.foldComment && atEOL && IsCommentLine(lineCurrent, styler)) { if (!IsCommentLine(lineCurrent - 1, styler) && IsCommentLine(lineCurrent + 1, styler)) levelCurrent++; else if (IsCommentLine(lineCurrent - 1, styler) && !IsCommentLine(lineCurrent + 1, styler)) levelCurrent--; } switch (style) { case SCE_SH_WORD: if ((wordlen + 1) < sizeof(word)) word[wordlen++] = ch; if (styleNext != style) { word[wordlen] = '\0'; wordlen = 0; if (InList(word, {"if", "case", "do"})) { levelCurrent++; } else if (InList(word, {"fi", "esac", "done"})) { levelCurrent--; } } break; case SCE_SH_OPERATOR: if (ch == '{') { levelCurrent++; } else if (ch == '}') { levelCurrent--; } break; // Here Document folding case SCE_SH_HERE_DELIM: if (stylePrev == SCE_SH_HERE_Q) { levelCurrent--; } else if (stylePrev != SCE_SH_HERE_DELIM) { if (ch == '<' && chNext == '<') { if (styler.SafeGetCharAt(i + 2) != '<') { levelCurrent++; } } } break; case SCE_SH_HERE_Q: if (styleNext == SCE_SH_DEFAULT) { levelCurrent--; } break; } if (atEOL) { int lev = levelPrev; if (visibleChars == 0 && options.foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if ((levelCurrent > levelPrev) && (visibleChars > 0)) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelPrev = levelCurrent; visibleChars = 0; } if (!isspacechar(ch)) visibleChars++; } // Fill in the real level of the next line, keeping the current flags as they will be filled in later const int flagsNext = styler.LevelAt(lineCurrent) & ~SC_FOLDLEVELNUMBERMASK; styler.SetLevel(lineCurrent, levelPrev | flagsNext); } LexerModule lmBash(SCLEX_BASH, LexerBash::LexerFactoryBash, "bash", bashWordListDesc); lexilla/lexers/LexMake.cxx0000664000175000017500000001042214647367374014552 0ustar neilneil// Scintilla source code edit control /** @file LexMake.cxx ** Lexer for make files. **/ // Copyright 1998-2001 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static inline bool AtEOL(Accessor &styler, Sci_PositionU i) { return (styler[i] == '\n') || ((styler[i] == '\r') && (styler.SafeGetCharAt(i + 1) != '\n')); } static void ColouriseMakeLine( const std::string &lineBuffer, Sci_PositionU startLine, Sci_PositionU endPos, Accessor &styler) { const Sci_PositionU lengthLine = lineBuffer.length(); Sci_PositionU i = 0; Sci_Position lastNonSpace = -1; unsigned int state = SCE_MAKE_DEFAULT; bool bSpecial = false; // check for a tab character in column 0 indicating a command bool bCommand = false; if ((lengthLine > 0) && (lineBuffer[0] == '\t')) bCommand = true; // Skip initial spaces while ((i < lengthLine) && isspacechar(lineBuffer[i])) { i++; } if (i < lengthLine) { if (lineBuffer[i] == '#') { // Comment styler.ColourTo(endPos, SCE_MAKE_COMMENT); return; } if (lineBuffer[i] == '!') { // Special directive styler.ColourTo(endPos, SCE_MAKE_PREPROCESSOR); return; } } int varCount = 0; while (i < lengthLine) { if (((i + 1) < lengthLine) && (lineBuffer[i] == '$' && lineBuffer[i + 1] == '(')) { styler.ColourTo(startLine + i - 1, state); state = SCE_MAKE_IDENTIFIER; varCount++; } else if (state == SCE_MAKE_IDENTIFIER && lineBuffer[i] == ')') { if (--varCount == 0) { styler.ColourTo(startLine + i, state); state = SCE_MAKE_DEFAULT; } } // skip identifier and target styling if this is a command line if (!bSpecial && !bCommand) { if (lineBuffer[i] == ':') { if (((i + 1) < lengthLine) && (lineBuffer[i + 1] == '=')) { // it's a ':=', so style as an identifier if (lastNonSpace >= 0) styler.ColourTo(startLine + lastNonSpace, SCE_MAKE_IDENTIFIER); styler.ColourTo(startLine + i - 1, SCE_MAKE_DEFAULT); styler.ColourTo(startLine + i + 1, SCE_MAKE_OPERATOR); } else { // We should check that no colouring was made since the beginning of the line, // to avoid colouring stuff like /OUT:file if (lastNonSpace >= 0) styler.ColourTo(startLine + lastNonSpace, SCE_MAKE_TARGET); styler.ColourTo(startLine + i - 1, SCE_MAKE_DEFAULT); styler.ColourTo(startLine + i, SCE_MAKE_OPERATOR); } bSpecial = true; // Only react to the first ':' of the line state = SCE_MAKE_DEFAULT; } else if (lineBuffer[i] == '=') { if (lastNonSpace >= 0) styler.ColourTo(startLine + lastNonSpace, SCE_MAKE_IDENTIFIER); styler.ColourTo(startLine + i - 1, SCE_MAKE_DEFAULT); styler.ColourTo(startLine + i, SCE_MAKE_OPERATOR); bSpecial = true; // Only react to the first '=' of the line state = SCE_MAKE_DEFAULT; } } if (!isspacechar(lineBuffer[i])) { lastNonSpace = i; } i++; } if (state == SCE_MAKE_IDENTIFIER) { styler.ColourTo(endPos, SCE_MAKE_IDEOL); // Error, variable reference not ended } else { styler.ColourTo(endPos, SCE_MAKE_DEFAULT); } } static void ColouriseMakeDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { std::string lineBuffer; styler.StartAt(startPos); styler.StartSegment(startPos); Sci_PositionU startLine = startPos; for (Sci_PositionU i = startPos; i < startPos + length; i++) { lineBuffer.push_back(styler[i]); if (AtEOL(styler, i)) { // End of line (or of line buffer) met, colourise it ColouriseMakeLine(lineBuffer, startLine, i, styler); lineBuffer.clear(); startLine = i + 1; } } if (!lineBuffer.empty()) { // Last line does not have ending characters ColouriseMakeLine(lineBuffer, startLine, startPos + length - 1, styler); } } static const char *const emptyWordListDesc[] = { nullptr }; LexerModule lmMake(SCLEX_MAKEFILE, ColouriseMakeDoc, "makefile", nullptr, emptyWordListDesc); lexilla/lexers/LexPS.cxx0000664000175000017500000003057114647367374014226 0ustar neilneil// Scintilla source code edit control /** @file LexPS.cxx ** Lexer for PostScript ** ** Written by Nigel Hathaway . ** The License.txt file describes the conditions under which this software may be distributed. **/ // Previous releases of this lexer included support for marking token starts with // a style byte indicator. This was used by the wxGhostscript IDE/debugger. // Style byte indicators were removed in version 3.4.3. // Anyone wanting to restore this functionality for wxGhostscript using 'modern' // indicators can examine the earlier source in the Mercurial repository. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static inline bool IsASelfDelimitingChar(const int ch) { return (ch == '[' || ch == ']' || ch == '{' || ch == '}' || ch == '/' || ch == '<' || ch == '>' || ch == '(' || ch == ')' || ch == '%'); } static inline bool IsAWhitespaceChar(const int ch) { return (ch == ' ' || ch == '\t' || ch == '\r' || ch == '\n' || ch == '\f' || ch == '\0'); } static bool IsABaseNDigit(const int ch, const int base) { int maxdig = '9'; int letterext = -1; if (base <= 10) maxdig = '0' + base - 1; else letterext = base - 11; return ((ch >= '0' && ch <= maxdig) || (ch >= 'A' && ch <= ('A' + letterext)) || (ch >= 'a' && ch <= ('a' + letterext))); } static inline bool IsABase85Char(const int ch) { return ((ch >= '!' && ch <= 'u') || ch == 'z'); } static void ColourisePSDoc( Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { WordList &keywords1 = *keywordlists[0]; WordList &keywords2 = *keywordlists[1]; WordList &keywords3 = *keywordlists[2]; WordList &keywords4 = *keywordlists[3]; WordList &keywords5 = *keywordlists[4]; StyleContext sc(startPos, length, initStyle, styler); // property ps.level // Define level (0..3) of PostScript handled and thus set of keywords. Default is 3. int pslevel = styler.GetPropertyInt("ps.level", 3); Sci_Position lineCurrent = styler.GetLine(startPos); int nestTextCurrent = 0; if (lineCurrent > 0 && initStyle == SCE_PS_TEXT) nestTextCurrent = styler.GetLineState(lineCurrent - 1); int numRadix = 0; bool numHasPoint = false; bool numHasExponent = false; bool numHasSign = false; for (; sc.More(); sc.Forward()) { if (sc.atLineStart) lineCurrent = styler.GetLine(sc.currentPos); // Determine if the current state should terminate. if (sc.state == SCE_PS_COMMENT || sc.state == SCE_PS_DSC_VALUE) { if (sc.atLineEnd) { sc.SetState(SCE_C_DEFAULT); } } else if (sc.state == SCE_PS_DSC_COMMENT) { if (sc.ch == ':') { sc.Forward(); if (!sc.atLineEnd) sc.SetState(SCE_PS_DSC_VALUE); else sc.SetState(SCE_C_DEFAULT); } else if (sc.atLineEnd) { sc.SetState(SCE_C_DEFAULT); } else if (IsAWhitespaceChar(sc.ch) && sc.ch != '\r') { sc.ChangeState(SCE_PS_COMMENT); } } else if (sc.state == SCE_PS_NUMBER) { if (IsASelfDelimitingChar(sc.ch) || IsAWhitespaceChar(sc.ch)) { if ((sc.chPrev == '+' || sc.chPrev == '-' || sc.chPrev == 'E' || sc.chPrev == 'e') && numRadix == 0) sc.ChangeState(SCE_PS_NAME); sc.SetState(SCE_C_DEFAULT); } else if (sc.ch == '#') { if (numHasPoint || numHasExponent || numHasSign || numRadix != 0) { sc.ChangeState(SCE_PS_NAME); } else { char szradix[5]; sc.GetCurrent(szradix, 4); numRadix = atoi(szradix); if (numRadix < 2 || numRadix > 36) sc.ChangeState(SCE_PS_NAME); } } else if ((sc.ch == 'E' || sc.ch == 'e') && numRadix == 0) { if (numHasExponent) { sc.ChangeState(SCE_PS_NAME); } else { numHasExponent = true; if (sc.chNext == '+' || sc.chNext == '-') sc.Forward(); } } else if (sc.ch == '.') { if (numHasPoint || numHasExponent || numRadix != 0) { sc.ChangeState(SCE_PS_NAME); } else { numHasPoint = true; } } else if (numRadix == 0) { if (!IsABaseNDigit(sc.ch, 10)) sc.ChangeState(SCE_PS_NAME); } else { if (!IsABaseNDigit(sc.ch, numRadix)) sc.ChangeState(SCE_PS_NAME); } } else if (sc.state == SCE_PS_NAME || sc.state == SCE_PS_KEYWORD) { if (IsASelfDelimitingChar(sc.ch) || IsAWhitespaceChar(sc.ch)) { char s[100]; sc.GetCurrent(s, sizeof(s)); if ((pslevel >= 1 && keywords1.InList(s)) || (pslevel >= 2 && keywords2.InList(s)) || (pslevel >= 3 && keywords3.InList(s)) || keywords4.InList(s) || keywords5.InList(s)) { sc.ChangeState(SCE_PS_KEYWORD); } sc.SetState(SCE_C_DEFAULT); } } else if (sc.state == SCE_PS_LITERAL || sc.state == SCE_PS_IMMEVAL) { if (IsASelfDelimitingChar(sc.ch) || IsAWhitespaceChar(sc.ch)) sc.SetState(SCE_C_DEFAULT); } else if (sc.state == SCE_PS_PAREN_ARRAY || sc.state == SCE_PS_PAREN_DICT || sc.state == SCE_PS_PAREN_PROC) { sc.SetState(SCE_C_DEFAULT); } else if (sc.state == SCE_PS_TEXT) { if (sc.ch == '(') { nestTextCurrent++; } else if (sc.ch == ')') { if (--nestTextCurrent == 0) sc.ForwardSetState(SCE_PS_DEFAULT); } else if (sc.ch == '\\') { sc.Forward(); } } else if (sc.state == SCE_PS_HEXSTRING) { if (sc.ch == '>') { sc.ForwardSetState(SCE_PS_DEFAULT); } else if (!IsABaseNDigit(sc.ch, 16) && !IsAWhitespaceChar(sc.ch)) { sc.SetState(SCE_PS_HEXSTRING); styler.ColourTo(sc.currentPos, SCE_PS_BADSTRINGCHAR); } } else if (sc.state == SCE_PS_BASE85STRING) { if (sc.Match('~', '>')) { sc.Forward(); sc.ForwardSetState(SCE_PS_DEFAULT); } else if (!IsABase85Char(sc.ch) && !IsAWhitespaceChar(sc.ch)) { sc.SetState(SCE_PS_BASE85STRING); styler.ColourTo(sc.currentPos, SCE_PS_BADSTRINGCHAR); } } // Determine if a new state should be entered. if (sc.state == SCE_C_DEFAULT) { if (sc.ch == '[' || sc.ch == ']') { sc.SetState(SCE_PS_PAREN_ARRAY); } else if (sc.ch == '{' || sc.ch == '}') { sc.SetState(SCE_PS_PAREN_PROC); } else if (sc.ch == '/') { if (sc.chNext == '/') { sc.SetState(SCE_PS_IMMEVAL); sc.Forward(); } else { sc.SetState(SCE_PS_LITERAL); } } else if (sc.ch == '<') { if (sc.chNext == '<') { sc.SetState(SCE_PS_PAREN_DICT); sc.Forward(); } else if (sc.chNext == '~') { sc.SetState(SCE_PS_BASE85STRING); sc.Forward(); } else { sc.SetState(SCE_PS_HEXSTRING); } } else if (sc.ch == '>' && sc.chNext == '>') { sc.SetState(SCE_PS_PAREN_DICT); sc.Forward(); } else if (sc.ch == '>' || sc.ch == ')') { sc.SetState(SCE_C_DEFAULT); styler.ColourTo(sc.currentPos, SCE_PS_BADSTRINGCHAR); } else if (sc.ch == '(') { sc.SetState(SCE_PS_TEXT); nestTextCurrent = 1; } else if (sc.ch == '%') { if (sc.chNext == '%' && sc.atLineStart) { sc.SetState(SCE_PS_DSC_COMMENT); sc.Forward(); if (sc.chNext == '+') { sc.Forward(); sc.ForwardSetState(SCE_PS_DSC_VALUE); } } else { sc.SetState(SCE_PS_COMMENT); } } else if ((sc.ch == '+' || sc.ch == '-' || sc.ch == '.') && IsABaseNDigit(sc.chNext, 10)) { sc.SetState(SCE_PS_NUMBER); numRadix = 0; numHasPoint = (sc.ch == '.'); numHasExponent = false; numHasSign = (sc.ch == '+' || sc.ch == '-'); } else if ((sc.ch == '+' || sc.ch == '-') && sc.chNext == '.' && IsABaseNDigit(sc.GetRelative(2), 10)) { sc.SetState(SCE_PS_NUMBER); numRadix = 0; numHasPoint = false; numHasExponent = false; numHasSign = true; } else if (IsABaseNDigit(sc.ch, 10)) { sc.SetState(SCE_PS_NUMBER); numRadix = 0; numHasPoint = false; numHasExponent = false; numHasSign = false; } else if (!IsAWhitespaceChar(sc.ch)) { sc.SetState(SCE_PS_NAME); } } if (sc.atLineEnd) styler.SetLineState(lineCurrent, nestTextCurrent); } sc.Complete(); } static void FoldPSDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; bool foldAtElse = styler.GetPropertyInt("fold.at.else", 0) != 0; Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelCurrent = SC_FOLDLEVELBASE; if (lineCurrent > 0) levelCurrent = styler.LevelAt(lineCurrent-1) >> 16; int levelMinCurrent = levelCurrent; int levelNext = levelCurrent; char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); int style = styleNext; styleNext = styler.StyleAt(i + 1); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); //mac?? if ((style & 31) == SCE_PS_PAREN_PROC) { if (ch == '{') { // Measure the minimum before a '{' to allow // folding on "} {" if (levelMinCurrent > levelNext) { levelMinCurrent = levelNext; } levelNext++; } else if (ch == '}') { levelNext--; } } if (atEOL) { int levelUse = levelCurrent; if (foldAtElse) { levelUse = levelMinCurrent; } int lev = levelUse | levelNext << 16; if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if (levelUse < levelNext) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelCurrent = levelNext; levelMinCurrent = levelCurrent; visibleChars = 0; } if (!isspacechar(ch)) visibleChars++; } } static const char * const psWordListDesc[] = { "PS Level 1 operators", "PS Level 2 operators", "PS Level 3 operators", "RIP-specific operators", "User-defined operators", 0 }; LexerModule lmPS(SCLEX_PS, ColourisePSDoc, "ps", FoldPSDoc, psWordListDesc); lexilla/lexers/LexKVIrc.cxx0000664000175000017500000003772314647367374014670 0ustar neilneil// Scintilla source code edit control /** @file LexKVIrc.cxx ** Lexer for KVIrc script. **/ // Copyright 2013 by OmegaPhil , based in // part from LexPython Copyright 1998-2002 by Neil Hodgson // and LexCmake Copyright 2007 by Cristian Adam // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; /* KVIrc Script syntactic rules: http://www.kvirc.net/doc/doc_syntactic_rules.html */ /* Utility functions */ static inline bool IsAWordChar(int ch) { /* Keyword list includes modules, i.e. words including '.', and * alias namespaces include ':' */ return (ch < 0x80) && (isalnum(ch) || ch == '_' || ch == '.' || ch == ':'); } static inline bool IsAWordStart(int ch) { /* Functions (start with '$') are treated separately to keywords */ return (ch < 0x80) && (isalnum(ch) || ch == '_' ); } /* Interface function called by Scintilla to request some text to be syntax highlighted */ static void ColouriseKVIrcDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { /* Fetching style context */ StyleContext sc(startPos, length, initStyle, styler); /* Accessing keywords and function-marking keywords */ WordList &keywords = *keywordlists[0]; WordList &functionKeywords = *keywordlists[1]; /* Looping for all characters - only automatically moving forward * when asked for (transitions leaving strings and keywords do this * already) */ bool next = true; for( ; sc.More(); next ? sc.Forward() : (void)0 ) { /* Resetting next */ next = true; /* Dealing with different states */ switch (sc.state) { case SCE_KVIRC_DEFAULT: /* Detecting single-line comments * Unfortunately KVIrc script allows raw '#' to be used, and appending # to an array returns * its length... * Going for a compromise where single line comments not * starting on a newline are allowed in all cases except * when they are preceeded with an opening bracket or comma * (this will probably be the most common style a valid * string-less channel name will be used with), with the * array length case included */ if ( (sc.ch == '#' && sc.atLineStart) || (sc.ch == '#' && ( sc.chPrev != '(' && sc.chPrev != ',' && sc.chPrev != ']') ) ) { sc.SetState(SCE_KVIRC_COMMENT); break; } /* Detecting multi-line comments */ if (sc.Match('/', '*')) { sc.SetState(SCE_KVIRC_COMMENTBLOCK); break; } /* Detecting strings */ if (sc.ch == '"') { sc.SetState(SCE_KVIRC_STRING); break; } /* Detecting functions */ if (sc.ch == '$') { sc.SetState(SCE_KVIRC_FUNCTION); break; } /* Detecting variables */ if (sc.ch == '%') { sc.SetState(SCE_KVIRC_VARIABLE); break; } /* Detecting numbers - isdigit is unsafe as it does not * validate, use CharacterSet.h functions */ if (IsADigit(sc.ch)) { sc.SetState(SCE_KVIRC_NUMBER); break; } /* Detecting words */ if (IsAWordStart(sc.ch) && IsAWordChar(sc.chNext)) { sc.SetState(SCE_KVIRC_WORD); sc.Forward(); break; } /* Detecting operators */ if (isoperator(sc.ch)) { sc.SetState(SCE_KVIRC_OPERATOR); break; } break; case SCE_KVIRC_COMMENT: /* Breaking out of single line comment when a newline * is introduced */ if (sc.ch == '\r' || sc.ch == '\n') { sc.SetState(SCE_KVIRC_DEFAULT); break; } break; case SCE_KVIRC_COMMENTBLOCK: /* Detecting end of multi-line comment */ if (sc.Match('*', '/')) { // Moving the current position forward two characters // so that '*/' is included in the comment sc.Forward(2); sc.SetState(SCE_KVIRC_DEFAULT); /* Comment has been exited and the current position * moved forward, yet the new current character * has yet to be defined - loop without moving * forward again */ next = false; break; } break; case SCE_KVIRC_STRING: /* Detecting end of string - closing speechmarks */ if (sc.ch == '"') { /* Allowing escaped speechmarks to pass */ if (sc.chPrev == '\\') break; /* Moving the current position forward to capture the * terminating speechmarks, and ending string */ sc.ForwardSetState(SCE_KVIRC_DEFAULT); /* String has been exited and the current position * moved forward, yet the new current character * has yet to be defined - loop without moving * forward again */ next = false; break; } /* Functions and variables are now highlighted in strings * Detecting functions */ if (sc.ch == '$') { /* Allowing escaped functions to pass */ if (sc.chPrev == '\\') break; sc.SetState(SCE_KVIRC_STRING_FUNCTION); break; } /* Detecting variables */ if (sc.ch == '%') { /* Allowing escaped variables to pass */ if (sc.chPrev == '\\') break; sc.SetState(SCE_KVIRC_STRING_VARIABLE); break; } /* Breaking out of a string when a newline is introduced */ if (sc.ch == '\r' || sc.ch == '\n') { /* Allowing escaped newlines */ if (sc.chPrev == '\\') break; sc.SetState(SCE_KVIRC_DEFAULT); break; } break; case SCE_KVIRC_FUNCTION: case SCE_KVIRC_VARIABLE: /* Detecting the end of a function/variable (word) */ if (!IsAWordChar(sc.ch)) { sc.SetState(SCE_KVIRC_DEFAULT); /* Word has been exited yet the current character * has yet to be defined - loop without moving * forward again */ next = false; break; } break; case SCE_KVIRC_STRING_FUNCTION: case SCE_KVIRC_STRING_VARIABLE: /* A function or variable in a string * Detecting the end of a function/variable (word) */ if (!IsAWordChar(sc.ch)) { sc.SetState(SCE_KVIRC_STRING); /* Word has been exited yet the current character * has yet to be defined - loop without moving * forward again */ next = false; break; } break; case SCE_KVIRC_NUMBER: /* Detecting the end of a number */ if (!IsADigit(sc.ch)) { sc.SetState(SCE_KVIRC_DEFAULT); /* Number has been exited yet the current character * has yet to be defined - loop without moving * forward */ next = false; break; } break; case SCE_KVIRC_OPERATOR: /* Because '%' is an operator but is also the marker for * a variable, I need to always treat operators as single * character strings and therefore redo their detection * after every character */ sc.SetState(SCE_KVIRC_DEFAULT); /* Operator has been exited yet the current character * has yet to be defined - loop without moving * forward */ next = false; break; case SCE_KVIRC_WORD: /* Detecting the end of a word */ if (!IsAWordChar(sc.ch)) { /* Checking if the word was actually a keyword - * fetching the current word, NULL-terminated like * the keyword list */ char s[100]; Sci_Position wordLen = sc.currentPos - styler.GetStartSegment(); if (wordLen > 99) wordLen = 99; /* Include '\0' in buffer */ Sci_Position i; for( i = 0; i < wordLen; ++i ) { s[i] = styler.SafeGetCharAt( styler.GetStartSegment() + i ); } s[wordLen] = '\0'; /* Actually detecting keywords and fixing the state */ if (keywords.InList(s)) { /* The SetState call actually commits the * previous keyword state */ sc.ChangeState(SCE_KVIRC_KEYWORD); } else if (functionKeywords.InList(s)) { // Detecting function keywords and fixing the state sc.ChangeState(SCE_KVIRC_FUNCTION_KEYWORD); } /* Transitioning to default and committing the previous * word state */ sc.SetState(SCE_KVIRC_DEFAULT); /* Word has been exited yet the current character * has yet to be defined - loop without moving * forward again */ next = false; break; } break; } } /* Indicating processing is complete */ sc.Complete(); } static void FoldKVIrcDoc(Sci_PositionU startPos, Sci_Position length, int /*initStyle - unused*/, WordList *[], Accessor &styler) { /* Based on CMake's folder */ /* Exiting if folding isnt enabled */ if ( styler.GetPropertyInt("fold") == 0 ) return; /* Obtaining current line number*/ Sci_Position currentLine = styler.GetLine(startPos); /* Obtaining starting character - indentation is done on a line basis, * not character */ Sci_PositionU safeStartPos = styler.LineStart( currentLine ); /* Initialising current level - this is defined as indentation level * in the low 12 bits, with flag bits in the upper four bits. * It looks like two indentation states are maintained in the returned * 32bit value - 'nextLevel' in the most-significant bits, 'currentLevel' * in the least-significant bits. Since the next level is the most * up to date, this must refer to the current state of indentation. * So the code bitshifts the old current level out of existence to * get at the actual current state of indentation * Based on the LexerCPP.cxx line 958 comment */ int currentLevel = SC_FOLDLEVELBASE; if (currentLine > 0) currentLevel = styler.LevelAt(currentLine - 1) >> 16; int nextLevel = currentLevel; // Looping for characters in range for (Sci_PositionU i = safeStartPos; i < startPos + length; ++i) { /* Folding occurs after syntax highlighting, meaning Scintilla * already knows where the comments are * Fetching the current state */ int state = styler.StyleAt(i) & 31; switch( styler.SafeGetCharAt(i) ) { case '{': /* Indenting only when the braces are not contained in * a comment */ if (state != SCE_KVIRC_COMMENT && state != SCE_KVIRC_COMMENTBLOCK) ++nextLevel; break; case '}': /* Outdenting only when the braces are not contained in * a comment */ if (state != SCE_KVIRC_COMMENT && state != SCE_KVIRC_COMMENTBLOCK) --nextLevel; break; case '\n': case '\r': /* Preparing indentation information to return - combining * current and next level data */ int lev = currentLevel | nextLevel << 16; /* If the next level increases the indent level, mark the * current line as a fold point - current level data is * in the least significant bits */ if (nextLevel > currentLevel ) lev |= SC_FOLDLEVELHEADERFLAG; /* Updating indentation level if needed */ if (lev != styler.LevelAt(currentLine)) styler.SetLevel(currentLine, lev); /* Updating variables */ ++currentLine; currentLevel = nextLevel; /* Dealing with problematic Windows newlines - * incrementing to avoid the extra newline breaking the * fold point */ if (styler.SafeGetCharAt(i) == '\r' && styler.SafeGetCharAt(i + 1) == '\n') ++i; break; } } /* At this point the data has ended, so presumably the end of the line? * Preparing indentation information to return - combining current * and next level data */ int lev = currentLevel | nextLevel << 16; /* If the next level increases the indent level, mark the current * line as a fold point - current level data is in the least * significant bits */ if (nextLevel > currentLevel ) lev |= SC_FOLDLEVELHEADERFLAG; /* Updating indentation level if needed */ if (lev != styler.LevelAt(currentLine)) styler.SetLevel(currentLine, lev); } /* Registering wordlists */ static const char *const kvircWordListDesc[] = { "primary", "function_keywords", 0 }; /* Registering functions and wordlists */ LexerModule lmKVIrc(SCLEX_KVIRC, ColouriseKVIrcDoc, "kvirc", FoldKVIrcDoc, kvircWordListDesc); lexilla/lexers/LexASY.cxx0000664000175000017500000001660314647367374014340 0ustar neilneil// Scintilla source code edit control // @file LexASY.cxx //Author: instanton (email: soft_share126com) // This lexer is for the Asymptote vector graphics language // https://en.wikipedia.org/wiki/Asymptote_(vector_graphics_language) // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static void ColouriseAsyDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { WordList &keywords = *keywordlists[0]; WordList &keywords2 = *keywordlists[1]; CharacterSet setWordStart(CharacterSet::setAlpha, "_", 0x80, true); CharacterSet setWord(CharacterSet::setAlphaNum, "._", 0x80, true); int visibleChars = 0; StyleContext sc(startPos, length, initStyle, styler); for (; sc.More(); sc.Forward()) { if (sc.atLineStart) { if (sc.state == SCE_ASY_STRING) { sc.SetState(SCE_ASY_STRING); } visibleChars = 0; } if (sc.ch == '\\') { if (sc.chNext == '\n' || sc.chNext == '\r') { sc.Forward(); if (sc.ch == '\r' && sc.chNext == '\n') { sc.Forward(); } // continuationLine = true; continue; } } // Determine if the current state should terminate. switch (sc.state) { case SCE_ASY_OPERATOR: sc.SetState(SCE_ASY_DEFAULT); break; case SCE_ASY_NUMBER: if (!setWord.Contains(sc.ch)) { sc.SetState(SCE_ASY_DEFAULT); } break; case SCE_ASY_IDENTIFIER: if (!setWord.Contains(sc.ch) || (sc.ch == '.')) { char s[1000]; sc.GetCurrentLowered(s, sizeof(s)); if (keywords.InList(s)) { sc.ChangeState(SCE_ASY_WORD); } else if (keywords2.InList(s)) { sc.ChangeState(SCE_ASY_WORD2); } sc.SetState(SCE_ASY_DEFAULT); } break; case SCE_ASY_COMMENT: if (sc.Match('*', '/')) { sc.Forward(); sc.ForwardSetState(SCE_ASY_DEFAULT); } break; case SCE_ASY_COMMENTLINE: if (sc.atLineStart) { sc.SetState(SCE_ASY_DEFAULT); } break; case SCE_ASY_STRING: if (sc.atLineEnd) { sc.ChangeState(SCE_ASY_STRINGEOL); } else if (sc.ch == '\\') { if (sc.chNext == '\"' || sc.chNext == '\'' || sc.chNext == '\\') { sc.Forward(); } } else if (sc.ch == '\"') { sc.ForwardSetState(SCE_ASY_DEFAULT); } break; case SCE_ASY_CHARACTER: if (sc.atLineEnd) { sc.ChangeState(SCE_ASY_STRINGEOL); } else if (sc.ch == '\\') { if (sc.chNext == '\"' || sc.chNext == '\'' || sc.chNext == '\\') { sc.Forward(); } } else if (sc.ch == '\'') { sc.ForwardSetState(SCE_ASY_DEFAULT); } break; } // Determine if a new state should be entered. if (sc.state == SCE_ASY_DEFAULT) { if (setWordStart.Contains(sc.ch) || (sc.ch == '@')) { sc.SetState(SCE_ASY_IDENTIFIER); } else if (sc.Match('/', '*')) { sc.SetState(SCE_ASY_COMMENT); sc.Forward(); // } else if (sc.Match('/', '/')) { sc.SetState(SCE_ASY_COMMENTLINE); } else if (sc.ch == '\"') { sc.SetState(SCE_ASY_STRING); } else if (sc.ch == '\'') { sc.SetState(SCE_ASY_CHARACTER); } else if (sc.ch == '#' && visibleChars == 0) { do { sc.Forward(); } while ((sc.ch == ' ' || sc.ch == '\t') && sc.More()); if (sc.atLineEnd) { sc.SetState(SCE_ASY_DEFAULT); } } else if (isoperator(static_cast(sc.ch))) { sc.SetState(SCE_ASY_OPERATOR); } } } sc.Complete(); } static bool IsAsyCommentStyle(int style) { return style == SCE_ASY_COMMENT; } static inline bool isASYidentifier(int ch) { return ((ch >= 'a') && (ch <= 'z')) || ((ch >= 'A') && (ch <= 'Z')) ; } static int ParseASYWord(Sci_PositionU pos, Accessor &styler, char *word) { int length=0; char ch=styler.SafeGetCharAt(pos); *word=0; while(isASYidentifier(ch) && length<100){ word[length]=ch; length++; ch=styler.SafeGetCharAt(pos+length); } word[length]=0; return length; } static bool IsASYDrawingLine(Sci_Position line, Accessor &styler) { Sci_Position pos = styler.LineStart(line); Sci_Position eol_pos = styler.LineStart(line + 1) - 1; Sci_Position startpos = pos; char buffer[100]=""; while (startpos 0) levelCurrent = styler.LevelAt(lineCurrent-1) >> 16; int levelMinCurrent = levelCurrent; int levelNext = levelCurrent; char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); int style = initStyle; for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); int stylePrev = style; style = styleNext; styleNext = styler.StyleAt(i + 1); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (foldComment && IsAsyCommentStyle(style)) { if (!IsAsyCommentStyle(stylePrev) && (stylePrev != SCE_ASY_COMMENTLINEDOC)) { levelNext++; } else if (!IsAsyCommentStyle(styleNext) && (styleNext != SCE_ASY_COMMENTLINEDOC) && !atEOL) { levelNext--; } } if (style == SCE_ASY_OPERATOR) { if (ch == '{') { if (levelMinCurrent > levelNext) { levelMinCurrent = levelNext; } levelNext++; } else if (ch == '}') { levelNext--; } } if (atEOL && IsASYDrawingLine(lineCurrent, styler)){ if (lineCurrent==0 && IsASYDrawingLine(lineCurrent + 1, styler)) levelNext++; else if (lineCurrent!=0 && !IsASYDrawingLine(lineCurrent - 1, styler) && IsASYDrawingLine(lineCurrent + 1, styler) ) levelNext++; else if (lineCurrent!=0 && IsASYDrawingLine(lineCurrent - 1, styler) && !IsASYDrawingLine(lineCurrent+1, styler)) levelNext--; } if (atEOL) { int levelUse = levelCurrent; if (foldAtElse) { levelUse = levelMinCurrent; } int lev = levelUse | levelNext << 16; if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if (levelUse < levelNext) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelCurrent = levelNext; levelMinCurrent = levelCurrent; visibleChars = 0; } if (!IsASpace(ch)) visibleChars++; } } static const char * const asyWordLists[] = { "Primary keywords and identifiers", "Secondary keywords and identifiers", 0, }; LexerModule lmASY(SCLEX_ASYMPTOTE, ColouriseAsyDoc, "asy", FoldAsyDoc, asyWordLists); lexilla/lexers/LexAsm.cxx0000664000175000017500000003360614647367374014426 0ustar neilneil// Scintilla source code edit control /** @file LexAsm.cxx ** Lexer for Assembler, just for the MASM syntax ** Written by The Black Horus ** Enhancements and NASM stuff by Kein-Hong Man, 2003-10 ** SCE_ASM_COMMENTBLOCK and SCE_ASM_CHARACTER are for future GNU as colouring ** Converted to lexer object and added further folding features/properties by "Udo Lechner" **/ // Copyright 1998-2003 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" #include "OptionSet.h" #include "DefaultLexer.h" using namespace Scintilla; using namespace Lexilla; static inline bool IsAWordChar(const int ch) { return (ch < 0x80) && (isalnum(ch) || ch == '.' || ch == '_' || ch == '?'); } static inline bool IsAWordStart(const int ch) { return (ch < 0x80) && (isalnum(ch) || ch == '_' || ch == '.' || ch == '%' || ch == '@' || ch == '$' || ch == '?'); } static inline bool IsAsmOperator(const int ch) { if ((ch < 0x80) && (isalnum(ch))) return false; // '.' left out as it is used to make up numbers if (ch == '*' || ch == '/' || ch == '-' || ch == '+' || ch == '(' || ch == ')' || ch == '=' || ch == '^' || ch == '[' || ch == ']' || ch == '<' || ch == '&' || ch == '>' || ch == ',' || ch == '|' || ch == '~' || ch == '%' || ch == ':') return true; return false; } static bool IsStreamCommentStyle(int style) { return style == SCE_ASM_COMMENTDIRECTIVE || style == SCE_ASM_COMMENTBLOCK; } static inline int LowerCase(int c) { if (c >= 'A' && c <= 'Z') return 'a' + c - 'A'; return c; } // An individual named option for use in an OptionSet // Options used for LexerAsm struct OptionsAsm { std::string delimiter; bool fold; bool foldSyntaxBased; bool foldCommentMultiline; bool foldCommentExplicit; std::string foldExplicitStart; std::string foldExplicitEnd; bool foldExplicitAnywhere; bool foldCompact; std::string commentChar; OptionsAsm() { delimiter = ""; fold = false; foldSyntaxBased = true; foldCommentMultiline = false; foldCommentExplicit = false; foldExplicitStart = ""; foldExplicitEnd = ""; foldExplicitAnywhere = false; foldCompact = true; commentChar = ""; } }; static const char * const asmWordListDesc[] = { "CPU instructions", "FPU instructions", "Registers", "Directives", "Directive operands", "Extended instructions", "Directives4Foldstart", "Directives4Foldend", 0 }; struct OptionSetAsm : public OptionSet { OptionSetAsm() { DefineProperty("lexer.asm.comment.delimiter", &OptionsAsm::delimiter, "Character used for COMMENT directive's delimiter, replacing the standard \"~\"."); DefineProperty("fold", &OptionsAsm::fold); DefineProperty("fold.asm.syntax.based", &OptionsAsm::foldSyntaxBased, "Set this property to 0 to disable syntax based folding."); DefineProperty("fold.asm.comment.multiline", &OptionsAsm::foldCommentMultiline, "Set this property to 1 to enable folding multi-line comments."); DefineProperty("fold.asm.comment.explicit", &OptionsAsm::foldCommentExplicit, "This option enables folding explicit fold points when using the Asm lexer. " "Explicit fold points allows adding extra folding by placing a ;{ comment at the start and a ;} " "at the end of a section that should fold."); DefineProperty("fold.asm.explicit.start", &OptionsAsm::foldExplicitStart, "The string to use for explicit fold start points, replacing the standard ;{."); DefineProperty("fold.asm.explicit.end", &OptionsAsm::foldExplicitEnd, "The string to use for explicit fold end points, replacing the standard ;}."); DefineProperty("fold.asm.explicit.anywhere", &OptionsAsm::foldExplicitAnywhere, "Set this property to 1 to enable explicit fold points anywhere, not just in line comments."); DefineProperty("fold.compact", &OptionsAsm::foldCompact); DefineProperty("lexer.as.comment.character", &OptionsAsm::commentChar, "Overrides the default comment character (which is ';' for asm and '#' for as)."); DefineWordListSets(asmWordListDesc); } }; class LexerAsm : public DefaultLexer { WordList cpuInstruction; WordList mathInstruction; WordList registers; WordList directive; WordList directiveOperand; WordList extInstruction; WordList directives4foldstart; WordList directives4foldend; OptionsAsm options; OptionSetAsm osAsm; int commentChar; public: LexerAsm(const char *languageName_, int language_, int commentChar_) : DefaultLexer(languageName_, language_) { commentChar = commentChar_; } virtual ~LexerAsm() { } void SCI_METHOD Release() override { delete this; } int SCI_METHOD Version() const override { return lvRelease5; } const char * SCI_METHOD PropertyNames() override { return osAsm.PropertyNames(); } int SCI_METHOD PropertyType(const char *name) override { return osAsm.PropertyType(name); } const char * SCI_METHOD DescribeProperty(const char *name) override { return osAsm.DescribeProperty(name); } Sci_Position SCI_METHOD PropertySet(const char *key, const char *val) override; const char * SCI_METHOD PropertyGet(const char *key) override { return osAsm.PropertyGet(key); } const char * SCI_METHOD DescribeWordListSets() override { return osAsm.DescribeWordListSets(); } Sci_Position SCI_METHOD WordListSet(int n, const char *wl) override; void SCI_METHOD Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void SCI_METHOD Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void * SCI_METHOD PrivateCall(int, void *) override { return 0; } static ILexer5 *LexerFactoryAsm() { return new LexerAsm("asm", SCLEX_ASM, ';'); } static ILexer5 *LexerFactoryAs() { return new LexerAsm("as", SCLEX_AS, '#'); } }; Sci_Position SCI_METHOD LexerAsm::PropertySet(const char *key, const char *val) { if (osAsm.PropertySet(&options, key, val)) { return 0; } return -1; } Sci_Position SCI_METHOD LexerAsm::WordListSet(int n, const char *wl) { WordList *wordListN = 0; switch (n) { case 0: wordListN = &cpuInstruction; break; case 1: wordListN = &mathInstruction; break; case 2: wordListN = ®isters; break; case 3: wordListN = &directive; break; case 4: wordListN = &directiveOperand; break; case 5: wordListN = &extInstruction; break; case 6: wordListN = &directives4foldstart; break; case 7: wordListN = &directives4foldend; break; } Sci_Position firstModification = -1; if (wordListN) { if (wordListN->Set(wl)) { firstModification = 0; } } return firstModification; } void SCI_METHOD LexerAsm::Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { LexAccessor styler(pAccess); const char commentCharacter = options.commentChar.empty() ? commentChar : options.commentChar.front(); // Do not leak onto next line if (initStyle == SCE_ASM_STRINGEOL) initStyle = SCE_ASM_DEFAULT; StyleContext sc(startPos, length, initStyle, styler); for (; sc.More(); sc.Forward()) { if (sc.atLineStart) { switch (sc.state) { case SCE_ASM_STRING: case SCE_ASM_CHARACTER: // Prevent SCE_ASM_STRINGEOL from leaking back to previous line sc.SetState(sc.state); break; case SCE_ASM_COMMENT: sc.SetState(SCE_ASM_DEFAULT); break; default: break; } } // Handle line continuation generically. if (sc.ch == '\\') { if (sc.chNext == '\n' || sc.chNext == '\r') { sc.Forward(); if (sc.ch == '\r' && sc.chNext == '\n') { sc.Forward(); } continue; } } // Determine if the current state should terminate. if (sc.state == SCE_ASM_OPERATOR) { if (!IsAsmOperator(sc.ch)) { sc.SetState(SCE_ASM_DEFAULT); } } else if (sc.state == SCE_ASM_NUMBER) { if (!IsAWordChar(sc.ch)) { sc.SetState(SCE_ASM_DEFAULT); } } else if (sc.state == SCE_ASM_IDENTIFIER) { if (!IsAWordChar(sc.ch) ) { char s[100]; sc.GetCurrentLowered(s, sizeof(s)); bool IsDirective = false; if (cpuInstruction.InList(s)) { sc.ChangeState(SCE_ASM_CPUINSTRUCTION); } else if (mathInstruction.InList(s)) { sc.ChangeState(SCE_ASM_MATHINSTRUCTION); } else if (registers.InList(s)) { sc.ChangeState(SCE_ASM_REGISTER); } else if (directive.InList(s)) { sc.ChangeState(SCE_ASM_DIRECTIVE); IsDirective = true; } else if (directiveOperand.InList(s)) { sc.ChangeState(SCE_ASM_DIRECTIVEOPERAND); } else if (extInstruction.InList(s)) { sc.ChangeState(SCE_ASM_EXTINSTRUCTION); } sc.SetState(SCE_ASM_DEFAULT); if (IsDirective && !strcmp(s, "comment")) { char delimiter = options.delimiter.empty() ? '~' : options.delimiter.c_str()[0]; while (IsASpaceOrTab(sc.ch) && !sc.atLineEnd) { sc.ForwardSetState(SCE_ASM_DEFAULT); } if (sc.ch == delimiter) { sc.SetState(SCE_ASM_COMMENTDIRECTIVE); } } } } else if (sc.state == SCE_ASM_COMMENTDIRECTIVE) { char delimiter = options.delimiter.empty() ? '~' : options.delimiter.c_str()[0]; if (sc.ch == delimiter) { while (!sc.MatchLineEnd()) { sc.Forward(); } sc.SetState(SCE_ASM_DEFAULT); } } else if (sc.state == SCE_ASM_STRING) { if (sc.ch == '\\') { if (sc.chNext == '\"' || sc.chNext == '\'' || sc.chNext == '\\') { sc.Forward(); } } else if (sc.ch == '\"') { sc.ForwardSetState(SCE_ASM_DEFAULT); } else if (sc.atLineEnd) { sc.ChangeState(SCE_ASM_STRINGEOL); sc.ForwardSetState(SCE_ASM_DEFAULT); } } else if (sc.state == SCE_ASM_CHARACTER) { if (sc.ch == '\\') { if (sc.chNext == '\"' || sc.chNext == '\'' || sc.chNext == '\\') { sc.Forward(); } } else if (sc.ch == '\'') { sc.ForwardSetState(SCE_ASM_DEFAULT); } else if (sc.atLineEnd) { sc.ChangeState(SCE_ASM_STRINGEOL); sc.ForwardSetState(SCE_ASM_DEFAULT); } } // Determine if a new state should be entered. if (sc.state == SCE_ASM_DEFAULT) { if (sc.ch == commentCharacter) { sc.SetState(SCE_ASM_COMMENT); } else if (IsASCII(sc.ch) && (isdigit(sc.ch) || (sc.ch == '.' && IsASCII(sc.chNext) && isdigit(sc.chNext)))) { sc.SetState(SCE_ASM_NUMBER); } else if (IsAWordStart(sc.ch)) { sc.SetState(SCE_ASM_IDENTIFIER); } else if (sc.ch == '\"') { sc.SetState(SCE_ASM_STRING); } else if (sc.ch == '\'') { sc.SetState(SCE_ASM_CHARACTER); } else if (IsAsmOperator(sc.ch)) { sc.SetState(SCE_ASM_OPERATOR); } } } sc.Complete(); } // Store both the current line's fold level and the next lines in the // level store to make it easy to pick up with each increment // and to make it possible to fiddle the current level for "else". void SCI_METHOD LexerAsm::Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { if (!options.fold) return; LexAccessor styler(pAccess); Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelCurrent = SC_FOLDLEVELBASE; if (lineCurrent > 0) levelCurrent = styler.LevelAt(lineCurrent-1) >> 16; int levelNext = levelCurrent; char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); int style = initStyle; char word[100]; int wordlen = 0; const bool userDefinedFoldMarkers = !options.foldExplicitStart.empty() && !options.foldExplicitEnd.empty(); for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); int stylePrev = style; style = styleNext; styleNext = styler.StyleAt(i + 1); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (options.foldCommentMultiline && IsStreamCommentStyle(style)) { if (!IsStreamCommentStyle(stylePrev)) { levelNext++; } else if (!IsStreamCommentStyle(styleNext) && !atEOL) { // Comments don't end at end of line and the next character may be unstyled. levelNext--; } } if (options.foldCommentExplicit && ((style == SCE_ASM_COMMENT) || options.foldExplicitAnywhere)) { if (userDefinedFoldMarkers) { if (styler.Match(i, options.foldExplicitStart.c_str())) { levelNext++; } else if (styler.Match(i, options.foldExplicitEnd.c_str())) { levelNext--; } } else { if (ch == ';') { if (chNext == '{') { levelNext++; } else if (chNext == '}') { levelNext--; } } } } if (options.foldSyntaxBased && (style == SCE_ASM_DIRECTIVE)) { word[wordlen++] = static_cast(LowerCase(ch)); if (wordlen == 100) { // prevent overflow word[0] = '\0'; wordlen = 1; } if (styleNext != SCE_ASM_DIRECTIVE) { // reading directive ready word[wordlen] = '\0'; wordlen = 0; if (directives4foldstart.InList(word)) { levelNext++; } else if (directives4foldend.InList(word)){ levelNext--; } } } if (!IsASpace(ch)) visibleChars++; if (atEOL || (i == endPos-1)) { int levelUse = levelCurrent; int lev = levelUse | levelNext << 16; if (visibleChars == 0 && options.foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if (levelUse < levelNext) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelCurrent = levelNext; if (atEOL && (i == static_cast(styler.Length() - 1))) { // There is an empty line at end of file so give it same level and empty styler.SetLevel(lineCurrent, (levelCurrent | levelCurrent << 16) | SC_FOLDLEVELWHITEFLAG); } visibleChars = 0; } } } LexerModule lmAsm(SCLEX_ASM, LexerAsm::LexerFactoryAsm, "asm", asmWordListDesc); LexerModule lmAs(SCLEX_AS, LexerAsm::LexerFactoryAs, "as", asmWordListDesc); lexilla/lexers/LexMySQL.cxx0000664000175000017500000004435214647367374014653 0ustar neilneil/** * Scintilla source code edit control * @file LexMySQL.cxx * Lexer for MySQL * * Improved by Mike Lischke * Adopted from LexSQL.cxx by Anders Karlsson * Original work by Neil Hodgson * Copyright 1998-2005 by Neil Hodgson * The License.txt file describes the conditions under which this software may be distributed. */ #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static inline bool IsAWordChar(int ch) { return (ch < 0x80) && (isalnum(ch) || ch == '_'); } static inline bool IsAWordStart(int ch) { return (ch < 0x80) && (isalpha(ch) || ch == '_'); } static inline bool IsANumberChar(int ch) { // Not exactly following number definition (several dots are seen as OK, etc.) // but probably enough in most cases. return (ch < 0x80) && (isdigit(ch) || toupper(ch) == 'E' || ch == '.' || ch == '-' || ch == '+'); } //-------------------------------------------------------------------------------------------------- /** * Check if the current content context represent a keyword and set the context state if so. */ static void CheckForKeyword(StyleContext& sc, WordList* keywordlists[], int activeState) { Sci_Position length = sc.LengthCurrent() + 1; // +1 for the next char char* s = new char[length]; sc.GetCurrentLowered(s, length); if (keywordlists[0]->InList(s)) sc.ChangeState(SCE_MYSQL_MAJORKEYWORD | activeState); else if (keywordlists[1]->InList(s)) sc.ChangeState(SCE_MYSQL_KEYWORD | activeState); else if (keywordlists[2]->InList(s)) sc.ChangeState(SCE_MYSQL_DATABASEOBJECT | activeState); else if (keywordlists[3]->InList(s)) sc.ChangeState(SCE_MYSQL_FUNCTION | activeState); else if (keywordlists[5]->InList(s)) sc.ChangeState(SCE_MYSQL_PROCEDUREKEYWORD | activeState); else if (keywordlists[6]->InList(s)) sc.ChangeState(SCE_MYSQL_USER1 | activeState); else if (keywordlists[7]->InList(s)) sc.ChangeState(SCE_MYSQL_USER2 | activeState); else if (keywordlists[8]->InList(s)) sc.ChangeState(SCE_MYSQL_USER3 | activeState); delete [] s; } //-------------------------------------------------------------------------------------------------- #define HIDDENCOMMAND_STATE 0x40 // Offset for states within a hidden command. #define MASKACTIVE(style) (style & ~HIDDENCOMMAND_STATE) static void SetDefaultState(StyleContext& sc, int activeState) { if (activeState == 0) sc.SetState(SCE_MYSQL_DEFAULT); else sc.SetState(SCE_MYSQL_HIDDENCOMMAND); } static void ForwardDefaultState(StyleContext& sc, int activeState) { if (activeState == 0) sc.ForwardSetState(SCE_MYSQL_DEFAULT); else sc.ForwardSetState(SCE_MYSQL_HIDDENCOMMAND); } static void ColouriseMySQLDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { StyleContext sc(startPos, length, initStyle, styler, 127); int activeState = (initStyle == SCE_MYSQL_HIDDENCOMMAND) ? HIDDENCOMMAND_STATE : initStyle & HIDDENCOMMAND_STATE; for (; sc.More(); sc.Forward()) { // Determine if the current state should terminate. switch (MASKACTIVE(sc.state)) { case SCE_MYSQL_OPERATOR: SetDefaultState(sc, activeState); break; case SCE_MYSQL_NUMBER: // We stop the number definition on non-numerical non-dot non-eE non-sign char. if (!IsANumberChar(sc.ch)) SetDefaultState(sc, activeState); break; case SCE_MYSQL_IDENTIFIER: // Switch from identifier to keyword state and open a new state for the new char. if (!IsAWordChar(sc.ch)) { CheckForKeyword(sc, keywordlists, activeState); // Additional check for function keywords needed. // A function name must be followed by an opening parenthesis. if (MASKACTIVE(sc.state) == SCE_MYSQL_FUNCTION && sc.ch != '(') { if (activeState > 0) sc.ChangeState(SCE_MYSQL_HIDDENCOMMAND); else sc.ChangeState(SCE_MYSQL_DEFAULT); } SetDefaultState(sc, activeState); } break; case SCE_MYSQL_VARIABLE: if (!IsAWordChar(sc.ch)) SetDefaultState(sc, activeState); break; case SCE_MYSQL_SYSTEMVARIABLE: if (!IsAWordChar(sc.ch)) { Sci_Position length = sc.LengthCurrent() + 1; char* s = new char[length]; sc.GetCurrentLowered(s, length); // Check for known system variables here. if (keywordlists[4]->InList(&s[2])) sc.ChangeState(SCE_MYSQL_KNOWNSYSTEMVARIABLE | activeState); delete [] s; SetDefaultState(sc, activeState); } break; case SCE_MYSQL_QUOTEDIDENTIFIER: if (sc.ch == '`') { if (sc.chNext == '`') sc.Forward(); // Ignore it else ForwardDefaultState(sc, activeState); } break; case SCE_MYSQL_COMMENT: if (sc.Match('*', '/')) { sc.Forward(); ForwardDefaultState(sc, activeState); } break; case SCE_MYSQL_COMMENTLINE: if (sc.atLineStart) SetDefaultState(sc, activeState); break; case SCE_MYSQL_SQSTRING: if (sc.ch == '\\') sc.Forward(); // Escape sequence else if (sc.ch == '\'') { // End of single quoted string reached? if (sc.chNext == '\'') sc.Forward(); else ForwardDefaultState(sc, activeState); } break; case SCE_MYSQL_DQSTRING: if (sc.ch == '\\') sc.Forward(); // Escape sequence else if (sc.ch == '\"') { // End of single quoted string reached? if (sc.chNext == '\"') sc.Forward(); else ForwardDefaultState(sc, activeState); } break; case SCE_MYSQL_PLACEHOLDER: if (sc.Match('}', '>')) { sc.Forward(); ForwardDefaultState(sc, activeState); } break; } if (sc.state == SCE_MYSQL_HIDDENCOMMAND && sc.Match('*', '/')) { activeState = 0; sc.Forward(); ForwardDefaultState(sc, activeState); } // Determine if a new state should be entered. if (sc.state == SCE_MYSQL_DEFAULT || sc.state == SCE_MYSQL_HIDDENCOMMAND) { switch (sc.ch) { case '@': if (sc.chNext == '@') { sc.SetState(SCE_MYSQL_SYSTEMVARIABLE | activeState); sc.Forward(2); // Skip past @@. } else if (IsAWordStart(sc.ch)) { sc.SetState(SCE_MYSQL_VARIABLE | activeState); sc.Forward(); // Skip past @. } else sc.SetState(SCE_MYSQL_OPERATOR | activeState); break; case '`': sc.SetState(SCE_MYSQL_QUOTEDIDENTIFIER | activeState); break; case '#': sc.SetState(SCE_MYSQL_COMMENTLINE | activeState); break; case '\'': sc.SetState(SCE_MYSQL_SQSTRING | activeState); break; case '\"': sc.SetState(SCE_MYSQL_DQSTRING | activeState); break; default: if (IsADigit(sc.ch) || (sc.ch == '.' && IsADigit(sc.chNext))) sc.SetState(SCE_MYSQL_NUMBER | activeState); else if (IsAWordStart(sc.ch)) sc.SetState(SCE_MYSQL_IDENTIFIER | activeState); else if (sc.Match('/', '*')) { sc.SetState(SCE_MYSQL_COMMENT | activeState); // Skip first char of comment introducer and check for hidden command. // The second char is skipped by the outer loop. sc.Forward(); if (sc.GetRelativeCharacter(1) == '!') { // Version comment found. Skip * now. sc.Forward(); activeState = HIDDENCOMMAND_STATE; sc.ChangeState(SCE_MYSQL_HIDDENCOMMAND); } } else if (sc.Match('<', '{')) { sc.SetState(SCE_MYSQL_PLACEHOLDER | activeState); } else if (sc.Match("--")) { // Special MySQL single line comment. sc.SetState(SCE_MYSQL_COMMENTLINE | activeState); sc.Forward(2); // Check the third character too. It must be a space or EOL. if (sc.ch != ' ' && sc.ch != '\n' && sc.ch != '\r') sc.ChangeState(SCE_MYSQL_OPERATOR | activeState); } else if (isoperator(static_cast(sc.ch))) sc.SetState(SCE_MYSQL_OPERATOR | activeState); } } } // Do a final check for keywords if we currently have an identifier, to highlight them // also at the end of a line. if (sc.state == SCE_MYSQL_IDENTIFIER) { CheckForKeyword(sc, keywordlists, activeState); // Additional check for function keywords needed. // A function name must be followed by an opening parenthesis. if (sc.state == SCE_MYSQL_FUNCTION && sc.ch != '(') SetDefaultState(sc, activeState); } sc.Complete(); } //-------------------------------------------------------------------------------------------------- /** * Helper function to determine if we have a foldable comment currently. */ static bool IsStreamCommentStyle(int style) { return MASKACTIVE(style) == SCE_MYSQL_COMMENT; } //-------------------------------------------------------------------------------------------------- /** * Code copied from StyleContext and modified to work here. Should go into Accessor as a * companion to Match()... */ static bool MatchIgnoreCase(Accessor &styler, Sci_Position currentPos, const char *s) { for (Sci_Position n = 0; *s; n++) { if (*s != tolower(styler.SafeGetCharAt(currentPos + n))) return false; s++; } return true; } //-------------------------------------------------------------------------------------------------- // Store both the current line's fold level and the next lines in the // level store to make it easy to pick up with each increment. static void FoldMySQLDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *[], Accessor &styler) { bool foldComment = styler.GetPropertyInt("fold.comment") != 0; bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; bool foldOnlyBegin = styler.GetPropertyInt("fold.sql.only.begin", 0) != 0; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelCurrent = SC_FOLDLEVELBASE; if (lineCurrent > 0) levelCurrent = styler.LevelAt(lineCurrent - 1) >> 16; int levelNext = levelCurrent; int styleNext = styler.StyleAt(startPos); int style = initStyle; int activeState = (style == SCE_MYSQL_HIDDENCOMMAND) ? HIDDENCOMMAND_STATE : style & HIDDENCOMMAND_STATE; bool endPending = false; bool whenPending = false; bool elseIfPending = false; char nextChar = styler.SafeGetCharAt(startPos); for (Sci_PositionU i = startPos; length > 0; i++, length--) { int stylePrev = style; int lastActiveState = activeState; style = styleNext; styleNext = styler.StyleAt(i + 1); activeState = (style == SCE_MYSQL_HIDDENCOMMAND) ? HIDDENCOMMAND_STATE : style & HIDDENCOMMAND_STATE; char currentChar = nextChar; nextChar = styler.SafeGetCharAt(i + 1); bool atEOL = (currentChar == '\r' && nextChar != '\n') || (currentChar == '\n'); switch (MASKACTIVE(style)) { case SCE_MYSQL_COMMENT: if (foldComment) { // Multiline comment style /* .. */ just started or is still in progress. if (IsStreamCommentStyle(style) && !IsStreamCommentStyle(stylePrev)) levelNext++; } break; case SCE_MYSQL_COMMENTLINE: if (foldComment) { // Not really a standard, but we add support for single line comments // with special curly braces syntax as foldable comments too. // MySQL needs -- comments to be followed by space or control char if (styler.Match(i, "--")) { char chNext2 = styler.SafeGetCharAt(i + 2); char chNext3 = styler.SafeGetCharAt(i + 3); if (chNext2 == '{' || chNext3 == '{') levelNext++; else if (chNext2 == '}' || chNext3 == '}') levelNext--; } } break; case SCE_MYSQL_HIDDENCOMMAND: /* if (endPending) { // A conditional command is not a white space so it should end the current block // before opening a new one. endPending = false; levelNext--; if (levelNext < SC_FOLDLEVELBASE) levelNext = SC_FOLDLEVELBASE; } }*/ if (activeState != lastActiveState) levelNext++; break; case SCE_MYSQL_OPERATOR: if (endPending) { endPending = false; levelNext--; if (levelNext < SC_FOLDLEVELBASE) levelNext = SC_FOLDLEVELBASE; } if (currentChar == '(') levelNext++; else if (currentChar == ')') { levelNext--; if (levelNext < SC_FOLDLEVELBASE) levelNext = SC_FOLDLEVELBASE; } break; case SCE_MYSQL_MAJORKEYWORD: case SCE_MYSQL_KEYWORD: case SCE_MYSQL_FUNCTION: case SCE_MYSQL_PROCEDUREKEYWORD: // Reserved and other keywords. if (style != stylePrev) { // END decreases the folding level, regardless which keyword follows. bool endFound = MatchIgnoreCase(styler, i, "end"); if (endPending) { levelNext--; if (levelNext < SC_FOLDLEVELBASE) levelNext = SC_FOLDLEVELBASE; } else if (!endFound) { if (MatchIgnoreCase(styler, i, "begin")) levelNext++; else { if (!foldOnlyBegin) { bool whileFound = MatchIgnoreCase(styler, i, "while"); bool loopFound = MatchIgnoreCase(styler, i, "loop"); bool repeatFound = MatchIgnoreCase(styler, i, "repeat"); bool caseFound = MatchIgnoreCase(styler, i, "case"); if (whileFound || loopFound || repeatFound || caseFound) levelNext++; else { // IF alone does not increase the fold level as it is also used in non-block'ed // code like DROP PROCEDURE blah IF EXISTS. // Instead THEN opens the new level (if not part of an ELSEIF or WHEN (case) branch). if (MatchIgnoreCase(styler, i, "then")) { if (!elseIfPending && !whenPending) levelNext++; else { elseIfPending = false; whenPending = false; } } else { // Neither of if/then/while/loop/repeat/case, so check for // sub parts of IF and CASE. if (MatchIgnoreCase(styler, i, "elseif")) elseIfPending = true; if (MatchIgnoreCase(styler, i, "when")) whenPending = true; } } } } } // Keep the current end state for the next round. endPending = endFound; } break; default: if (!isspacechar(currentChar) && endPending) { // END followed by a non-whitespace character (not covered by other cases like identifiers) // also should end a folding block. Typical case: END followed by self defined delimiter. levelNext--; if (levelNext < SC_FOLDLEVELBASE) levelNext = SC_FOLDLEVELBASE; } break; } // Go up one level if we just ended a multi line comment. if (IsStreamCommentStyle(stylePrev) && !IsStreamCommentStyle(style)) { levelNext--; if (levelNext < SC_FOLDLEVELBASE) levelNext = SC_FOLDLEVELBASE; } if (activeState == 0 && lastActiveState != 0) { // Decrease fold level when we left a hidden command. levelNext--; if (levelNext < SC_FOLDLEVELBASE) levelNext = SC_FOLDLEVELBASE; } if (atEOL) { // Apply the new folding level to this line. // Leave pending states as they are otherwise a line break will de-sync // code folding and valid syntax. int levelUse = levelCurrent; int lev = levelUse | levelNext << 16; if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if (levelUse < levelNext) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) styler.SetLevel(lineCurrent, lev); lineCurrent++; levelCurrent = levelNext; visibleChars = 0; } if (!isspacechar(currentChar)) visibleChars++; } } //-------------------------------------------------------------------------------------------------- static const char * const mysqlWordListDesc[] = { "Major Keywords", "Keywords", "Database Objects", "Functions", "System Variables", "Procedure keywords", "User Keywords 1", "User Keywords 2", "User Keywords 3", 0 }; LexerModule lmMySQL(SCLEX_MYSQL, ColouriseMySQLDoc, "mysql", FoldMySQLDoc, mysqlWordListDesc); lexilla/lexers/LexTCL.cxx0000664000175000017500000002605714647367374014332 0ustar neilneil// Scintilla source code edit control /** @file LexTCL.cxx ** Lexer for TCL language. **/ // Copyright 1998-2001 by Andre Arpin // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; // Extended to accept accented characters static inline bool IsAWordChar(int ch) { return ch >= 0x80 || (isalnum(ch) || ch == '_' || ch ==':' || ch=='.'); // : name space separator } static inline bool IsAWordStart(int ch) { return ch >= 0x80 || (ch ==':' || isalpha(ch) || ch == '_'); } static inline bool IsANumberChar(int ch) { // Not exactly following number definition (several dots are seen as OK, etc.) // but probably enough in most cases. return (ch < 0x80) && (IsADigit(ch, 0x10) || toupper(ch) == 'E' || ch == '.' || ch == '-' || ch == '+'); } static void ColouriseTCLDoc(Sci_PositionU startPos, Sci_Position length, int , WordList *keywordlists[], Accessor &styler) { #define isComment(s) (s==SCE_TCL_COMMENT || s==SCE_TCL_COMMENTLINE || s==SCE_TCL_COMMENT_BOX || s==SCE_TCL_BLOCK_COMMENT) const bool foldComment = styler.GetPropertyInt("fold.comment") != 0; const bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; bool commentLevel = false; bool subBrace = false; // substitution begin with a brace ${.....} enum tLineState {LS_DEFAULT, LS_OPEN_COMMENT, LS_OPEN_DOUBLE_QUOTE, LS_COMMENT_BOX, LS_MASK_STATE = 0xf, LS_COMMAND_EXPECTED = 16, LS_BRACE_ONLY = 32 } lineState = LS_DEFAULT; bool prevSlash = false; int currentLevel = 0; bool expected = 0; bool subParen = 0; Sci_Position currentLine = styler.GetLine(startPos); if (currentLine > 0) currentLine--; length += startPos - styler.LineStart(currentLine); // make sure lines overlap startPos = styler.LineStart(currentLine); WordList &keywords = *keywordlists[0]; WordList &keywords2 = *keywordlists[1]; WordList &keywords3 = *keywordlists[2]; WordList &keywords4 = *keywordlists[3]; WordList &keywords5 = *keywordlists[4]; WordList &keywords6 = *keywordlists[5]; WordList &keywords7 = *keywordlists[6]; WordList &keywords8 = *keywordlists[7]; WordList &keywords9 = *keywordlists[8]; if (currentLine > 0) { int ls = styler.GetLineState(currentLine - 1); lineState = tLineState(ls & LS_MASK_STATE); expected = LS_COMMAND_EXPECTED == tLineState(ls & LS_COMMAND_EXPECTED); subBrace = LS_BRACE_ONLY == tLineState(ls & LS_BRACE_ONLY); currentLevel = styler.LevelAt(currentLine - 1) >> 17; commentLevel = (styler.LevelAt(currentLine - 1) >> 16) & 1; } else styler.SetLevel(0, SC_FOLDLEVELBASE | SC_FOLDLEVELHEADERFLAG); bool visibleChars = false; int previousLevel = currentLevel; StyleContext sc(startPos, length, SCE_TCL_DEFAULT, styler); for (; ; sc.Forward()) { next: if (sc.ch=='\r' && sc.chNext == '\n') // only ignore \r on PC process on the mac continue; bool atEnd = !sc.More(); // make sure we coloured the last word if (lineState != LS_DEFAULT) { sc.SetState(SCE_TCL_DEFAULT); if (lineState == LS_OPEN_COMMENT) sc.SetState(SCE_TCL_COMMENTLINE); else if (lineState == LS_OPEN_DOUBLE_QUOTE) sc.SetState(SCE_TCL_IN_QUOTE); else if (lineState == LS_COMMENT_BOX && (sc.ch == '#' || (sc.ch == ' ' && sc.chNext=='#'))) sc.SetState(SCE_TCL_COMMENT_BOX); lineState = LS_DEFAULT; } if (subBrace) { // ${ overrides every thing even \ except } if (sc.ch == '}') { subBrace = false; sc.SetState(SCE_TCL_OPERATOR); sc.ForwardSetState(SCE_TCL_DEFAULT); goto next; } else sc.SetState(SCE_TCL_SUB_BRACE); if (!sc.atLineEnd) continue; } else if (sc.state == SCE_TCL_DEFAULT || sc.state ==SCE_TCL_OPERATOR) { expected &= isspacechar(static_cast(sc.ch)) || IsAWordStart(sc.ch) || sc.ch =='#'; } else if (sc.state == SCE_TCL_SUBSTITUTION) { switch (sc.ch) { case '(': subParen=true; sc.SetState(SCE_TCL_OPERATOR); sc.ForwardSetState(SCE_TCL_SUBSTITUTION); continue; case ')': sc.SetState(SCE_TCL_OPERATOR); subParen=false; continue; case '$': continue; case ',': sc.SetState(SCE_TCL_OPERATOR); if (subParen) { sc.ForwardSetState(SCE_TCL_SUBSTITUTION); goto next; // Already forwarded so avoid loop's Forward() } continue; default : // maybe spaces should be allowed ??? if (!IsAWordChar(sc.ch)) { // probably the code is wrong sc.SetState(SCE_TCL_DEFAULT); subParen = 0; } break; } } else if (isComment(sc.state)) { } else if (!IsAWordChar(sc.ch)) { if ((sc.state == SCE_TCL_IDENTIFIER && expected) || sc.state == SCE_TCL_MODIFIER) { char w[100]; sc.GetCurrent(w, sizeof(w)); char *s=w; if (w[strlen(w)-1]=='\r') w[strlen(w)-1]=0; while (*s == ':') // ignore leading : like in ::set a 10 ++s; bool quote = sc.state == SCE_TCL_IN_QUOTE; if (commentLevel || expected) { if (keywords.InList(s)) { sc.ChangeState(quote ? SCE_TCL_WORD_IN_QUOTE : SCE_TCL_WORD); } else if (keywords2.InList(s)) { sc.ChangeState(quote ? SCE_TCL_WORD_IN_QUOTE : SCE_TCL_WORD2); } else if (keywords3.InList(s)) { sc.ChangeState(quote ? SCE_TCL_WORD_IN_QUOTE : SCE_TCL_WORD3); } else if (keywords4.InList(s)) { sc.ChangeState(quote ? SCE_TCL_WORD_IN_QUOTE : SCE_TCL_WORD4); } else if (sc.GetRelative(-static_cast(strlen(s))-1) == '{' && keywords5.InList(s) && sc.ch == '}') { // {keyword} exactly no spaces sc.ChangeState(SCE_TCL_EXPAND); } if (keywords6.InList(s)) { sc.ChangeState(SCE_TCL_WORD5); } else if (keywords7.InList(s)) { sc.ChangeState(SCE_TCL_WORD6); } else if (keywords8.InList(s)) { sc.ChangeState(SCE_TCL_WORD7); } else if (keywords9.InList(s)) { sc.ChangeState(SCE_TCL_WORD8); } } expected = false; sc.SetState(quote ? SCE_TCL_IN_QUOTE : SCE_TCL_DEFAULT); } else if (sc.state == SCE_TCL_MODIFIER || sc.state == SCE_TCL_IDENTIFIER) { sc.SetState(SCE_TCL_DEFAULT); } } if (atEnd) break; if (sc.atLineEnd) { lineState = LS_DEFAULT; currentLine = styler.GetLine(sc.currentPos); if (foldComment && sc.state!=SCE_TCL_COMMENT && isComment(sc.state)) { if (currentLevel == 0) { ++currentLevel; commentLevel = true; } } else { if (visibleChars && commentLevel) { --currentLevel; --previousLevel; commentLevel = false; } } int flag = 0; if (!visibleChars && foldCompact) flag = SC_FOLDLEVELWHITEFLAG; if (currentLevel > previousLevel) flag = SC_FOLDLEVELHEADERFLAG; styler.SetLevel(currentLine, flag + previousLevel + SC_FOLDLEVELBASE + (currentLevel << 17) + (commentLevel << 16)); // Update the line state, so it can be seen by next line if (sc.state == SCE_TCL_IN_QUOTE) { lineState = LS_OPEN_DOUBLE_QUOTE; } else { if (prevSlash) { if (isComment(sc.state)) lineState = LS_OPEN_COMMENT; } else if (sc.state == SCE_TCL_COMMENT_BOX) lineState = LS_COMMENT_BOX; } styler.SetLineState(currentLine, (subBrace ? LS_BRACE_ONLY : 0) | (expected ? LS_COMMAND_EXPECTED : 0) | lineState); if (lineState == LS_COMMENT_BOX) sc.ForwardSetState(SCE_TCL_COMMENT_BOX); else if (lineState == LS_OPEN_DOUBLE_QUOTE) sc.ForwardSetState(SCE_TCL_IN_QUOTE); else sc.ForwardSetState(SCE_TCL_DEFAULT); prevSlash = false; previousLevel = currentLevel; visibleChars = false; goto next; } if (prevSlash) { prevSlash = false; if (sc.ch == '#' && IsANumberChar(sc.chNext)) sc.ForwardSetState(SCE_TCL_NUMBER); continue; } prevSlash = sc.ch == '\\'; if (isComment(sc.state)) continue; if (sc.atLineStart) { visibleChars = false; if (sc.state!=SCE_TCL_IN_QUOTE && !isComment(sc.state)) { sc.SetState(SCE_TCL_DEFAULT); expected = IsAWordStart(sc.ch)|| isspacechar(static_cast(sc.ch)); } } switch (sc.state) { case SCE_TCL_NUMBER: if (!IsANumberChar(sc.ch)) sc.SetState(SCE_TCL_DEFAULT); break; case SCE_TCL_IN_QUOTE: if (sc.ch == '"') { sc.ForwardSetState(SCE_TCL_DEFAULT); visibleChars = true; // necessary if a " is the first and only character on a line goto next; } else if (sc.ch == '[' || sc.ch == ']' || sc.ch == '$') { sc.SetState(SCE_TCL_OPERATOR); expected = sc.ch == '['; sc.ForwardSetState(SCE_TCL_IN_QUOTE); goto next; } continue; case SCE_TCL_OPERATOR: sc.SetState(SCE_TCL_DEFAULT); break; } if (sc.ch == '#') { if (visibleChars) { if (sc.state != SCE_TCL_IN_QUOTE && expected) sc.SetState(SCE_TCL_COMMENT); } else { sc.SetState(SCE_TCL_COMMENTLINE); if (sc.chNext == '~') sc.SetState(SCE_TCL_BLOCK_COMMENT); if (sc.atLineStart && (sc.chNext == '#' || sc.chNext == '-')) sc.SetState(SCE_TCL_COMMENT_BOX); } } if (!isspacechar(static_cast(sc.ch))) { visibleChars = true; } if (sc.ch == '\\') { prevSlash = true; continue; } // Determine if a new state should be entered. if (sc.state == SCE_TCL_DEFAULT) { if (IsAWordStart(sc.ch)) { sc.SetState(SCE_TCL_IDENTIFIER); } else if (IsADigit(sc.ch) && !IsAWordChar(sc.chPrev)) { sc.SetState(SCE_TCL_NUMBER); } else { switch (sc.ch) { case '\"': sc.SetState(SCE_TCL_IN_QUOTE); break; case '{': sc.SetState(SCE_TCL_OPERATOR); expected = true; ++currentLevel; break; case '}': sc.SetState(SCE_TCL_OPERATOR); expected = true; --currentLevel; break; case '[': expected = true; [[fallthrough]]; case ']': case '(': case ')': sc.SetState(SCE_TCL_OPERATOR); break; case ';': expected = true; break; case '$': subParen = 0; if (sc.chNext != '{') { sc.SetState(SCE_TCL_SUBSTITUTION); } else { sc.SetState(SCE_TCL_OPERATOR); // $ sc.Forward(); // { sc.ForwardSetState(SCE_TCL_SUB_BRACE); subBrace = true; } break; case '#': if ((isspacechar(static_cast(sc.chPrev))|| isoperator(static_cast(sc.chPrev))) && IsADigit(sc.chNext,0x10)) sc.SetState(SCE_TCL_NUMBER); break; case '-': sc.SetState(IsADigit(sc.chNext)? SCE_TCL_NUMBER: SCE_TCL_MODIFIER); break; default: if (isoperator(static_cast(sc.ch))) { sc.SetState(SCE_TCL_OPERATOR); } } } } } sc.Complete(); } static const char *const tclWordListDesc[] = { "TCL Keywords", "TK Keywords", "iTCL Keywords", "tkCommands", "expand", "user1", "user2", "user3", "user4", 0 }; // this code supports folding in the colourizer LexerModule lmTCL(SCLEX_TCL, ColouriseTCLDoc, "tcl", 0, tclWordListDesc); lexilla/lexers/LexGAP.cxx0000664000175000017500000001555114647367374014314 0ustar neilneil// Scintilla source code edit control /** @file LexGAP.cxx ** Lexer for the GAP language. (The GAP System for Computational Discrete Algebra) ** http://www.gap-system.org **/ // Copyright 2007 by Istvan Szollosi ( szteven gmail com ) // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static inline bool IsGAPOperator(char ch) { if (IsASCII(ch) && isalnum(ch)) return false; if (ch == '+' || ch == '-' || ch == '*' || ch == '/' || ch == '^' || ch == ',' || ch == '!' || ch == '.' || ch == '=' || ch == '<' || ch == '>' || ch == '(' || ch == ')' || ch == ';' || ch == '[' || ch == ']' || ch == '{' || ch == '}' || ch == ':' ) return true; return false; } static void GetRange(Sci_PositionU start, Sci_PositionU end, Accessor &styler, char *s, Sci_PositionU len) { Sci_PositionU i = 0; while ((i < end - start + 1) && (i < len-1)) { s[i] = static_cast(styler[start + i]); i++; } s[i] = '\0'; } static void ColouriseGAPDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { WordList &keywords1 = *keywordlists[0]; WordList &keywords2 = *keywordlists[1]; WordList &keywords3 = *keywordlists[2]; WordList &keywords4 = *keywordlists[3]; // Do not leak onto next line if (initStyle == SCE_GAP_STRINGEOL) initStyle = SCE_GAP_DEFAULT; StyleContext sc(startPos, length, initStyle, styler); for (; sc.More(); sc.Forward()) { // Prevent SCE_GAP_STRINGEOL from leaking back to previous line if ( sc.atLineStart ) { if (sc.state == SCE_GAP_STRING) sc.SetState(SCE_GAP_STRING); if (sc.state == SCE_GAP_CHAR) sc.SetState(SCE_GAP_CHAR); } // Handle line continuation generically if (sc.ch == '\\' ) { if (sc.chNext == '\n' || sc.chNext == '\r') { sc.Forward(); if (sc.ch == '\r' && sc.chNext == '\n') { sc.Forward(); } continue; } } // Determine if the current state should terminate switch (sc.state) { case SCE_GAP_OPERATOR : sc.SetState(SCE_GAP_DEFAULT); break; case SCE_GAP_NUMBER : if (!IsADigit(sc.ch)) { if (sc.ch == '\\') { if (!sc.atLineEnd) { if (!IsADigit(sc.chNext)) { sc.Forward(); sc.ChangeState(SCE_GAP_IDENTIFIER); } } } else if (isalpha(sc.ch) || sc.ch == '_') { sc.ChangeState(SCE_GAP_IDENTIFIER); } else sc.SetState(SCE_GAP_DEFAULT); } break; case SCE_GAP_IDENTIFIER : if (!(iswordstart(static_cast(sc.ch)) || sc.ch == '$')) { if (sc.ch == '\\') sc.Forward(); else { char s[1000]; sc.GetCurrent(s, sizeof(s)); if (keywords1.InList(s)) { sc.ChangeState(SCE_GAP_KEYWORD); } else if (keywords2.InList(s)) { sc.ChangeState(SCE_GAP_KEYWORD2); } else if (keywords3.InList(s)) { sc.ChangeState(SCE_GAP_KEYWORD3); } else if (keywords4.InList(s)) { sc.ChangeState(SCE_GAP_KEYWORD4); } sc.SetState(SCE_GAP_DEFAULT); } } break; case SCE_GAP_COMMENT : if (sc.atLineEnd) { sc.SetState(SCE_GAP_DEFAULT); } break; case SCE_GAP_STRING: if (sc.atLineEnd) { sc.ChangeState(SCE_GAP_STRINGEOL); } else if (sc.ch == '\\') { if (sc.chNext == '\"' || sc.chNext == '\'' || sc.chNext == '\\') { sc.Forward(); } } else if (sc.ch == '\"') { sc.ForwardSetState(SCE_GAP_DEFAULT); } break; case SCE_GAP_CHAR: if (sc.atLineEnd) { sc.ChangeState(SCE_GAP_STRINGEOL); } else if (sc.ch == '\\') { if (sc.chNext == '\"' || sc.chNext == '\'' || sc.chNext == '\\') { sc.Forward(); } } else if (sc.ch == '\'') { sc.ForwardSetState(SCE_GAP_DEFAULT); } break; case SCE_GAP_STRINGEOL: if (sc.atLineStart) { sc.SetState(SCE_GAP_DEFAULT); } break; } // Determine if a new state should be entered if (sc.state == SCE_GAP_DEFAULT) { if (IsGAPOperator(static_cast(sc.ch))) { sc.SetState(SCE_GAP_OPERATOR); } else if (IsADigit(sc.ch)) { sc.SetState(SCE_GAP_NUMBER); } else if (isalpha(sc.ch) || sc.ch == '_' || sc.ch == '\\' || sc.ch == '$' || sc.ch == '~') { sc.SetState(SCE_GAP_IDENTIFIER); if (sc.ch == '\\') sc.Forward(); } else if (sc.ch == '#') { sc.SetState(SCE_GAP_COMMENT); } else if (sc.ch == '\"') { sc.SetState(SCE_GAP_STRING); } else if (sc.ch == '\'') { sc.SetState(SCE_GAP_CHAR); } } } sc.Complete(); } static int ClassifyFoldPointGAP(const char* s) { int level = 0; if (strcmp(s, "function") == 0 || strcmp(s, "do") == 0 || strcmp(s, "if") == 0 || strcmp(s, "repeat") == 0 ) { level = 1; } else if (strcmp(s, "end") == 0 || strcmp(s, "od") == 0 || strcmp(s, "fi") == 0 || strcmp(s, "until") == 0 ) { level = -1; } return level; } static void FoldGAPDoc( Sci_PositionU startPos, Sci_Position length, int initStyle, WordList** , Accessor &styler) { Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelPrev = styler.LevelAt(lineCurrent) & SC_FOLDLEVELNUMBERMASK; int levelCurrent = levelPrev; char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); int style = initStyle; Sci_Position lastStart = 0; for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); int stylePrev = style; style = styleNext; styleNext = styler.StyleAt(i + 1); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (stylePrev != SCE_GAP_KEYWORD && style == SCE_GAP_KEYWORD) { // Store last word start point. lastStart = i; } if (stylePrev == SCE_GAP_KEYWORD) { if(iswordchar(ch) && !iswordchar(chNext)) { char s[100]; GetRange(lastStart, i, styler, s, sizeof(s)); levelCurrent += ClassifyFoldPointGAP(s); } } if (atEOL) { int lev = levelPrev; if ((levelCurrent > levelPrev) && (visibleChars > 0)) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelPrev = levelCurrent; visibleChars = 0; } if (!isspacechar(ch)) visibleChars++; } int flagsNext = styler.LevelAt(lineCurrent) & ~SC_FOLDLEVELNUMBERMASK; styler.SetLevel(lineCurrent, levelPrev | flagsNext); } static const char * const GAPWordListDesc[] = { "Keywords 1", "Keywords 2", "Keywords 3 (unused)", "Keywords 4 (unused)", 0 }; LexerModule lmGAP( SCLEX_GAP, ColouriseGAPDoc, "gap", FoldGAPDoc, GAPWordListDesc); lexilla/lexers/LexSML.cxx0000664000175000017500000001345014647367374014334 0ustar neilneil// Scintilla source code edit control /** @file LexSML.cxx ** Lexer for SML. **/ // Copyright 2009 by James Moffatt and Yuzhou Xin // Modified from LexCaml.cxx by Robert Roessler Copyright 2005 // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" #if defined(__clang__) #pragma clang diagnostic ignored "-Wcomma" #endif inline int issml(int c) {return isalnum(c) || c == '_';} inline int issmlf(int c) {return isalpha(c) || c == '_';} inline int issmld(int c) {return isdigit(c) || c == '_';} using namespace Lexilla; static void ColouriseSMLDoc( Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { StyleContext sc(startPos, length, initStyle, styler); int nesting = 0; if (sc.state < SCE_SML_STRING) sc.state = SCE_SML_DEFAULT; if (sc.state >= SCE_SML_COMMENT) nesting = (sc.state & 0x0f) - SCE_SML_COMMENT; Sci_PositionU chToken = 0; int chBase = 0, chLit = 0; WordList& keywords = *keywordlists[0]; WordList& keywords2 = *keywordlists[1]; WordList& keywords3 = *keywordlists[2]; const int useMagic = styler.GetPropertyInt("lexer.caml.magic", 0); while (sc.More()) { int state2 = -1; Sci_Position chColor = sc.currentPos - 1; bool advance = true; switch (sc.state & 0x0f) { case SCE_SML_DEFAULT: chToken = sc.currentPos; if (issmlf(sc.ch)) state2 = SCE_SML_IDENTIFIER; else if (sc.Match('`') && issmlf(sc.chNext)) state2 = SCE_SML_TAGNAME; else if (sc.Match('#')&&isdigit(sc.chNext)) state2 = SCE_SML_LINENUM; else if (sc.Match('#','\"')){ state2 = SCE_SML_CHAR,chLit = 0; sc.Forward(); } else if (isdigit(sc.ch)) { state2 = SCE_SML_NUMBER, chBase = 10; if (sc.Match('0') && strchr("xX", sc.chNext)) chBase = 16, sc.Forward();} else if (sc.Match('\"')&&sc.chPrev!='#') state2 = SCE_SML_STRING; else if (sc.Match('(', '*')){ state2 = SCE_SML_COMMENT, sc.ch = ' ', sc.Forward();} else if (strchr("!~" "=<>@^+-*/" "()[];,:.#", sc.ch)) state2 = SCE_SML_OPERATOR; break; case SCE_SML_IDENTIFIER: if (!(issml(sc.ch) || sc.Match('\''))) { const Sci_Position n = sc.currentPos - chToken; if (n < 24) { char t[24]; for (Sci_Position i = -n; i < 0; i++) t[n + i] = static_cast(sc.GetRelative(i)); t[n] = '\0'; if ((n == 1 && sc.chPrev == '_') || keywords.InList(t)) sc.ChangeState(SCE_SML_KEYWORD); else if (keywords2.InList(t)) sc.ChangeState(SCE_SML_KEYWORD2); else if (keywords3.InList(t)) sc.ChangeState(SCE_SML_KEYWORD3); } state2 = SCE_SML_DEFAULT, advance = false; } break; case SCE_SML_TAGNAME: if (!(issml(sc.ch) || sc.Match('\''))) state2 = SCE_SML_DEFAULT, advance = false; break; case SCE_SML_LINENUM: if (!isdigit(sc.ch)) state2 = SCE_SML_DEFAULT, advance = false; break; case SCE_SML_OPERATOR: { const char* o = 0; if (issml(sc.ch) || isspace(sc.ch) || (o = strchr(")]};,\'\"`#", sc.ch),o) || !strchr("!$%&*+-./:<=>?@^|~", sc.ch)) { if (o && strchr(")]};,", sc.ch)) { if ((sc.Match(')') && sc.chPrev == '(') || (sc.Match(']') && sc.chPrev == '[')) sc.ChangeState(SCE_SML_KEYWORD); chColor++; } else advance = false; state2 = SCE_SML_DEFAULT; } break; } case SCE_SML_NUMBER: if (issmld(sc.ch) || IsADigit(sc.ch, chBase)) break; if ((sc.Match('l') || sc.Match('L') || sc.Match('n')) && (issmld(sc.chPrev) || IsADigit(sc.chPrev, chBase))) break; if (chBase == 10) { if (sc.Match('.') && issmld(sc.chPrev)) break; if ((sc.Match('e') || sc.Match('E')) && (issmld(sc.chPrev) || sc.chPrev == '.')) break; if ((sc.Match('+') || sc.Match('-')) && (sc.chPrev == 'e' || sc.chPrev == 'E')) break; } state2 = SCE_SML_DEFAULT, advance = false; break; case SCE_SML_CHAR: if (sc.Match('\\')) { chLit = 1; if (sc.chPrev == '\\') sc.ch = ' '; } else if ((sc.Match('\"') && sc.chPrev != '\\') || sc.atLineEnd) { state2 = SCE_SML_DEFAULT; chLit = 1; if (sc.Match('\"')) chColor++; else sc.ChangeState(SCE_SML_IDENTIFIER); } else if (chLit < 1 && sc.currentPos - chToken >= 3) sc.ChangeState(SCE_SML_IDENTIFIER), advance = false; break; case SCE_SML_STRING: if (sc.Match('\\') && sc.chPrev == '\\') sc.ch = ' '; else if (sc.Match('\"') && sc.chPrev != '\\') state2 = SCE_SML_DEFAULT, chColor++; break; case SCE_SML_COMMENT: case SCE_SML_COMMENT1: case SCE_SML_COMMENT2: case SCE_SML_COMMENT3: if (sc.Match('(', '*')) state2 = sc.state + 1, chToken = sc.currentPos, sc.ch = ' ', sc.Forward(), nesting++; else if (sc.Match(')') && sc.chPrev == '*') { if (nesting) state2 = (sc.state & 0x0f) - 1, chToken = 0, nesting--; else state2 = SCE_SML_DEFAULT; chColor++; } else if (useMagic && sc.currentPos - chToken == 4 && sc.Match('c') && sc.chPrev == 'r' && sc.GetRelative(-2) == '@') sc.state |= 0x10; break; } if (state2 >= 0) styler.ColourTo(chColor, sc.state), sc.ChangeState(state2); if (advance) sc.Forward(); } sc.Complete(); } static void FoldSMLDoc( Sci_PositionU, Sci_Position, int, WordList *[], Accessor &) { } static const char * const SMLWordListDesc[] = { "Keywords", "Keywords2", "Keywords3", 0 }; LexerModule lmSML(SCLEX_SML, ColouriseSMLDoc, "SML", FoldSMLDoc, SMLWordListDesc); lexilla/lexers/LexKix.cxx0000664000175000017500000000731314647367374014435 0ustar neilneil// Scintilla source code edit control /** @file LexKix.cxx ** Lexer for KIX-Scripts. **/ // Copyright 2004 by Manfred Becker // The License.txt file describes the conditions under which this software may be distributed. // Edited by Lee Wilmott (24-Jun-2014) added support for block comments #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; // Extended to accept accented characters static inline bool IsAWordChar(int ch) { return ch >= 0x80 || isalnum(ch) || ch == '_'; } static inline bool IsOperator(const int ch) { return (ch == '+' || ch == '-' || ch == '*' || ch == '/' || ch == '&' || ch == '|' || ch == '<' || ch == '>' || ch == '='); } static void ColouriseKixDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { WordList &keywords = *keywordlists[0]; WordList &keywords2 = *keywordlists[1]; WordList &keywords3 = *keywordlists[2]; // WordList &keywords4 = *keywordlists[3]; styler.StartAt(startPos); StyleContext sc(startPos, length, initStyle, styler); for (; sc.More(); sc.Forward()) { if (sc.state == SCE_KIX_COMMENT) { if (sc.atLineEnd) { sc.SetState(SCE_KIX_DEFAULT); } } else if (sc.state == SCE_KIX_COMMENTSTREAM) { if (sc.ch == '/' && sc.chPrev == '*') { sc.ForwardSetState(SCE_KIX_DEFAULT); } } else if (sc.state == SCE_KIX_STRING1) { // This is a doubles quotes string if (sc.ch == '\"') { sc.ForwardSetState(SCE_KIX_DEFAULT); } } else if (sc.state == SCE_KIX_STRING2) { // This is a single quote string if (sc.ch == '\'') { sc.ForwardSetState(SCE_KIX_DEFAULT); } } else if (sc.state == SCE_KIX_NUMBER) { if (!IsADigit(sc.ch)) { sc.SetState(SCE_KIX_DEFAULT); } } else if (sc.state == SCE_KIX_VAR) { if (!IsAWordChar(sc.ch)) { sc.SetState(SCE_KIX_DEFAULT); } } else if (sc.state == SCE_KIX_MACRO) { if (!IsAWordChar(sc.ch) && !IsADigit(sc.ch)) { char s[100]; sc.GetCurrentLowered(s, sizeof(s)); if (!keywords3.InList(&s[1])) { sc.ChangeState(SCE_KIX_DEFAULT); } sc.SetState(SCE_KIX_DEFAULT); } } else if (sc.state == SCE_KIX_OPERATOR) { if (!IsOperator(sc.ch)) { sc.SetState(SCE_KIX_DEFAULT); } } else if (sc.state == SCE_KIX_IDENTIFIER) { if (!IsAWordChar(sc.ch)) { char s[100]; sc.GetCurrentLowered(s, sizeof(s)); if (keywords.InList(s)) { sc.ChangeState(SCE_KIX_KEYWORD); } else if (keywords2.InList(s)) { sc.ChangeState(SCE_KIX_FUNCTIONS); } sc.SetState(SCE_KIX_DEFAULT); } } // Determine if a new state should be entered. if (sc.state == SCE_KIX_DEFAULT) { if (sc.ch == ';') { sc.SetState(SCE_KIX_COMMENT); } else if (sc.ch == '/' && sc.chNext == '*') { sc.SetState(SCE_KIX_COMMENTSTREAM); } else if (sc.ch == '\"') { sc.SetState(SCE_KIX_STRING1); } else if (sc.ch == '\'') { sc.SetState(SCE_KIX_STRING2); } else if (sc.ch == '$') { sc.SetState(SCE_KIX_VAR); } else if (sc.ch == '@') { sc.SetState(SCE_KIX_MACRO); } else if (IsADigit(sc.ch) || ((sc.ch == '.' || sc.ch == '&') && IsADigit(sc.chNext))) { sc.SetState(SCE_KIX_NUMBER); } else if (IsOperator(sc.ch)) { sc.SetState(SCE_KIX_OPERATOR); } else if (IsAWordChar(sc.ch)) { sc.SetState(SCE_KIX_IDENTIFIER); } } } sc.Complete(); } LexerModule lmKix(SCLEX_KIX, ColouriseKixDoc, "kix"); lexilla/lexers/LexDMAP.cxx0000664000175000017500000002222714647367374014424 0ustar neilneil// Scintilla source code edit control /** @file LexDMAP.cxx ** Lexer for MSC Nastran DMAP. ** Written by Mark Robinson, based on the Fortran lexer by Chuan-jian Shen, Last changed Aug. 2013 **/ // Copyright 1998-2001 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. /***************************************/ #include #include #include #include #include #include #include #include /***************************************/ #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" /***************************************/ #if defined(__clang__) #if __has_warning("-Wunused-but-set-variable") // Disable warning for numNonBlank #pragma clang diagnostic ignored "-Wunused-but-set-variable" #endif #endif using namespace Lexilla; /***********************************************/ static inline bool IsAWordChar(const int ch) { return (ch < 0x80) && (isalnum(ch) || ch == '_' || ch == '%'); } /**********************************************/ static inline bool IsAWordStart(const int ch) { return (ch < 0x80) && (isalnum(ch)); } /***************************************/ static void ColouriseDMAPDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { WordList &keywords = *keywordlists[0]; WordList &keywords2 = *keywordlists[1]; WordList &keywords3 = *keywordlists[2]; /***************************************/ Sci_Position posLineStart = 0, numNonBlank = 0; Sci_Position endPos = startPos + length; /***************************************/ // backtrack to the nearest keyword while ((startPos > 1) && (styler.StyleAt(startPos) != SCE_DMAP_WORD)) { startPos--; } startPos = styler.LineStart(styler.GetLine(startPos)); initStyle = styler.StyleAt(startPos - 1); StyleContext sc(startPos, endPos-startPos, initStyle, styler); /***************************************/ for (; sc.More(); sc.Forward()) { // remember the start position of the line if (sc.atLineStart) { posLineStart = sc.currentPos; numNonBlank = 0; sc.SetState(SCE_DMAP_DEFAULT); } if (!IsASpaceOrTab(sc.ch)) numNonBlank ++; /***********************************************/ // Handle data appearing after column 72; it is ignored Sci_Position toLineStart = sc.currentPos - posLineStart; if (toLineStart >= 72 || sc.ch == '$') { sc.SetState(SCE_DMAP_COMMENT); while (!sc.atLineEnd && sc.More()) sc.Forward(); // Until line end continue; } /***************************************/ // Determine if the current state should terminate. if (sc.state == SCE_DMAP_OPERATOR) { sc.SetState(SCE_DMAP_DEFAULT); } else if (sc.state == SCE_DMAP_NUMBER) { if (!(IsAWordChar(sc.ch) || sc.ch=='\'' || sc.ch=='\"' || sc.ch=='.')) { sc.SetState(SCE_DMAP_DEFAULT); } } else if (sc.state == SCE_DMAP_IDENTIFIER) { if (!IsAWordChar(sc.ch) || (sc.ch == '%')) { char s[100]; sc.GetCurrentLowered(s, sizeof(s)); if (keywords.InList(s)) { sc.ChangeState(SCE_DMAP_WORD); } else if (keywords2.InList(s)) { sc.ChangeState(SCE_DMAP_WORD2); } else if (keywords3.InList(s)) { sc.ChangeState(SCE_DMAP_WORD3); } sc.SetState(SCE_DMAP_DEFAULT); } } else if (sc.state == SCE_DMAP_COMMENT) { if (sc.ch == '\r' || sc.ch == '\n') { sc.SetState(SCE_DMAP_DEFAULT); } } else if (sc.state == SCE_DMAP_STRING1) { if (sc.ch == '\'') { if (sc.chNext == '\'') { sc.Forward(); } else { sc.ForwardSetState(SCE_DMAP_DEFAULT); } } else if (sc.atLineEnd) { sc.ChangeState(SCE_DMAP_STRINGEOL); sc.ForwardSetState(SCE_DMAP_DEFAULT); } } else if (sc.state == SCE_DMAP_STRING2) { if (sc.atLineEnd) { sc.ChangeState(SCE_DMAP_STRINGEOL); sc.ForwardSetState(SCE_DMAP_DEFAULT); } else if (sc.ch == '\"') { if (sc.chNext == '\"') { sc.Forward(); } else { sc.ForwardSetState(SCE_DMAP_DEFAULT); } } } /***************************************/ // Determine if a new state should be entered. if (sc.state == SCE_DMAP_DEFAULT) { if (sc.ch == '$') { sc.SetState(SCE_DMAP_COMMENT); } else if (IsADigit(sc.ch) || (sc.ch == '.' && IsADigit(sc.chNext)) || (sc.ch == '-' && IsADigit(sc.chNext))) { sc.SetState(SCE_F_NUMBER); } else if (IsAWordStart(sc.ch)) { sc.SetState(SCE_DMAP_IDENTIFIER); } else if (sc.ch == '\"') { sc.SetState(SCE_DMAP_STRING2); } else if (sc.ch == '\'') { sc.SetState(SCE_DMAP_STRING1); } else if (isoperator(static_cast(sc.ch))) { sc.SetState(SCE_DMAP_OPERATOR); } } } sc.Complete(); } /***************************************/ // To determine the folding level depending on keywords static int classifyFoldPointDMAP(const char* s, const char* prevWord) { int lev = 0; if ((strcmp(prevWord, "else") == 0 && strcmp(s, "if") == 0) || strcmp(s, "enddo") == 0 || strcmp(s, "endif") == 0) { lev = -1; } else if ((strcmp(prevWord, "do") == 0 && strcmp(s, "while") == 0) || strcmp(s, "then") == 0) { lev = 1; } return lev; } // Folding the code static void FoldDMAPDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *[], Accessor &styler) { // // bool foldComment = styler.GetPropertyInt("fold.comment") != 0; // Do not know how to fold the comment at the moment. // bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelPrev = styler.LevelAt(lineCurrent) & SC_FOLDLEVELNUMBERMASK; int levelCurrent = levelPrev; char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); int style = initStyle; /***************************************/ Sci_Position lastStart = 0; char prevWord[32] = ""; /***************************************/ for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); int stylePrev = style; style = styleNext; styleNext = styler.StyleAt(i + 1); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); // if ((stylePrev == SCE_DMAP_DEFAULT || stylePrev == SCE_DMAP_OPERATOR || stylePrev == SCE_DMAP_COMMENT) && (style == SCE_DMAP_WORD)) { // Store last word and label start point. lastStart = i; } /***************************************/ if (style == SCE_DMAP_WORD) { if(iswordchar(ch) && !iswordchar(chNext)) { char s[32]; Sci_PositionU k; for(k=0; (k<31 ) && (k(tolower(styler[lastStart+k])); } s[k] = '\0'; levelCurrent += classifyFoldPointDMAP(s, prevWord); strcpy(prevWord, s); } } if (atEOL) { int lev = levelPrev; if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if ((levelCurrent > levelPrev) && (visibleChars > 0)) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelPrev = levelCurrent; visibleChars = 0; strcpy(prevWord, ""); } /***************************************/ if (!isspacechar(ch)) visibleChars++; } /***************************************/ // Fill in the real level of the next line, keeping the current flags as they will be filled in later int flagsNext = styler.LevelAt(lineCurrent) & ~SC_FOLDLEVELNUMBERMASK; styler.SetLevel(lineCurrent, levelPrev | flagsNext); } /***************************************/ static const char * const DMAPWordLists[] = { "Primary keywords and identifiers", "Intrinsic functions", "Extended and user defined functions", 0, }; /***************************************/ LexerModule lmDMAP(SCLEX_DMAP, ColouriseDMAPDoc, "DMAP", FoldDMAPDoc, DMAPWordLists); lexilla/lexers/LexTCMD.cxx0000664000175000017500000004050714647367374014433 0ustar neilneil// Scintilla\ source code edit control /** @file LexTCMD.cxx ** Lexer for Take Command / TCC batch scripts (.bat, .btm, .cmd). **/ // Written by Rex Conn (rconn [at] jpsoft [dot] com) // based on the CMD lexer // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static bool IsAlphabetic(int ch) { return IsASCII(ch) && isalpha(ch); } static inline bool AtEOL(Accessor &styler, Sci_PositionU i) { return (styler[i] == '\n') || ((styler[i] == '\r') && (styler.SafeGetCharAt(i + 1) != '\n')); } // Tests for BATCH Operators static bool IsBOperator(char ch) { return (ch == '=') || (ch == '+') || (ch == '>') || (ch == '<') || (ch == '|') || (ch == '&') || (ch == '!') || (ch == '?') || (ch == '*') || (ch == '(') || (ch == ')'); } // Tests for BATCH Separators static bool IsBSeparator(char ch) { return (ch == '\\') || (ch == '.') || (ch == ';') || (ch == ' ') || (ch == '\t') || (ch == '[') || (ch == ']') || (ch == '\"') || (ch == '\'') || (ch == '/'); } // Find length of CMD FOR variable with modifier (%~...) or return 0 static unsigned int GetBatchVarLen( char *wordBuffer ) { int nLength = 0; if ( wordBuffer[0] == '%' ) { if ( wordBuffer[1] == '~' ) nLength = 2; else if (( wordBuffer[1] == '%' ) && ( wordBuffer[2] == '~' )) nLength++; else return 0; for ( ; ( wordBuffer[nLength] ); nLength++ ) { switch ( toupper(wordBuffer[nLength]) ) { case 'A': // file attributes case 'D': // drive letter only case 'F': // fully qualified path name case 'N': // filename only case 'P': // path only case 'S': // short name case 'T': // date / time of file case 'X': // file extension only case 'Z': // file size break; default: return nLength; } } } return nLength; } static void ColouriseTCMDLine( char *lineBuffer, Sci_PositionU lengthLine, Sci_PositionU startLine, Sci_PositionU endPos, WordList *keywordlists[], Accessor &styler) { Sci_PositionU offset = 0; // Line Buffer Offset char wordBuffer[260]; // Word Buffer - large to catch long paths Sci_PositionU wbl; // Word Buffer Length Sci_PositionU wbo; // Word Buffer Offset - also Special Keyword Buffer Length WordList &keywords = *keywordlists[0]; // Internal Commands // WordList &keywords2 = *keywordlists[1]; // Aliases (optional) bool isDelayedExpansion = 1; // !var! bool continueProcessing = true; // Used to toggle Regular Keyword Checking // Special Keywords are those that allow certain characters without whitespace after the command // Examples are: cd. cd\ echo: echo. path= bool inString = false; // Used for processing while "" // Special Keyword Buffer used to determine if the first n characters is a Keyword char sKeywordBuffer[260] = ""; // Special Keyword Buffer bool sKeywordFound; // Exit Special Keyword for-loop if found // Skip leading whitespace while ((offset < lengthLine) && (isspacechar(lineBuffer[offset]))) { offset++; } // Colorize Default Text styler.ColourTo(startLine + offset - 1, SCE_TCMD_DEFAULT); if ( offset >= lengthLine ) return; // Check for Fake Label (Comment) or Real Label - return if found if (lineBuffer[offset] == ':') { if (lineBuffer[offset + 1] == ':') { // Colorize Fake Label (Comment) - :: is the same as REM styler.ColourTo(endPos, SCE_TCMD_COMMENT); } else { // Colorize Real Label styler.ColourTo(endPos, SCE_TCMD_LABEL); } return; // Check for Comment - return if found } else if (( CompareNCaseInsensitive(lineBuffer+offset, "rem", 3) == 0 ) && (( lineBuffer[offset+3] == 0 ) || ( isspace(lineBuffer[offset+3] )))) { styler.ColourTo(endPos, SCE_TCMD_COMMENT); return; // Check for Drive Change (Drive Change is internal command) - return if found } else if ((IsAlphabetic(lineBuffer[offset])) && (lineBuffer[offset + 1] == ':') && ((isspacechar(lineBuffer[offset + 2])) || (((lineBuffer[offset + 2] == '\\')) && (isspacechar(lineBuffer[offset + 3]))))) { // Colorize Regular Keyword styler.ColourTo(endPos, SCE_TCMD_WORD); return; } // Check for Hide Command (@ECHO OFF/ON) if (lineBuffer[offset] == '@') { styler.ColourTo(startLine + offset, SCE_TCMD_HIDE); offset++; } // Skip whitespace while ((offset < lengthLine) && (isspacechar(lineBuffer[offset]))) { offset++; } // Read remainder of line word-at-a-time or remainder-of-word-at-a-time while (offset < lengthLine) { if (offset > startLine) { // Colorize Default Text styler.ColourTo(startLine + offset - 1, SCE_TCMD_DEFAULT); } // Copy word from Line Buffer into Word Buffer wbl = 0; for (; offset < lengthLine && ( wbl < 260 ) && !isspacechar(lineBuffer[offset]); wbl++, offset++) { wordBuffer[wbl] = static_cast(tolower(lineBuffer[offset])); } wordBuffer[wbl] = '\0'; wbo = 0; // Check for Separator if (IsBSeparator(wordBuffer[0])) { // Reset Offset to re-process remainder of word offset -= (wbl - 1); // Colorize Default Text styler.ColourTo(startLine + offset - 1, SCE_BAT_DEFAULT); if (wordBuffer[0] == '"') inString = !inString; // Check for Regular expression } else if (( wordBuffer[0] == ':' ) && ( wordBuffer[1] == ':' ) && (continueProcessing)) { // Colorize Regular exoressuin styler.ColourTo(startLine + offset - 1, SCE_TCMD_DEFAULT); // No need to Reset Offset // Check for Labels in text (... :label) } else if (wordBuffer[0] == ':' && isspacechar(lineBuffer[offset - wbl - 1])) { // Colorize Default Text styler.ColourTo(startLine + offset - 1 - wbl, SCE_TCMD_DEFAULT); // Colorize Label styler.ColourTo(startLine + offset - 1, SCE_TCMD_CLABEL); // No need to Reset Offset // Check for delayed expansion Variable (!x...!) } else if (isDelayedExpansion && wordBuffer[0] == '!') { // Colorize Default Text styler.ColourTo(startLine + offset - 1 - wbl, SCE_TCMD_DEFAULT); wbo++; // Search to end of word for second ! while ((wbo < wbl) && (wordBuffer[wbo] != '!') && (!IsBOperator(wordBuffer[wbo])) && (!IsBSeparator(wordBuffer[wbo]))) { wbo++; } if (wordBuffer[wbo] == '!') { wbo++; // Colorize Environment Variable styler.ColourTo(startLine + offset - 1 - (wbl - wbo), SCE_TCMD_EXPANSION); } else { wbo = 1; // Colorize Symbol styler.ColourTo(startLine + offset - 1 - (wbl - 1), SCE_TCMD_DEFAULT); } // Reset Offset to re-process remainder of word offset -= (wbl - wbo); // Check for Regular Keyword in list } else if ((keywords.InList(wordBuffer)) && (!inString) && (continueProcessing)) { // ECHO, PATH, and PROMPT require no further Regular Keyword Checking if ((CompareCaseInsensitive(wordBuffer, "echo") == 0) || (CompareCaseInsensitive(sKeywordBuffer, "echos") == 0) || (CompareCaseInsensitive(sKeywordBuffer, "echoerr") == 0) || (CompareCaseInsensitive(sKeywordBuffer, "echoserr") == 0) || (CompareCaseInsensitive(wordBuffer, "path") == 0) || (CompareCaseInsensitive(wordBuffer, "prompt") == 0)) { continueProcessing = false; } // Colorize Regular keyword styler.ColourTo(startLine + offset - 1, SCE_TCMD_WORD); // No need to Reset Offset } else if ((wordBuffer[0] != '%') && (wordBuffer[0] != '!') && (!IsBOperator(wordBuffer[0])) && (!inString) && (continueProcessing)) { // a few commands accept "illegal" syntax -- cd\, echo., etc. sscanf( wordBuffer, "%[^.<>|&=\\/]", sKeywordBuffer ); sKeywordFound = false; if ((CompareCaseInsensitive(sKeywordBuffer, "echo") == 0) || (CompareCaseInsensitive(sKeywordBuffer, "echos") == 0) || (CompareCaseInsensitive(sKeywordBuffer, "echoerr") == 0) || (CompareCaseInsensitive(sKeywordBuffer, "echoserr") == 0) || (CompareCaseInsensitive(sKeywordBuffer, "cd") == 0) || (CompareCaseInsensitive(sKeywordBuffer, "path") == 0) || (CompareCaseInsensitive(sKeywordBuffer, "prompt") == 0)) { // no further Regular Keyword Checking continueProcessing = false; sKeywordFound = true; wbo = (Sci_PositionU)strlen( sKeywordBuffer ); // Colorize Special Keyword as Regular Keyword styler.ColourTo(startLine + offset - 1 - (wbl - wbo), SCE_TCMD_WORD); // Reset Offset to re-process remainder of word offset -= (wbl - wbo); } // Check for Default Text if (!sKeywordFound) { wbo = 0; // Read up to %, Operator or Separator while ((wbo < wbl) && (wordBuffer[wbo] != '%') && (!isDelayedExpansion || wordBuffer[wbo] != '!') && (!IsBOperator(wordBuffer[wbo])) && (!IsBSeparator(wordBuffer[wbo]))) { wbo++; } // Colorize Default Text styler.ColourTo(startLine + offset - 1 - (wbl - wbo), SCE_TCMD_DEFAULT); // Reset Offset to re-process remainder of word offset -= (wbl - wbo); } // Check for Argument (%n), Environment Variable (%x...%) or Local Variable (%%a) } else if (wordBuffer[0] == '%') { unsigned int varlen; unsigned int n = 1; // Colorize Default Text styler.ColourTo(startLine + offset - 1 - wbl, SCE_TCMD_DEFAULT); wbo++; // check for %[nn] syntax if ( wordBuffer[1] == '[' ) { n++; while ((n < wbl) && (wordBuffer[n] != ']')) { n++; } if ( wordBuffer[n] == ']' ) n++; goto ColorizeArg; } // Search to end of word for second % or to the first terminator (can be a long path) while ((wbo < wbl) && (wordBuffer[wbo] != '%') && (!IsBOperator(wordBuffer[wbo])) && (!IsBSeparator(wordBuffer[wbo]))) { wbo++; } // Check for Argument (%n) or (%*) if (((isdigit(wordBuffer[1])) || (wordBuffer[1] == '*')) && (wordBuffer[wbo] != '%')) { while (( wordBuffer[n] ) && ( strchr( "%0123456789*#$", wordBuffer[n] ) != NULL )) n++; ColorizeArg: // Colorize Argument styler.ColourTo(startLine + offset - 1 - (wbl - n), SCE_TCMD_IDENTIFIER); // Reset Offset to re-process remainder of word offset -= (wbl - n); // Check for Variable with modifiers (%~...) } else if ((varlen = GetBatchVarLen(wordBuffer)) != 0) { // Colorize Variable styler.ColourTo(startLine + offset - 1 - (wbl - varlen), SCE_TCMD_IDENTIFIER); // Reset Offset to re-process remainder of word offset -= (wbl - varlen); // Check for Environment Variable (%x...%) } else if (( wordBuffer[1] ) && ( wordBuffer[1] != '%')) { if ( wordBuffer[wbo] == '%' ) wbo++; // Colorize Environment Variable styler.ColourTo(startLine + offset - 1 - (wbl - wbo), SCE_TCMD_ENVIRONMENT); // Reset Offset to re-process remainder of word offset -= (wbl - wbo); // Check for Local Variable (%%a) } else if ( (wbl > 2) && (wordBuffer[1] == '%') && (wordBuffer[2] != '%') && (!IsBOperator(wordBuffer[2])) && (!IsBSeparator(wordBuffer[2]))) { n = 2; while (( wordBuffer[n] ) && (!IsBOperator(wordBuffer[n])) && (!IsBSeparator(wordBuffer[n]))) n++; // Colorize Local Variable styler.ColourTo(startLine + offset - 1 - (wbl - n), SCE_TCMD_IDENTIFIER); // Reset Offset to re-process remainder of word offset -= (wbl - n); // Check for %% } else if ((wbl > 1) && (wordBuffer[1] == '%')) { // Colorize Symbols styler.ColourTo(startLine + offset - 1 - (wbl - 2), SCE_TCMD_DEFAULT); // Reset Offset to re-process remainder of word offset -= (wbl - 2); } else { // Colorize Symbol styler.ColourTo(startLine + offset - 1 - (wbl - 1), SCE_TCMD_DEFAULT); // Reset Offset to re-process remainder of word offset -= (wbl - 1); } // Check for Operator } else if (IsBOperator(wordBuffer[0])) { // Colorize Default Text styler.ColourTo(startLine + offset - 1 - wbl, SCE_TCMD_DEFAULT); // Check for Pipe, compound, or conditional Operator if ((wordBuffer[0] == '|') || (wordBuffer[0] == '&')) { // Colorize Pipe Operator styler.ColourTo(startLine + offset - 1 - (wbl - 1), SCE_TCMD_OPERATOR); // Reset Offset to re-process remainder of word offset -= (wbl - 1); continueProcessing = true; // Check for Other Operator } else { // Check for > Operator if ((wordBuffer[0] == '>') || (wordBuffer[0] == '<')) { // Turn Keyword and External Command / Program checking back on continueProcessing = true; } // Colorize Other Operator if (!inString || !(wordBuffer[0] == '(' || wordBuffer[0] == ')')) styler.ColourTo(startLine + offset - 1 - (wbl - 1), SCE_TCMD_OPERATOR); // Reset Offset to re-process remainder of word offset -= (wbl - 1); } // Check for Default Text } else { // Read up to %, Operator or Separator while ((wbo < wbl) && (wordBuffer[wbo] != '%') && (!isDelayedExpansion || wordBuffer[wbo] != '!') && (!IsBOperator(wordBuffer[wbo])) && (!IsBSeparator(wordBuffer[wbo]))) { wbo++; } // Colorize Default Text styler.ColourTo(startLine + offset - 1 - (wbl - wbo), SCE_TCMD_DEFAULT); // Reset Offset to re-process remainder of word offset -= (wbl - wbo); } // Skip whitespace - nothing happens if Offset was Reset while ((offset < lengthLine) && (isspacechar(lineBuffer[offset]))) { offset++; } } // Colorize Default Text for remainder of line - currently not lexed styler.ColourTo(endPos, SCE_TCMD_DEFAULT); } static void ColouriseTCMDDoc( Sci_PositionU startPos, Sci_Position length, int /*initStyle*/, WordList *keywordlists[], Accessor &styler ) { char lineBuffer[16384]; styler.StartAt(startPos); styler.StartSegment(startPos); Sci_PositionU linePos = 0; Sci_PositionU startLine = startPos; for (Sci_PositionU i = startPos; i < startPos + length; i++) { lineBuffer[linePos++] = styler[i]; if (AtEOL(styler, i) || (linePos >= sizeof(lineBuffer) - 1)) { // End of line (or of line buffer) met, colourise it lineBuffer[linePos] = '\0'; ColouriseTCMDLine(lineBuffer, linePos, startLine, i, keywordlists, styler); linePos = 0; startLine = i + 1; } } if (linePos > 0) { // Last line does not have ending characters lineBuffer[linePos] = '\0'; ColouriseTCMDLine(lineBuffer, linePos, startLine, startPos + length - 1, keywordlists, styler); } } // Convert string to upper case static void StrUpr(char *s) { while (*s) { *s = MakeUpperCase(*s); s++; } } // Folding support (for DO, IFF, SWITCH, TEXT, and command groups) static void FoldTCMDDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { Sci_Position line = styler.GetLine(startPos); int level = styler.LevelAt(line); int levelIndent = 0; Sci_PositionU endPos = startPos + length; char s[16] = ""; char chPrev = styler.SafeGetCharAt(startPos - 1); // Scan for ( and ) for (Sci_PositionU i = startPos; i < endPos; i++) { int c = styler.SafeGetCharAt(i, '\n'); int style = styler.StyleAt(i); bool bLineStart = ((chPrev == '\r') || (chPrev == '\n')) || i == 0; if (style == SCE_TCMD_OPERATOR) { // CheckFoldPoint if (c == '(') { levelIndent += 1; } else if (c == ')') { levelIndent -= 1; } } if (( bLineStart ) && ( style == SCE_TCMD_WORD )) { for (Sci_PositionU j = 0; j < 10; j++) { if (!iswordchar(styler[i + j])) { break; } s[j] = styler[i + j]; s[j + 1] = '\0'; } StrUpr( s ); if ((strcmp(s, "DO") == 0) || (strcmp(s, "IFF") == 0) || (strcmp(s, "SWITCH") == 0) || (strcmp(s, "TEXT") == 0)) { levelIndent++; } else if ((strcmp(s, "ENDDO") == 0) || (strcmp(s, "ENDIFF") == 0) || (strcmp(s, "ENDSWITCH") == 0) || (strcmp(s, "ENDTEXT") == 0)) { levelIndent--; } } if (c == '\n') { // line end if (levelIndent > 0) { level |= SC_FOLDLEVELHEADERFLAG; } if (level != styler.LevelAt(line)) styler.SetLevel(line, level); level += levelIndent; if ((level & SC_FOLDLEVELNUMBERMASK) < SC_FOLDLEVELBASE) level = SC_FOLDLEVELBASE; line++; // reset state levelIndent = 0; level &= ~SC_FOLDLEVELHEADERFLAG; level &= ~SC_FOLDLEVELWHITEFLAG; } chPrev = c; } } static const char *const tcmdWordListDesc[] = { "Internal Commands", "Aliases", 0 }; LexerModule lmTCMD(SCLEX_TCMD, ColouriseTCMDDoc, "tcmd", FoldTCMDDoc, tcmdWordListDesc); lexilla/lexers/LexLout.cxx0000664000175000017500000001370214647367374014624 0ustar neilneil// Scintilla source code edit control /** @file LexLout.cxx ** Lexer for the Basser Lout (>= version 3) typesetting language **/ // Copyright 2003 by Kein-Hong Man // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static inline bool IsAWordChar(const int ch) { return (ch < 0x80) && (isalpha(ch) || ch == '@' || ch == '_'); } static inline bool IsAnOther(const int ch) { return (ch < 0x80) && (ch == '{' || ch == '}' || ch == '!' || ch == '$' || ch == '%' || ch == '&' || ch == '\'' || ch == '(' || ch == ')' || ch == '*' || ch == '+' || ch == ',' || ch == '-' || ch == '.' || ch == '/' || ch == ':' || ch == ';' || ch == '<' || ch == '=' || ch == '>' || ch == '?' || ch == '[' || ch == ']' || ch == '^' || ch == '`' || ch == '|' || ch == '~'); } static void ColouriseLoutDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { WordList &keywords = *keywordlists[0]; WordList &keywords2 = *keywordlists[1]; WordList &keywords3 = *keywordlists[2]; int visibleChars = 0; int firstWordInLine = 0; int leadingAtSign = 0; StyleContext sc(startPos, length, initStyle, styler); for (; sc.More(); sc.Forward()) { if (sc.atLineStart && (sc.state == SCE_LOUT_STRING)) { // Prevent SCE_LOUT_STRINGEOL from leaking back to previous line sc.SetState(SCE_LOUT_STRING); } // Determine if the current state should terminate. if (sc.state == SCE_LOUT_COMMENT) { if (sc.atLineEnd) { sc.SetState(SCE_LOUT_DEFAULT); visibleChars = 0; } } else if (sc.state == SCE_LOUT_NUMBER) { if (!IsADigit(sc.ch) && sc.ch != '.') { sc.SetState(SCE_LOUT_DEFAULT); } } else if (sc.state == SCE_LOUT_STRING) { if (sc.ch == '\\') { if (sc.chNext == '\"' || sc.chNext == '\\') { sc.Forward(); } } else if (sc.ch == '\"') { sc.ForwardSetState(SCE_LOUT_DEFAULT); } else if (sc.atLineEnd) { sc.ChangeState(SCE_LOUT_STRINGEOL); sc.ForwardSetState(SCE_LOUT_DEFAULT); visibleChars = 0; } } else if (sc.state == SCE_LOUT_IDENTIFIER) { if (!IsAWordChar(sc.ch)) { char s[100]; sc.GetCurrent(s, sizeof(s)); if (leadingAtSign) { if (keywords.InList(s)) { sc.ChangeState(SCE_LOUT_WORD); } else { sc.ChangeState(SCE_LOUT_WORD4); } } else if (firstWordInLine && keywords3.InList(s)) { sc.ChangeState(SCE_LOUT_WORD3); } sc.SetState(SCE_LOUT_DEFAULT); } } else if (sc.state == SCE_LOUT_OPERATOR) { if (!IsAnOther(sc.ch)) { char s[100]; sc.GetCurrent(s, sizeof(s)); if (keywords2.InList(s)) { sc.ChangeState(SCE_LOUT_WORD2); } sc.SetState(SCE_LOUT_DEFAULT); } } // Determine if a new state should be entered. if (sc.state == SCE_LOUT_DEFAULT) { if (sc.ch == '#') { sc.SetState(SCE_LOUT_COMMENT); } else if (sc.ch == '\"') { sc.SetState(SCE_LOUT_STRING); } else if (IsADigit(sc.ch) || (sc.ch == '.' && IsADigit(sc.chNext))) { sc.SetState(SCE_LOUT_NUMBER); } else if (IsAWordChar(sc.ch)) { firstWordInLine = (visibleChars == 0); leadingAtSign = (sc.ch == '@'); sc.SetState(SCE_LOUT_IDENTIFIER); } else if (IsAnOther(sc.ch)) { sc.SetState(SCE_LOUT_OPERATOR); } } if (sc.atLineEnd) { // Reset states to begining of colourise so no surprises // if different sets of lines lexed. visibleChars = 0; } if (!IsASpace(sc.ch)) { visibleChars++; } } sc.Complete(); } static void FoldLoutDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelPrev = styler.LevelAt(lineCurrent) & SC_FOLDLEVELNUMBERMASK; int levelCurrent = levelPrev; char chNext = styler[startPos]; bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; int styleNext = styler.StyleAt(startPos); char s[10] = ""; for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); int style = styleNext; styleNext = styler.StyleAt(i + 1); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (style == SCE_LOUT_WORD) { if (ch == '@') { for (Sci_PositionU j = 0; j < 8; j++) { if (!IsAWordChar(styler[i + j])) { break; } s[j] = styler[i + j]; s[j + 1] = '\0'; } if (strcmp(s, "@Begin") == 0) { levelCurrent++; } else if (strcmp(s, "@End") == 0) { levelCurrent--; } } } else if (style == SCE_LOUT_OPERATOR) { if (ch == '{') { levelCurrent++; } else if (ch == '}') { levelCurrent--; } } if (atEOL) { int lev = levelPrev; if (visibleChars == 0 && foldCompact) { lev |= SC_FOLDLEVELWHITEFLAG; } if ((levelCurrent > levelPrev) && (visibleChars > 0)) { lev |= SC_FOLDLEVELHEADERFLAG; } if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelPrev = levelCurrent; visibleChars = 0; } if (!isspacechar(ch)) visibleChars++; } // Fill in the real level of the next line, keeping the current flags as they will be filled in later int flagsNext = styler.LevelAt(lineCurrent) & ~SC_FOLDLEVELNUMBERMASK; styler.SetLevel(lineCurrent, levelPrev | flagsNext); } static const char * const loutWordLists[] = { "Predefined identifiers", "Predefined delimiters", "Predefined keywords", 0, }; LexerModule lmLout(SCLEX_LOUT, ColouriseLoutDoc, "lout", FoldLoutDoc, loutWordLists); lexilla/lexers/LexCOBOL.cxx0000664000175000017500000003174214647367374014543 0ustar neilneil// Scintilla source code edit control /** @file LexCOBOL.cxx ** Lexer for COBOL ** Based on LexPascal.cxx ** Written by Laurent le Tynevez ** Updated by Simon Steele September 2002 ** Updated by Mathias Rauen May 2003 (Delphi adjustments) ** Updated by Rod Falck, Aug 2006 Converted to COBOL **/ #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; #define IN_DIVISION 0x01 #define IN_DECLARATIVES 0x02 #define IN_SECTION 0x04 #define IN_PARAGRAPH 0x08 #define IN_FLAGS 0xF #define NOT_HEADER 0x10 inline bool isCOBOLoperator(char ch) { return isoperator(ch); } inline bool isCOBOLwordchar(char ch) { return IsASCII(ch) && (isalnum(ch) || ch == '-'); } inline bool isCOBOLwordstart(char ch) { return IsASCII(ch) && isalnum(ch); } static int CountBits(int nBits) { int count = 0; for (int i = 0; i < 32; ++i) { count += nBits & 1; nBits >>= 1; } return count; } static void getRange(Sci_PositionU start, Sci_PositionU end, Accessor &styler, char *s, Sci_PositionU len) { Sci_PositionU i = 0; while ((i < end - start + 1) && (i < len-1)) { s[i] = static_cast(tolower(styler[start + i])); i++; } s[i] = '\0'; } static void ColourTo(Accessor &styler, Sci_PositionU end, unsigned int attr) { styler.ColourTo(end, attr); } static int classifyWordCOBOL(Sci_PositionU start, Sci_PositionU end, /*WordList &keywords*/WordList *keywordlists[], Accessor &styler, int nContainment, bool *bAarea) { int ret = 0; char s[100]; s[0] = '\0'; s[1] = '\0'; getRange(start, end, styler, s, sizeof(s)); int chAttr = SCE_C_IDENTIFIER; if (isdigit(s[0]) || (s[0] == '.') || (s[0] == 'v')) { chAttr = SCE_C_NUMBER; char *p = s + 1; while (*p) { if ((!isdigit(*p) && (*p) != 'v') && isCOBOLwordchar(*p)) { chAttr = SCE_C_IDENTIFIER; break; } ++p; } } if (chAttr == SCE_C_IDENTIFIER) { WordList& a_keywords = *keywordlists[0]; WordList& b_keywords = *keywordlists[1]; WordList& c_keywords = *keywordlists[2]; if (a_keywords.InList(s)) { chAttr = SCE_C_WORD; } else if (b_keywords.InList(s)) { chAttr = SCE_C_WORD2; } else if (c_keywords.InList(s)) { chAttr = SCE_C_UUID; } } if (*bAarea) { if (strcmp(s, "division") == 0) { ret = IN_DIVISION; // we've determined the containment, anything else is just ignored for those purposes *bAarea = false; } else if (strcmp(s, "declaratives") == 0) { ret = IN_DIVISION | IN_DECLARATIVES; if (nContainment & IN_DECLARATIVES) ret |= NOT_HEADER | IN_SECTION; // we've determined the containment, anything else is just ignored for those purposes *bAarea = false; } else if (strcmp(s, "section") == 0) { ret = (nContainment &~ IN_PARAGRAPH) | IN_SECTION; // we've determined the containment, anything else is just ignored for those purposes *bAarea = false; } else if (strcmp(s, "end") == 0 && (nContainment & IN_DECLARATIVES)) { ret = IN_DIVISION | IN_DECLARATIVES | IN_SECTION | NOT_HEADER; } else { ret = nContainment | IN_PARAGRAPH; } } ColourTo(styler, end, chAttr); return ret; } static void ColouriseCOBOLDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { styler.StartAt(startPos); int state = initStyle; if (state == SCE_C_CHARACTER) // Does not leak onto next line state = SCE_C_DEFAULT; char chPrev = ' '; char chNext = styler[startPos]; Sci_PositionU lengthDoc = startPos + length; int nContainment; Sci_Position currentLine = styler.GetLine(startPos); if (currentLine > 0) { styler.SetLineState(currentLine, styler.GetLineState(currentLine-1)); nContainment = styler.GetLineState(currentLine); nContainment &= ~NOT_HEADER; } else { styler.SetLineState(currentLine, 0); nContainment = 0; } styler.StartSegment(startPos); bool bNewLine = true; bool bAarea = !isspacechar(chNext); int column = 0; for (Sci_PositionU i = startPos; i < lengthDoc; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); ++column; if (bNewLine) { column = 0; } if (column <= 1 && !bAarea) { bAarea = !isspacechar(ch); } bool bSetNewLine = false; if ((ch == '\r' && chNext != '\n') || (ch == '\n')) { // Trigger on CR only (Mac style) or either on LF from CR+LF (Dos/Win) or on LF alone (Unix) // Avoid triggering two times on Dos/Win // End of line if (state == SCE_C_CHARACTER) { ColourTo(styler, i, state); state = SCE_C_DEFAULT; } styler.SetLineState(currentLine, nContainment); currentLine++; bSetNewLine = true; if (nContainment & NOT_HEADER) nContainment &= ~(NOT_HEADER | IN_DECLARATIVES | IN_SECTION); } if (styler.IsLeadByte(ch)) { chNext = styler.SafeGetCharAt(i + 2); chPrev = ' '; i += 1; continue; } if (state == SCE_C_DEFAULT) { if (isCOBOLwordstart(ch) || (ch == '$' && IsASCII(chNext) && isalpha(chNext))) { ColourTo(styler, i-1, state); state = SCE_C_IDENTIFIER; } else if (column == 6 && (ch == '*' || ch == '/')) { // Cobol comment line: asterisk in column 7. ColourTo(styler, i-1, state); state = SCE_C_COMMENTLINE; } else if (ch == '*' && chNext == '>') { // Cobol inline comment: asterisk, followed by greater than. ColourTo(styler, i-1, state); state = SCE_C_COMMENTLINE; } else if (column == 0 && ch == '*' && chNext != '*') { ColourTo(styler, i-1, state); state = SCE_C_COMMENTLINE; } else if (column == 0 && ch == '/' && chNext != '*') { ColourTo(styler, i-1, state); state = SCE_C_COMMENTLINE; } else if (column == 0 && ch == '*' && chNext == '*') { ColourTo(styler, i-1, state); state = SCE_C_COMMENTDOC; } else if (column == 0 && ch == '/' && chNext == '*') { ColourTo(styler, i-1, state); state = SCE_C_COMMENTDOC; } else if (ch == '"') { ColourTo(styler, i-1, state); state = SCE_C_STRING; } else if (ch == '\'') { ColourTo(styler, i-1, state); state = SCE_C_CHARACTER; } else if (ch == '?' && column == 0) { ColourTo(styler, i-1, state); state = SCE_C_PREPROCESSOR; } else if (isCOBOLoperator(ch)) { ColourTo(styler, i-1, state); ColourTo(styler, i, SCE_C_OPERATOR); } } else if (state == SCE_C_IDENTIFIER) { if (!isCOBOLwordchar(ch)) { int lStateChange = classifyWordCOBOL(styler.GetStartSegment(), i - 1, keywordlists, styler, nContainment, &bAarea); if(lStateChange != 0) { styler.SetLineState(currentLine, lStateChange); nContainment = lStateChange; } state = SCE_C_DEFAULT; chNext = styler.SafeGetCharAt(i + 1); if (column == 6 && (ch == '*' || ch == '/')) { state = SCE_C_COMMENTLINE; } else if (ch == '"') { state = SCE_C_STRING; } else if (ch == '\'') { state = SCE_C_CHARACTER; } else if (isCOBOLoperator(ch)) { ColourTo(styler, i, SCE_C_OPERATOR); } } } else { if (state == SCE_C_PREPROCESSOR) { if ((ch == '\r' || ch == '\n') && !(chPrev == '\\' || chPrev == '\r')) { ColourTo(styler, i-1, state); state = SCE_C_DEFAULT; } } else if (state == SCE_C_COMMENT) { if (ch == '\r' || ch == '\n') { ColourTo(styler, i-1, state); state = SCE_C_DEFAULT; } } else if (state == SCE_C_COMMENTDOC) { if (ch == '\r' || ch == '\n') { if (((i > styler.GetStartSegment() + 2) || ( (initStyle == SCE_C_COMMENTDOC) && (styler.GetStartSegment() == static_cast(startPos))))) { ColourTo(styler, i-1, state); state = SCE_C_DEFAULT; } } } else if (state == SCE_C_COMMENTLINE) { if (ch == '\r' || ch == '\n') { ColourTo(styler, i-1, state); state = SCE_C_DEFAULT; } } else if (state == SCE_C_STRING) { if (ch == '"') { ColourTo(styler, i, state); state = SCE_C_DEFAULT; } else if (ch == '\r' || ch == '\n') { ColourTo(styler, i-1, state); state = SCE_C_DEFAULT; } } else if (state == SCE_C_CHARACTER) { if (ch == '\'') { ColourTo(styler, i, state); state = SCE_C_DEFAULT; } } } chPrev = ch; bNewLine = bSetNewLine; if (bNewLine) { bAarea = false; } } ColourTo(styler, lengthDoc - 1, state); } static void FoldCOBOLDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelPrev = lineCurrent > 0 ? styler.LevelAt(lineCurrent - 1) & SC_FOLDLEVELNUMBERMASK : 0xFFF; char chNext = styler[startPos]; bool bNewLine = true; bool bAarea = !isspacechar(chNext); int column = 0; bool bComment = false; for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); ++column; if (bNewLine) { column = 0; bComment = (ch == '*' || ch == '/' || ch == '?'); } if (column <= 1 && !bAarea) { bAarea = !isspacechar(ch); } bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (atEOL) { int nContainment = styler.GetLineState(lineCurrent); int lev = CountBits(nContainment & IN_FLAGS) | SC_FOLDLEVELBASE; if (bAarea && !bComment) --lev; if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if ((bAarea) && (visibleChars > 0) && !(nContainment & NOT_HEADER) && !bComment) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } if ((lev & SC_FOLDLEVELNUMBERMASK) <= (levelPrev & SC_FOLDLEVELNUMBERMASK)) { // this level is at the same level or less than the previous line // therefore these is nothing for the previous header to collapse, so remove the header styler.SetLevel(lineCurrent - 1, levelPrev & ~SC_FOLDLEVELHEADERFLAG); } levelPrev = lev; visibleChars = 0; bAarea = false; bNewLine = true; lineCurrent++; } else { bNewLine = false; } if (!isspacechar(ch)) visibleChars++; } // Fill in the real level of the next line, keeping the current flags as they will be filled in later int flagsNext = styler.LevelAt(lineCurrent) & ~SC_FOLDLEVELNUMBERMASK; styler.SetLevel(lineCurrent, levelPrev | flagsNext); } static const char * const COBOLWordListDesc[] = { "A Keywords", "B Keywords", "Extended Keywords", 0 }; LexerModule lmCOBOL(SCLEX_COBOL, ColouriseCOBOLDoc, "COBOL", FoldCOBOLDoc, COBOLWordListDesc); lexilla/lexers/LexCaml.cxx0000664000175000017500000002477214647367374014566 0ustar neilneil// Scintilla source code edit control /** @file LexCaml.cxx ** Lexer for Objective Caml. **/ // Copyright 2005-2009 by Robert Roessler // The License.txt file describes the conditions under which this software may be distributed. /* Release History 20050204 Initial release. 20050205 Quick compiler standards/"cleanliness" adjustment. 20050206 Added cast for IsLeadByte(). 20050209 Changes to "external" build support. 20050306 Fix for 1st-char-in-doc "corner" case. 20050502 Fix for [harmless] one-past-the-end coloring. 20050515 Refined numeric token recognition logic. 20051125 Added 2nd "optional" keywords class. 20051129 Support "magic" (read-only) comments for RCaml. 20051204 Swtich to using StyleContext infrastructure. 20090629 Add full Standard ML '97 support. */ #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" #if defined(__clang__) #pragma clang diagnostic ignored "-Wcomma" #endif // Since the Microsoft __iscsym[f] funcs are not ANSI... inline int iscaml(int c) {return isalnum(c) || c == '_';} inline int iscamlf(int c) {return isalpha(c) || c == '_';} static const int baseT[24] = { 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, /* A - L */ 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0,16 /* M - X */ }; using namespace Lexilla; static void ColouriseCamlDoc( Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { // initialize styler StyleContext sc(startPos, length, initStyle, styler); Sci_PositionU chToken = 0; int chBase = 0, chLit = 0; WordList& keywords = *keywordlists[0]; WordList& keywords2 = *keywordlists[1]; WordList& keywords3 = *keywordlists[2]; const bool isSML = keywords.InList("andalso"); const int useMagic = styler.GetPropertyInt("lexer.caml.magic", 0); // set up [initial] state info (terminating states that shouldn't "bleed") const int state_ = sc.state & 0x0f; if (state_ <= SCE_CAML_CHAR || (isSML && state_ == SCE_CAML_STRING)) sc.state = SCE_CAML_DEFAULT; int nesting = (state_ >= SCE_CAML_COMMENT)? (state_ - SCE_CAML_COMMENT): 0; // foreach char in range... while (sc.More()) { // set up [per-char] state info int state2 = -1; // (ASSUME no state change) Sci_Position chColor = sc.currentPos - 1;// (ASSUME standard coloring range) bool advance = true; // (ASSUME scanner "eats" 1 char) // step state machine switch (sc.state & 0x0f) { case SCE_CAML_DEFAULT: chToken = sc.currentPos; // save [possible] token start (JIC) // it's wide open; what do we have? if (iscamlf(sc.ch)) state2 = SCE_CAML_IDENTIFIER; else if (!isSML && sc.Match('`') && iscamlf(sc.chNext)) state2 = SCE_CAML_TAGNAME; else if (!isSML && sc.Match('#') && isdigit(sc.chNext)) state2 = SCE_CAML_LINENUM; else if (isdigit(sc.ch)) { // it's a number, assume base 10 state2 = SCE_CAML_NUMBER, chBase = 10; if (sc.Match('0')) { // there MAY be a base specified... const char* baseC = "bBoOxX"; if (isSML) { if (sc.chNext == 'w') sc.Forward(); // (consume SML "word" indicator) baseC = "x"; } // ... change to specified base AS REQUIRED if (strchr(baseC, sc.chNext)) chBase = baseT[tolower(sc.chNext) - 'a'], sc.Forward(); } } else if (!isSML && sc.Match('\'')) // (Caml char literal?) state2 = SCE_CAML_CHAR, chLit = 0; else if (isSML && sc.Match('#', '"')) // (SML char literal?) state2 = SCE_CAML_CHAR, sc.Forward(); else if (sc.Match('"')) state2 = SCE_CAML_STRING; else if (sc.Match('(', '*')) state2 = SCE_CAML_COMMENT, sc.Forward(), sc.ch = ' '; // (*)... else if (strchr("!?~" /* Caml "prefix-symbol" */ "=<>@^|&+-*/$%" /* Caml "infix-symbol" */ "()[]{};,:.#", sc.ch) // Caml "bracket" or ;,:.# // SML "extra" ident chars || (isSML && (sc.Match('\\') || sc.Match('`')))) state2 = SCE_CAML_OPERATOR; break; case SCE_CAML_IDENTIFIER: // [try to] interpret as [additional] identifier char if (!(iscaml(sc.ch) || sc.Match('\''))) { const Sci_Position n = sc.currentPos - chToken; if (n < 24) { // length is believable as keyword, [re-]construct token char t[24]; for (Sci_Position i = -n; i < 0; i++) t[n + i] = static_cast(sc.GetRelative(i)); t[n] = '\0'; // special-case "_" token as KEYWORD if ((n == 1 && sc.chPrev == '_') || keywords.InList(t)) sc.ChangeState(SCE_CAML_KEYWORD); else if (keywords2.InList(t)) sc.ChangeState(SCE_CAML_KEYWORD2); else if (keywords3.InList(t)) sc.ChangeState(SCE_CAML_KEYWORD3); } state2 = SCE_CAML_DEFAULT, advance = false; } break; case SCE_CAML_TAGNAME: // [try to] interpret as [additional] tagname char if (!(iscaml(sc.ch) || sc.Match('\''))) state2 = SCE_CAML_DEFAULT, advance = false; break; /*case SCE_CAML_KEYWORD: case SCE_CAML_KEYWORD2: case SCE_CAML_KEYWORD3: // [try to] interpret as [additional] keyword char if (!iscaml(ch)) state2 = SCE_CAML_DEFAULT, advance = false; break;*/ case SCE_CAML_LINENUM: // [try to] interpret as [additional] linenum directive char if (!isdigit(sc.ch)) state2 = SCE_CAML_DEFAULT, advance = false; break; case SCE_CAML_OPERATOR: { // [try to] interpret as [additional] operator char const char* o = 0; if (iscaml(sc.ch) || isspace(sc.ch) // ident or whitespace || (o = strchr(")]};,\'\"#", sc.ch),o) // "termination" chars || (!isSML && sc.Match('`')) // Caml extra term char || (!strchr("!$%&*+-./:<=>?@^|~", sc.ch)// "operator" chars // SML extra ident chars && !(isSML && (sc.Match('\\') || sc.Match('`'))))) { // check for INCLUSIVE termination if (o && strchr(")]};,", sc.ch)) { if ((sc.Match(')') && sc.chPrev == '(') || (sc.Match(']') && sc.chPrev == '[')) // special-case "()" and "[]" tokens as KEYWORDS sc.ChangeState(SCE_CAML_KEYWORD); chColor++; } else advance = false; state2 = SCE_CAML_DEFAULT; } break; } case SCE_CAML_NUMBER: // [try to] interpret as [additional] numeric literal char if ((!isSML && sc.Match('_')) || IsADigit(sc.ch, chBase)) break; // how about an integer suffix? if (!isSML && (sc.Match('l') || sc.Match('L') || sc.Match('n')) && (sc.chPrev == '_' || IsADigit(sc.chPrev, chBase))) break; // or a floating-point literal? if (chBase == 10) { // with a decimal point? if (sc.Match('.') && ((!isSML && sc.chPrev == '_') || IsADigit(sc.chPrev, chBase))) break; // with an exponent? (I) if ((sc.Match('e') || sc.Match('E')) && ((!isSML && (sc.chPrev == '.' || sc.chPrev == '_')) || IsADigit(sc.chPrev, chBase))) break; // with an exponent? (II) if (((!isSML && (sc.Match('+') || sc.Match('-'))) || (isSML && sc.Match('~'))) && (sc.chPrev == 'e' || sc.chPrev == 'E')) break; } // it looks like we have run out of number state2 = SCE_CAML_DEFAULT, advance = false; break; case SCE_CAML_CHAR: if (!isSML) { // [try to] interpret as [additional] char literal char if (sc.Match('\\')) { chLit = 1; // (definitely IS a char literal) if (sc.chPrev == '\\') sc.ch = ' '; // (...\\') // should we be terminating - one way or another? } else if ((sc.Match('\'') && sc.chPrev != '\\') || sc.atLineEnd) { state2 = SCE_CAML_DEFAULT; if (sc.Match('\'')) chColor++; else sc.ChangeState(SCE_CAML_IDENTIFIER); // ... maybe a char literal, maybe not } else if (chLit < 1 && sc.currentPos - chToken >= 2) sc.ChangeState(SCE_CAML_IDENTIFIER), advance = false; break; }/* else // fall through for SML char literal (handle like string) */ // Falls through. case SCE_CAML_STRING: // [try to] interpret as [additional] [SML char/] string literal char if (isSML && sc.Match('\\') && sc.chPrev != '\\' && isspace(sc.chNext)) state2 = SCE_CAML_WHITE; else if (sc.Match('\\') && sc.chPrev == '\\') sc.ch = ' '; // (...\\") // should we be terminating - one way or another? else if ((sc.Match('"') && sc.chPrev != '\\') || (isSML && sc.atLineEnd)) { state2 = SCE_CAML_DEFAULT; if (sc.Match('"')) chColor++; } break; case SCE_CAML_WHITE: // [try to] interpret as [additional] SML embedded whitespace char if (sc.Match('\\')) { // style this puppy NOW... state2 = SCE_CAML_STRING, sc.ch = ' ' /* (...\") */, chColor++, styler.ColourTo(chColor, SCE_CAML_WHITE), styler.Flush(); // ... then backtrack to determine original SML literal type Sci_Position p = chColor - 2; for (; p >= 0 && styler.StyleAt(p) == SCE_CAML_WHITE; p--) ; if (p >= 0) state2 = static_cast(styler.StyleAt(p)); // take care of state change NOW sc.ChangeState(state2), state2 = -1; } break; case SCE_CAML_COMMENT: case SCE_CAML_COMMENT1: case SCE_CAML_COMMENT2: case SCE_CAML_COMMENT3: // we're IN a comment - does this start a NESTED comment? if (sc.Match('(', '*')) state2 = sc.state + 1, chToken = sc.currentPos, sc.Forward(), sc.ch = ' ' /* (*)... */, nesting++; // [try to] interpret as [additional] comment char else if (sc.Match(')') && sc.chPrev == '*') { if (nesting) state2 = (sc.state & 0x0f) - 1, chToken = 0, nesting--; else state2 = SCE_CAML_DEFAULT; chColor++; // enable "magic" (read-only) comment AS REQUIRED } else if (useMagic && sc.currentPos - chToken == 4 && sc.Match('c') && sc.chPrev == 'r' && sc.GetRelative(-2) == '@') sc.state |= 0x10; // (switch to read-only comment style) break; } // handle state change and char coloring AS REQUIRED if (state2 >= 0) styler.ColourTo(chColor, sc.state), sc.ChangeState(state2); // move to next char UNLESS re-scanning current char if (advance) sc.Forward(); } // do any required terminal char coloring (JIC) sc.Complete(); } static void FoldCamlDoc( Sci_PositionU, Sci_Position, int, WordList *[], Accessor &) { } static const char * const camlWordListDesc[] = { "Keywords", // primary Objective Caml keywords "Keywords2", // "optional" keywords (typically from Pervasives) "Keywords3", // "optional" keywords (typically typenames) 0 }; LexerModule lmCaml(SCLEX_CAML, ColouriseCamlDoc, "caml", FoldCamlDoc, camlWordListDesc); lexilla/lexers/LexGDScript.cxx0000664000175000017500000005765514647367374015377 0ustar neilneil// Scintilla source code edit control /** @file LexGDScript.cxx ** Lexer for GDScript. **/ // Copyright 1998-2002 by Neil Hodgson // Heavily modified later for GDScript // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "StringCopy.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "CharacterCategory.h" #include "LexerModule.h" #include "OptionSet.h" #include "SubStyles.h" #include "DefaultLexer.h" using namespace Scintilla; using namespace Lexilla; namespace { enum kwType { kwOther, kwClass, kwDef, kwExtends}; constexpr int indicatorWhitespace = 1; bool IsGDStringStart(int ch) { return (ch == '\'' || ch == '"'); } bool IsGDComment(Accessor &styler, Sci_Position pos, Sci_Position len) { return len > 0 && styler[pos] == '#'; } constexpr bool IsGDSingleQuoteStringState(int st) noexcept { return ((st == SCE_GD_CHARACTER) || (st == SCE_GD_STRING)); } constexpr bool IsGDTripleQuoteStringState(int st) noexcept { return ((st == SCE_GD_TRIPLE) || (st == SCE_GD_TRIPLEDOUBLE)); } char GetGDStringQuoteChar(int st) noexcept { if ((st == SCE_GD_CHARACTER) || (st == SCE_GD_TRIPLE)) return '\''; if ((st == SCE_GD_STRING) || (st == SCE_GD_TRIPLEDOUBLE)) return '"'; return '\0'; } /* Return the state to use for the string starting at i; *nextIndex will be set to the first index following the quote(s) */ int GetGDStringState(Accessor &styler, Sci_Position i, Sci_PositionU *nextIndex) { char ch = styler.SafeGetCharAt(i); char chNext = styler.SafeGetCharAt(i + 1); if (ch != '"' && ch != '\'') { *nextIndex = i + 1; return SCE_GD_DEFAULT; } if (ch == chNext && ch == styler.SafeGetCharAt(i + 2)) { *nextIndex = i + 3; if (ch == '"') return SCE_GD_TRIPLEDOUBLE; else return SCE_GD_TRIPLE; } else { *nextIndex = i + 1; if (ch == '"') return SCE_GD_STRING; else return SCE_GD_CHARACTER; } } int GetGDStringState(int ch) { if (ch != '"' && ch != '\'') return SCE_GD_DEFAULT; if (ch == '"') return SCE_GD_STRING; else return SCE_GD_CHARACTER; } inline bool IsAWordChar(int ch, bool unicodeIdentifiers) { if (IsASCII(ch)) return (IsAlphaNumeric(ch) || ch == '.' || ch == '_'); if (!unicodeIdentifiers) return false; return IsXidContinue(ch); } inline bool IsANodePathChar(int ch, bool unicodeIdentifiers) { if (IsASCII(ch)) return (IsAlphaNumeric(ch) || ch == '_' || ch == '/' || ch =='%'); if (!unicodeIdentifiers) return false; return IsXidContinue(ch); } inline bool IsAWordStart(int ch, bool unicodeIdentifiers) { if (IsASCII(ch)) return (IsUpperOrLowerCase(ch) || ch == '_'); if (!unicodeIdentifiers) return false; return IsXidStart(ch); } bool IsFirstNonWhitespace(Sci_Position pos, Accessor &styler) { const Sci_Position line = styler.GetLine(pos); const Sci_Position start_pos = styler.LineStart(line); for (Sci_Position i = start_pos; i < pos; i++) { const char ch = styler[i]; if (!(ch == ' ' || ch == '\t')) return false; } return true; } // Options used for LexerGDScript struct OptionsGDScript { int whingeLevel; bool base2or8Literals; bool stringsOverNewline; bool keywords2NoSubIdentifiers; bool fold; bool foldQuotes; bool foldCompact; bool unicodeIdentifiers; OptionsGDScript() noexcept { whingeLevel = 0; base2or8Literals = true; stringsOverNewline = false; keywords2NoSubIdentifiers = false; fold = false; foldQuotes = false; foldCompact = false; unicodeIdentifiers = true; } }; const char *const gdscriptWordListDesc[] = { "Keywords", "Highlighted identifiers", nullptr }; struct OptionSetGDScript : public OptionSet { OptionSetGDScript() { DefineProperty("lexer.gdscript.whinge.level", &OptionsGDScript::whingeLevel, "For GDScript code, checks whether indenting is consistent. " "The default, 0 turns off indentation checking, " "1 checks whether each line is potentially inconsistent with the previous line, " "2 checks whether any space characters occur before a tab character in the indentation, " "3 checks whether any spaces are in the indentation, and " "4 checks for any tab characters in the indentation. " "1 is a good level to use."); DefineProperty("lexer.gdscript.literals.binary", &OptionsGDScript::base2or8Literals, "Set to 0 to not recognise binary and octal literals: 0b1011 0o712."); DefineProperty("lexer.gdscript.strings.over.newline", &OptionsGDScript::stringsOverNewline, "Set to 1 to allow strings to span newline characters."); DefineProperty("lexer.gdscript.keywords2.no.sub.identifiers", &OptionsGDScript::keywords2NoSubIdentifiers, "When enabled, it will not style keywords2 items that are used as a sub-identifier. " "Example: when set, will not highlight \"foo.open\" when \"open\" is a keywords2 item."); DefineProperty("fold", &OptionsGDScript::fold); DefineProperty("fold.gdscript.quotes", &OptionsGDScript::foldQuotes, "This option enables folding multi-line quoted strings when using the GDScript lexer."); DefineProperty("fold.compact", &OptionsGDScript::foldCompact); DefineProperty("lexer.gdscript.unicode.identifiers", &OptionsGDScript::unicodeIdentifiers, "Set to 0 to not recognise Unicode identifiers."); DefineWordListSets(gdscriptWordListDesc); } }; const char styleSubable[] = { SCE_GD_IDENTIFIER, 0 }; LexicalClass lexicalClasses[] = { // Lexer GDScript SCLEX_GDSCRIPT SCE_GD_: 0, "SCE_GD_DEFAULT", "default", "White space", 1, "SCE_GD_COMMENTLINE", "comment line", "Comment", 2, "SCE_GD_NUMBER", "literal numeric", "Number", 3, "SCE_GD_STRING", "literal string", "String", 4, "SCE_GD_CHARACTER", "literal string", "Single quoted string", 5, "SCE_GD_WORD", "keyword", "Keyword", 6, "SCE_GD_TRIPLE", "literal string", "Triple quotes", 7, "SCE_GD_TRIPLEDOUBLE", "literal string", "Triple double quotes", 8, "SCE_GD_CLASSNAME", "identifier", "Class name definition", 9, "SCE_GD_FUNCNAME", "identifier", "Function or method name definition", 10, "SCE_GD_OPERATOR", "operator", "Operators", 11, "SCE_GD_IDENTIFIER", "identifier", "Identifiers", 12, "SCE_GD_COMMENTBLOCK", "comment", "Comment-blocks", 13, "SCE_GD_STRINGEOL", "error literal string", "End of line where string is not closed", 14, "SCE_GD_WORD2", "identifier", "Highlighted identifiers", 15, "SCE_GD_ANNOTATION", "annotation", "Annotations", 16, "SCE_GD_NODEPATH", "path", "Node path", }; } class LexerGDScript : public DefaultLexer { WordList keywords; WordList keywords2; OptionsGDScript options; OptionSetGDScript osGDScript; enum { ssIdentifier }; SubStyles subStyles{styleSubable}; public: explicit LexerGDScript() : DefaultLexer("gdscript", SCLEX_GDSCRIPT, lexicalClasses, ELEMENTS(lexicalClasses)) { } ~LexerGDScript() override { } void SCI_METHOD Release() override { delete this; } int SCI_METHOD Version() const override { return lvRelease5; } const char *SCI_METHOD PropertyNames() override { return osGDScript.PropertyNames(); } int SCI_METHOD PropertyType(const char *name) override { return osGDScript.PropertyType(name); } const char *SCI_METHOD DescribeProperty(const char *name) override { return osGDScript.DescribeProperty(name); } Sci_Position SCI_METHOD PropertySet(const char *key, const char *val) override; const char * SCI_METHOD PropertyGet(const char *key) override { return osGDScript.PropertyGet(key); } const char *SCI_METHOD DescribeWordListSets() override { return osGDScript.DescribeWordListSets(); } Sci_Position SCI_METHOD WordListSet(int n, const char *wl) override; void SCI_METHOD Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void SCI_METHOD Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void *SCI_METHOD PrivateCall(int, void *) override { return nullptr; } int SCI_METHOD LineEndTypesSupported() override { return SC_LINE_END_TYPE_UNICODE; } int SCI_METHOD AllocateSubStyles(int styleBase, int numberStyles) override { return subStyles.Allocate(styleBase, numberStyles); } int SCI_METHOD SubStylesStart(int styleBase) override { return subStyles.Start(styleBase); } int SCI_METHOD SubStylesLength(int styleBase) override { return subStyles.Length(styleBase); } int SCI_METHOD StyleFromSubStyle(int subStyle) override { const int styleBase = subStyles.BaseStyle(subStyle); return styleBase; } int SCI_METHOD PrimaryStyleFromStyle(int style) override { return style; } void SCI_METHOD FreeSubStyles() override { subStyles.Free(); } void SCI_METHOD SetIdentifiers(int style, const char *identifiers) override { subStyles.SetIdentifiers(style, identifiers); } int SCI_METHOD DistanceToSecondaryStyles() override { return 0; } const char *SCI_METHOD GetSubStyleBases() override { return styleSubable; } static ILexer5 *LexerFactoryGDScript() { return new LexerGDScript(); } private: void ProcessLineEnd(StyleContext &sc, bool &inContinuedString); }; Sci_Position SCI_METHOD LexerGDScript::PropertySet(const char *key, const char *val) { if (osGDScript.PropertySet(&options, key, val)) { return 0; } return -1; } Sci_Position SCI_METHOD LexerGDScript::WordListSet(int n, const char *wl) { WordList *wordListN = nullptr; switch (n) { case 0: wordListN = &keywords; break; case 1: wordListN = &keywords2; break; default: break; } Sci_Position firstModification = -1; if (wordListN) { WordList wlNew; wlNew.Set(wl); if (*wordListN != wlNew) { wordListN->Set(wl); firstModification = 0; } } return firstModification; } void LexerGDScript::ProcessLineEnd(StyleContext &sc, bool &inContinuedString) { if ((sc.state == SCE_GD_DEFAULT) || IsGDTripleQuoteStringState(sc.state)) { // Perform colourisation of white space and triple quoted strings at end of each line to allow // tab marking to work inside white space and triple quoted strings sc.SetState(sc.state); } if (IsGDSingleQuoteStringState(sc.state)) { if (inContinuedString || options.stringsOverNewline) { inContinuedString = false; } else { sc.ChangeState(SCE_GD_STRINGEOL); sc.ForwardSetState(SCE_GD_DEFAULT); } } } void SCI_METHOD LexerGDScript::Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { Accessor styler(pAccess, nullptr); const Sci_Position endPos = startPos + length; // Backtrack to previous line in case need to fix its tab whinging Sci_Position lineCurrent = styler.GetLine(startPos); if (startPos > 0) { if (lineCurrent > 0) { lineCurrent--; // Look for backslash-continued lines while (lineCurrent > 0) { const Sci_Position eolPos = styler.LineStart(lineCurrent) - 1; const int eolStyle = styler.StyleAt(eolPos); if (eolStyle == SCE_GD_STRING || eolStyle == SCE_GD_CHARACTER || eolStyle == SCE_GD_STRINGEOL) { lineCurrent -= 1; } else { break; } } startPos = styler.LineStart(lineCurrent); } initStyle = startPos == 0 ? SCE_GD_DEFAULT : styler.StyleAt(startPos - 1); } initStyle = initStyle & 31; if (initStyle == SCE_GD_STRINGEOL) { initStyle = SCE_GD_DEFAULT; } kwType kwLast = kwOther; int spaceFlags = 0; styler.IndentAmount(lineCurrent, &spaceFlags, IsGDComment); bool base_n_number = false; const WordClassifier &classifierIdentifiers = subStyles.Classifier(SCE_GD_IDENTIFIER); StyleContext sc(startPos, endPos - startPos, initStyle, styler); bool indentGood = true; Sci_Position startIndicator = sc.currentPos; bool inContinuedString = false; bool percentIsNodePath = false; int nodePathStringState = SCE_GD_DEFAULT; for (; sc.More(); sc.Forward()) { if (sc.atLineStart) { styler.IndentAmount(lineCurrent, &spaceFlags, IsGDComment); indentGood = true; if (options.whingeLevel == 1) { indentGood = (spaceFlags & wsInconsistent) == 0; } else if (options.whingeLevel == 2) { indentGood = (spaceFlags & wsSpaceTab) == 0; } else if (options.whingeLevel == 3) { indentGood = (spaceFlags & wsSpace) == 0; } else if (options.whingeLevel == 4) { indentGood = (spaceFlags & wsTab) == 0; } if (!indentGood) { styler.IndicatorFill(startIndicator, sc.currentPos, indicatorWhitespace, 0); startIndicator = sc.currentPos; } } if (sc.atLineEnd) { percentIsNodePath = false; ProcessLineEnd(sc, inContinuedString); lineCurrent++; if (!sc.More()) break; } bool needEOLCheck = false; if (sc.state == SCE_GD_OPERATOR) { kwLast = kwOther; sc.SetState(SCE_GD_DEFAULT); } else if (sc.state == SCE_GD_NUMBER) { if (!IsAWordChar(sc.ch, false) && !(!base_n_number && ((sc.ch == '+' || sc.ch == '-') && (sc.chPrev == 'e' || sc.chPrev == 'E')))) { sc.SetState(SCE_GD_DEFAULT); } } else if (sc.state == SCE_GD_IDENTIFIER) { if ((sc.ch == '.') || (!IsAWordChar(sc.ch, options.unicodeIdentifiers))) { char s[100]; sc.GetCurrent(s, sizeof(s)); int style = SCE_GD_IDENTIFIER; if (keywords.InList(s)) { style = SCE_GD_WORD; } else if (kwLast == kwClass) { style = SCE_GD_CLASSNAME; } else if (kwLast == kwDef) { style = SCE_GD_FUNCNAME; } else if (keywords2.InList(s)) { if (options.keywords2NoSubIdentifiers) { // We don't want to highlight keywords2 // that are used as a sub-identifier, // i.e. not open in "foo.open". const Sci_Position pos = styler.GetStartSegment() - 1; if (pos < 0 || (styler.SafeGetCharAt(pos, '\0') != '.')) style = SCE_GD_WORD2; } else { style = SCE_GD_WORD2; } } else { const int subStyle = classifierIdentifiers.ValueFor(s); if (subStyle >= 0) { style = subStyle; } } sc.ChangeState(style); sc.SetState(SCE_GD_DEFAULT); if (style == SCE_GD_WORD) { if (0 == strcmp(s, "class")) kwLast = kwClass; else if (0 == strcmp(s, "func")) kwLast = kwDef; else if (0 == strcmp(s, "extends")) kwLast = kwExtends; else kwLast = kwOther; } else { kwLast = kwOther; } } } else if ((sc.state == SCE_GD_COMMENTLINE) || (sc.state == SCE_GD_COMMENTBLOCK)) { if (sc.ch == '\r' || sc.ch == '\n') { sc.SetState(SCE_GD_DEFAULT); } } else if (sc.state == SCE_GD_ANNOTATION) { if (!IsAWordStart(sc.ch, options.unicodeIdentifiers)) { sc.SetState(SCE_GD_DEFAULT); } } else if (sc.state == SCE_GD_NODEPATH) { if (nodePathStringState != SCE_GD_DEFAULT) { if (sc.ch == GetGDStringQuoteChar(nodePathStringState) ) { nodePathStringState = SCE_GD_DEFAULT; } } else { if (IsGDStringStart(sc.ch)) { nodePathStringState = GetGDStringState(sc.ch); } else if (!IsANodePathChar(sc.ch, options.unicodeIdentifiers)) { sc.SetState(SCE_GD_DEFAULT); } } } else if (IsGDSingleQuoteStringState(sc.state)) { if (sc.ch == '\\') { if ((sc.chNext == '\r') && (sc.GetRelative(2) == '\n')) { sc.Forward(); } if (sc.chNext == '\n' || sc.chNext == '\r') { inContinuedString = true; } else { // Don't roll over the newline. sc.Forward(); } } else if (sc.ch == GetGDStringQuoteChar(sc.state)) { sc.ForwardSetState(SCE_GD_DEFAULT); needEOLCheck = true; } } else if (sc.state == SCE_GD_TRIPLE) { if (sc.ch == '\\') { sc.Forward(); } else if (sc.Match(R"(''')")) { sc.Forward(); sc.Forward(); sc.ForwardSetState(SCE_GD_DEFAULT); needEOLCheck = true; } } else if (sc.state == SCE_GD_TRIPLEDOUBLE) { if (sc.ch == '\\') { sc.Forward(); } else if (sc.Match(R"(""")")) { sc.Forward(); sc.Forward(); sc.ForwardSetState(SCE_GD_DEFAULT); needEOLCheck = true; } } if (!indentGood && !IsASpaceOrTab(sc.ch)) { styler.IndicatorFill(startIndicator, sc.currentPos, indicatorWhitespace, 1); startIndicator = sc.currentPos; indentGood = true; } // State exit code may have moved on to end of line if (needEOLCheck && sc.atLineEnd) { ProcessLineEnd(sc, inContinuedString); lineCurrent++; styler.IndentAmount(lineCurrent, &spaceFlags, IsGDComment); if (!sc.More()) break; } // Check for a new state starting character if (sc.state == SCE_GD_DEFAULT) { if (IsADigit(sc.ch) || (sc.ch == '.' && IsADigit(sc.chNext))) { if (sc.ch == '0' && (sc.chNext == 'x' || sc.chNext == 'X')) { base_n_number = true; sc.SetState(SCE_GD_NUMBER); } else if (sc.ch == '0' && (sc.chNext == 'o' || sc.chNext == 'O' || sc.chNext == 'b' || sc.chNext == 'B')) { if (options.base2or8Literals) { base_n_number = true; sc.SetState(SCE_GD_NUMBER); } else { sc.SetState(SCE_GD_NUMBER); sc.ForwardSetState(SCE_GD_IDENTIFIER); } } else { base_n_number = false; sc.SetState(SCE_GD_NUMBER); } } else if ((sc.ch == '$') || (sc.ch == '%' && (percentIsNodePath || IsFirstNonWhitespace(sc.currentPos, styler)))) { percentIsNodePath = false; sc.SetState(SCE_GD_NODEPATH); } else if (isoperator(sc.ch) || sc.ch == '`') { percentIsNodePath = !((sc.ch == ')') || (sc.ch == ']') || (sc.ch == '}')); sc.SetState(SCE_GD_OPERATOR); } else if (sc.ch == '#') { sc.SetState(sc.chNext == '#' ? SCE_GD_COMMENTBLOCK : SCE_GD_COMMENTLINE); } else if (sc.ch == '@') { if (IsFirstNonWhitespace(sc.currentPos, styler)) sc.SetState(SCE_GD_ANNOTATION); else sc.SetState(SCE_GD_OPERATOR); } else if (IsGDStringStart(sc.ch)) { Sci_PositionU nextIndex = 0; sc.SetState(GetGDStringState(styler, sc.currentPos, &nextIndex)); while (nextIndex > (sc.currentPos + 1) && sc.More()) { sc.Forward(); } } else if (IsAWordStart(sc.ch, options.unicodeIdentifiers)) { sc.SetState(SCE_GD_IDENTIFIER); } } } styler.IndicatorFill(startIndicator, sc.currentPos, indicatorWhitespace, 0); sc.Complete(); } static bool IsCommentLine(Sci_Position line, Accessor &styler) { const Sci_Position pos = styler.LineStart(line); const Sci_Position eol_pos = styler.LineStart(line + 1) - 1; for (Sci_Position i = pos; i < eol_pos; i++) { const char ch = styler[i]; if (ch == '#') return true; else if (ch != ' ' && ch != '\t') return false; } return false; } static bool IsQuoteLine(Sci_Position line, const Accessor &styler) { const int style = styler.StyleAt(styler.LineStart(line)) & 31; return IsGDTripleQuoteStringState(style); } void SCI_METHOD LexerGDScript::Fold(Sci_PositionU startPos, Sci_Position length, int /*initStyle - unused*/, IDocument *pAccess) { if (!options.fold) return; Accessor styler(pAccess, nullptr); const Sci_Position maxPos = startPos + length; const Sci_Position maxLines = (maxPos == styler.Length()) ? styler.GetLine(maxPos) : styler.GetLine(maxPos - 1); // Requested last line const Sci_Position docLines = styler.GetLine(styler.Length()); // Available last line // Backtrack to previous non-blank line so we can determine indent level // for any white space lines (needed esp. within triple quoted strings) // and so we can fix any preceding fold level (which is why we go back // at least one line in all cases) int spaceFlags = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int indentCurrent = styler.IndentAmount(lineCurrent, &spaceFlags, nullptr); while (lineCurrent > 0) { lineCurrent--; indentCurrent = styler.IndentAmount(lineCurrent, &spaceFlags, nullptr); if (!(indentCurrent & SC_FOLDLEVELWHITEFLAG) && (!IsCommentLine(lineCurrent, styler)) && (!IsQuoteLine(lineCurrent, styler))) break; } int indentCurrentLevel = indentCurrent & SC_FOLDLEVELNUMBERMASK; // Set up initial loop state startPos = styler.LineStart(lineCurrent); int prev_state = SCE_GD_DEFAULT & 31; if (lineCurrent >= 1) prev_state = styler.StyleAt(startPos - 1) & 31; int prevQuote = options.foldQuotes && IsGDTripleQuoteStringState(prev_state); // Process all characters to end of requested range or end of any triple quote //that hangs over the end of the range. Cap processing in all cases // to end of document (in case of unclosed quote at end). while ((lineCurrent <= docLines) && ((lineCurrent <= maxLines) || prevQuote)) { // Gather info int lev = indentCurrent; Sci_Position lineNext = lineCurrent + 1; int indentNext = indentCurrent; int quote = false; if (lineNext <= docLines) { // Information about next line is only available if not at end of document indentNext = styler.IndentAmount(lineNext, &spaceFlags, nullptr); const Sci_Position lookAtPos = (styler.LineStart(lineNext) == styler.Length()) ? styler.Length() - 1 : styler.LineStart(lineNext); const int style = styler.StyleAt(lookAtPos) & 31; quote = options.foldQuotes && IsGDTripleQuoteStringState(style); } const bool quote_start = (quote && !prevQuote); const bool quote_continue = (quote && prevQuote); if (!quote || !prevQuote) indentCurrentLevel = indentCurrent & SC_FOLDLEVELNUMBERMASK; if (quote) indentNext = indentCurrentLevel; if (indentNext & SC_FOLDLEVELWHITEFLAG) indentNext = SC_FOLDLEVELWHITEFLAG | indentCurrentLevel; if (quote_start) { // Place fold point at start of triple quoted string lev |= SC_FOLDLEVELHEADERFLAG; } else if (quote_continue || prevQuote) { // Add level to rest of lines in the string lev = lev + 1; } // Skip past any blank lines for next indent level info; we skip also // comments (all comments, not just those starting in column 0) // which effectively folds them into surrounding code rather // than screwing up folding. If comments end file, use the min // comment indent as the level after int minCommentLevel = indentCurrentLevel; while (!quote && (lineNext < docLines) && ((indentNext & SC_FOLDLEVELWHITEFLAG) || (IsCommentLine(lineNext, styler)))) { if (IsCommentLine(lineNext, styler) && indentNext < minCommentLevel) { minCommentLevel = indentNext; } lineNext++; indentNext = styler.IndentAmount(lineNext, &spaceFlags, nullptr); } const int levelAfterComments = ((lineNext < docLines) ? indentNext & SC_FOLDLEVELNUMBERMASK : minCommentLevel); const int levelBeforeComments = std::max(indentCurrentLevel, levelAfterComments); // Now set all the indent levels on the lines we skipped // Do this from end to start. Once we encounter one line // which is indented more than the line after the end of // the comment-block, use the level of the block before Sci_Position skipLine = lineNext; int skipLevel = levelAfterComments; while (--skipLine > lineCurrent) { const int skipLineIndent = styler.IndentAmount(skipLine, &spaceFlags, nullptr); if (options.foldCompact) { if ((skipLineIndent & SC_FOLDLEVELNUMBERMASK) > levelAfterComments) skipLevel = levelBeforeComments; const int whiteFlag = skipLineIndent & SC_FOLDLEVELWHITEFLAG; styler.SetLevel(skipLine, skipLevel | whiteFlag); } else { if ((skipLineIndent & SC_FOLDLEVELNUMBERMASK) > levelAfterComments && !(skipLineIndent & SC_FOLDLEVELWHITEFLAG) && !IsCommentLine(skipLine, styler)) skipLevel = levelBeforeComments; styler.SetLevel(skipLine, skipLevel); } } // Set fold header on non-quote line if (!quote && !(indentCurrent & SC_FOLDLEVELWHITEFLAG)) { if ((indentCurrent & SC_FOLDLEVELNUMBERMASK) < (indentNext & SC_FOLDLEVELNUMBERMASK)) lev |= SC_FOLDLEVELHEADERFLAG; } // Keep track of triple quote state of previous line prevQuote = quote; // Set fold level for this line and move to next line styler.SetLevel(lineCurrent, options.foldCompact ? lev : lev & ~SC_FOLDLEVELWHITEFLAG); indentCurrent = indentNext; lineCurrent = lineNext; } // NOTE: Cannot set level of last line here because indentCurrent doesn't have // header flag set; the loop above is crafted to take care of this case! //styler.SetLevel(lineCurrent, indentCurrent); } LexerModule lmGDScript(SCLEX_GDSCRIPT, LexerGDScript::LexerFactoryGDScript, "gdscript", gdscriptWordListDesc); lexilla/lexers/LexRegistry.cxx0000664000175000017500000002633114647367374015513 0ustar neilneil// Scintilla source code edit control /** * @file LexRegistry.cxx * @date July 26 2014 * @brief Lexer for Windows registration files(.reg) * @author nkmathew * * The License.txt file describes the conditions under which this software may be * distributed. * */ #include #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" #include "OptionSet.h" #include "DefaultLexer.h" using namespace Scintilla; using namespace Lexilla; static const char *const RegistryWordListDesc[] = { 0 }; struct OptionsRegistry { bool foldCompact = false; bool fold = false; }; struct OptionSetRegistry : public OptionSet { OptionSetRegistry() { DefineProperty("fold.compact", &OptionsRegistry::foldCompact); DefineProperty("fold", &OptionsRegistry::fold); DefineWordListSets(RegistryWordListDesc); } }; class LexerRegistry : public DefaultLexer { OptionsRegistry options; OptionSetRegistry optSetRegistry; static bool IsStringState(int state) { return (state == SCE_REG_VALUENAME || state == SCE_REG_STRING); } static bool IsKeyPathState(int state) { return (state == SCE_REG_ADDEDKEY || state == SCE_REG_DELETEDKEY); } static bool AtValueType(LexAccessor &styler, Sci_Position start) { Sci_Position i = 0; while (i < 10) { i++; char curr = styler.SafeGetCharAt(start+i, '\0'); if (curr == ':') { return true; } else if (!curr) { return false; } } return false; } static bool IsNextNonWhitespace(LexAccessor &styler, Sci_Position start, char ch) { Sci_Position i = 0; while (i < 100) { i++; char curr = styler.SafeGetCharAt(start+i, '\0'); char next = styler.SafeGetCharAt(start+i+1, '\0'); bool atEOL = (curr == '\r' && next != '\n') || (curr == '\n'); if (curr == ch) { return true; } else if (!isspacechar(curr) || atEOL) { return false; } } return false; } // Looks for the equal sign at the end of the string static bool AtValueName(LexAccessor &styler, Sci_Position start) { bool atEOL = false; Sci_Position i = 0; bool escaped = false; while (!atEOL) { i++; char curr = styler.SafeGetCharAt(start+i, '\0'); char next = styler.SafeGetCharAt(start+i+1, '\0'); atEOL = (curr == '\r' && next != '\n') || (curr == '\n'); if (escaped) { escaped = false; continue; } escaped = curr == '\\'; if (curr == '"') { return IsNextNonWhitespace(styler, start+i, '='); } else if (!curr) { return false; } } return false; } static bool AtKeyPathEnd(LexAccessor &styler, Sci_Position start) { bool atEOL = false; Sci_Position i = 0; while (!atEOL) { i++; char curr = styler.SafeGetCharAt(start+i, '\0'); char next = styler.SafeGetCharAt(start+i+1, '\0'); atEOL = (curr == '\r' && next != '\n') || (curr == '\n'); if (curr == ']' || !curr) { // There's still at least one or more square brackets ahead return false; } } return true; } static bool AtGUID(LexAccessor &styler, Sci_Position start) { int count = 8; int portion = 0; int offset = 1; char digit = '\0'; while (portion < 5) { int i = 0; while (i < count) { digit = styler.SafeGetCharAt(start+offset); if (!(isxdigit(digit) || digit == '-')) { return false; } offset++; i++; } portion++; count = (portion == 4) ? 13 : 5; } digit = styler.SafeGetCharAt(start+offset); if (digit == '}') { return true; } else { return false; } } public: LexerRegistry() : DefaultLexer("registry", SCLEX_REGISTRY) {} virtual ~LexerRegistry() {} int SCI_METHOD Version() const override { return lvRelease5; } void SCI_METHOD Release() override { delete this; } const char *SCI_METHOD PropertyNames() override { return optSetRegistry.PropertyNames(); } int SCI_METHOD PropertyType(const char *name) override { return optSetRegistry.PropertyType(name); } const char *SCI_METHOD DescribeProperty(const char *name) override { return optSetRegistry.DescribeProperty(name); } Sci_Position SCI_METHOD PropertySet(const char *key, const char *val) override { if (optSetRegistry.PropertySet(&options, key, val)) { return 0; } return -1; } const char * SCI_METHOD PropertyGet(const char *key) override { return optSetRegistry.PropertyGet(key); } Sci_Position SCI_METHOD WordListSet(int, const char *) override { return -1; } void *SCI_METHOD PrivateCall(int, void *) override { return 0; } static ILexer5 *LexerFactoryRegistry() { return new LexerRegistry; } const char *SCI_METHOD DescribeWordListSets() override { return optSetRegistry.DescribeWordListSets(); } void SCI_METHOD Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void SCI_METHOD Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; }; void SCI_METHOD LexerRegistry::Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { int beforeGUID = SCE_REG_DEFAULT; int beforeEscape = SCE_REG_DEFAULT; CharacterSet setOperators = CharacterSet(CharacterSet::setNone, "-,.=:\\@()"); LexAccessor styler(pAccess); StyleContext context(startPos, length, initStyle, styler); bool highlight = true; bool afterEqualSign = false; while (context.More()) { if (context.atLineStart) { Sci_Position currPos = static_cast(context.currentPos); bool continued = styler[currPos-3] == '\\'; highlight = continued ? true : false; } switch (context.state) { case SCE_REG_COMMENT: if (context.atLineEnd) { context.SetState(SCE_REG_DEFAULT); } break; case SCE_REG_VALUENAME: case SCE_REG_STRING: { Sci_Position currPos = static_cast(context.currentPos); if (context.ch == '"') { context.ForwardSetState(SCE_REG_DEFAULT); } else if (context.ch == '\\') { beforeEscape = context.state; context.SetState(SCE_REG_ESCAPED); context.Forward(); } else if (context.ch == '{') { if (AtGUID(styler, currPos)) { beforeGUID = context.state; context.SetState(SCE_REG_STRING_GUID); } } if (context.state == SCE_REG_STRING && context.ch == '%' && (isdigit(context.chNext) || context.chNext == '*')) { context.SetState(SCE_REG_PARAMETER); } } break; case SCE_REG_PARAMETER: context.ForwardSetState(SCE_REG_STRING); if (context.ch == '"') { context.ForwardSetState(SCE_REG_DEFAULT); } break; case SCE_REG_VALUETYPE: if (context.ch == ':') { context.SetState(SCE_REG_DEFAULT); afterEqualSign = false; } break; case SCE_REG_HEXDIGIT: case SCE_REG_OPERATOR: context.SetState(SCE_REG_DEFAULT); break; case SCE_REG_DELETEDKEY: case SCE_REG_ADDEDKEY: { Sci_Position currPos = static_cast(context.currentPos); if (context.ch == ']' && AtKeyPathEnd(styler, currPos)) { context.ForwardSetState(SCE_REG_DEFAULT); } else if (context.ch == '{') { if (AtGUID(styler, currPos)) { beforeGUID = context.state; context.SetState(SCE_REG_KEYPATH_GUID); } } } break; case SCE_REG_ESCAPED: if (context.ch == '"') { context.SetState(beforeEscape); context.ForwardSetState(SCE_REG_DEFAULT); } else if (context.ch == '\\') { context.Forward(); } else { context.SetState(beforeEscape); beforeEscape = SCE_REG_DEFAULT; } break; case SCE_REG_STRING_GUID: case SCE_REG_KEYPATH_GUID: { if (context.ch == '}') { context.ForwardSetState(beforeGUID); beforeGUID = SCE_REG_DEFAULT; } Sci_Position currPos = static_cast(context.currentPos); if (context.ch == '"' && IsStringState(context.state)) { context.ForwardSetState(SCE_REG_DEFAULT); } else if (context.ch == ']' && AtKeyPathEnd(styler, currPos) && IsKeyPathState(context.state)) { context.ForwardSetState(SCE_REG_DEFAULT); } else if (context.ch == '\\' && IsStringState(context.state)) { beforeEscape = context.state; context.SetState(SCE_REG_ESCAPED); context.Forward(); } } break; } // Determine if a new state should be entered. if (context.state == SCE_REG_DEFAULT) { Sci_Position currPos = static_cast(context.currentPos); if (context.ch == ';') { context.SetState(SCE_REG_COMMENT); } else if (context.ch == '"') { if (AtValueName(styler, currPos)) { context.SetState(SCE_REG_VALUENAME); } else { context.SetState(SCE_REG_STRING); } } else if (context.ch == '[') { if (IsNextNonWhitespace(styler, currPos, '-')) { context.SetState(SCE_REG_DELETEDKEY); } else { context.SetState(SCE_REG_ADDEDKEY); } } else if (context.ch == '=') { afterEqualSign = true; highlight = true; } else if (afterEqualSign) { bool wordStart = isalpha(context.ch) && !isalpha(context.chPrev); if (wordStart && AtValueType(styler, currPos)) { context.SetState(SCE_REG_VALUETYPE); } } else if (isxdigit(context.ch) && highlight) { context.SetState(SCE_REG_HEXDIGIT); } highlight = (context.ch == '@') ? true : highlight; if (setOperators.Contains(context.ch) && highlight) { context.SetState(SCE_REG_OPERATOR); } } context.Forward(); } context.Complete(); } // Folding similar to that of FoldPropsDoc in LexOthers void SCI_METHOD LexerRegistry::Fold(Sci_PositionU startPos, Sci_Position length, int, IDocument *pAccess) { if (!options.fold) { return; } LexAccessor styler(pAccess); Sci_Position currLine = styler.GetLine(startPos); int visibleChars = 0; Sci_PositionU endPos = startPos + length; bool atKeyPath = false; for (Sci_PositionU i = startPos; i < endPos; i++) { atKeyPath = IsKeyPathState(styler.StyleAt(i)) ? true : atKeyPath; char curr = styler.SafeGetCharAt(i); char next = styler.SafeGetCharAt(i+1); bool atEOL = (curr == '\r' && next != '\n') || (curr == '\n'); if (atEOL || i == (endPos-1)) { int level = SC_FOLDLEVELBASE; if (currLine > 0) { int prevLevel = styler.LevelAt(currLine-1); if (prevLevel & SC_FOLDLEVELHEADERFLAG) { level += 1; } else { level = prevLevel; } } if (!visibleChars && options.foldCompact) { level |= SC_FOLDLEVELWHITEFLAG; } else if (atKeyPath) { level = SC_FOLDLEVELBASE | SC_FOLDLEVELHEADERFLAG; } if (level != styler.LevelAt(currLine)) { styler.SetLevel(currLine, level); } currLine++; visibleChars = 0; atKeyPath = false; } if (!isspacechar(curr)) { visibleChars++; } } // Make the folding reach the last line in the file int level = SC_FOLDLEVELBASE; if (currLine > 0) { int prevLevel = styler.LevelAt(currLine-1); if (prevLevel & SC_FOLDLEVELHEADERFLAG) { level += 1; } else { level = prevLevel; } } styler.SetLevel(currLine, level); } LexerModule lmRegistry(SCLEX_REGISTRY, LexerRegistry::LexerFactoryRegistry, "registry", RegistryWordListDesc); lexilla/lexers/LexCsound.cxx0000664000175000017500000001435014647367374015134 0ustar neilneil// Scintilla source code edit control /** @file LexCsound.cxx ** Lexer for Csound (Orchestra & Score) ** Written by Georg Ritter - **/ // Copyright 1998-2003 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static inline bool IsAWordChar(const int ch) { return (ch < 0x80) && (isalnum(ch) || ch == '.' || ch == '_' || ch == '?'); } static inline bool IsAWordStart(const int ch) { return (ch < 0x80) && (isalnum(ch) || ch == '_' || ch == '.' || ch == '%' || ch == '@' || ch == '$' || ch == '?'); } static inline bool IsCsoundOperator(char ch) { if (IsASCII(ch) && isalnum(ch)) return false; // '.' left out as it is used to make up numbers if (ch == '*' || ch == '/' || ch == '-' || ch == '+' || ch == '(' || ch == ')' || ch == '=' || ch == '^' || ch == '[' || ch == ']' || ch == '<' || ch == '&' || ch == '>' || ch == ',' || ch == '|' || ch == '~' || ch == '%' || ch == ':') return true; return false; } static void ColouriseCsoundDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { WordList &opcode = *keywordlists[0]; WordList &headerStmt = *keywordlists[1]; WordList &otherKeyword = *keywordlists[2]; // Do not leak onto next line if (initStyle == SCE_CSOUND_STRINGEOL) initStyle = SCE_CSOUND_DEFAULT; StyleContext sc(startPos, length, initStyle, styler); for (; sc.More(); sc.Forward()) { // Handle line continuation generically. if (sc.ch == '\\') { if (sc.chNext == '\n' || sc.chNext == '\r') { sc.Forward(); if (sc.ch == '\r' && sc.chNext == '\n') { sc.Forward(); } continue; } } // Determine if the current state should terminate. if (sc.state == SCE_CSOUND_OPERATOR) { if (!IsCsoundOperator(static_cast(sc.ch))) { sc.SetState(SCE_CSOUND_DEFAULT); } }else if (sc.state == SCE_CSOUND_NUMBER) { if (!IsAWordChar(sc.ch)) { sc.SetState(SCE_CSOUND_DEFAULT); } } else if (sc.state == SCE_CSOUND_IDENTIFIER) { if (!IsAWordChar(sc.ch) ) { char s[100]; sc.GetCurrent(s, sizeof(s)); if (opcode.InList(s)) { sc.ChangeState(SCE_CSOUND_OPCODE); } else if (headerStmt.InList(s)) { sc.ChangeState(SCE_CSOUND_HEADERSTMT); } else if (otherKeyword.InList(s)) { sc.ChangeState(SCE_CSOUND_USERKEYWORD); } else if (s[0] == 'p') { sc.ChangeState(SCE_CSOUND_PARAM); } else if (s[0] == 'a') { sc.ChangeState(SCE_CSOUND_ARATE_VAR); } else if (s[0] == 'k') { sc.ChangeState(SCE_CSOUND_KRATE_VAR); } else if (s[0] == 'i') { // covers both i-rate variables and i-statements sc.ChangeState(SCE_CSOUND_IRATE_VAR); } else if (s[0] == 'g') { sc.ChangeState(SCE_CSOUND_GLOBAL_VAR); } sc.SetState(SCE_CSOUND_DEFAULT); } } else if (sc.state == SCE_CSOUND_COMMENT ) { if (sc.atLineEnd) { sc.SetState(SCE_CSOUND_DEFAULT); } } else if ((sc.state == SCE_CSOUND_ARATE_VAR) || (sc.state == SCE_CSOUND_KRATE_VAR) || (sc.state == SCE_CSOUND_IRATE_VAR)) { if (!IsAWordChar(sc.ch)) { sc.SetState(SCE_CSOUND_DEFAULT); } } // Determine if a new state should be entered. if (sc.state == SCE_CSOUND_DEFAULT) { if (sc.ch == ';'){ sc.SetState(SCE_CSOUND_COMMENT); } else if (isdigit(sc.ch) || (sc.ch == '.' && isdigit(sc.chNext))) { sc.SetState(SCE_CSOUND_NUMBER); } else if (IsAWordStart(sc.ch)) { sc.SetState(SCE_CSOUND_IDENTIFIER); } else if (IsCsoundOperator(static_cast(sc.ch))) { sc.SetState(SCE_CSOUND_OPERATOR); } else if (sc.ch == 'p') { sc.SetState(SCE_CSOUND_PARAM); } else if (sc.ch == 'a') { sc.SetState(SCE_CSOUND_ARATE_VAR); } else if (sc.ch == 'k') { sc.SetState(SCE_CSOUND_KRATE_VAR); } else if (sc.ch == 'i') { // covers both i-rate variables and i-statements sc.SetState(SCE_CSOUND_IRATE_VAR); } else if (sc.ch == 'g') { sc.SetState(SCE_CSOUND_GLOBAL_VAR); } } } sc.Complete(); } static void FoldCsoundInstruments(Sci_PositionU startPos, Sci_Position length, int /* initStyle */, WordList *[], Accessor &styler) { Sci_PositionU lengthDoc = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelPrev = styler.LevelAt(lineCurrent) & SC_FOLDLEVELNUMBERMASK; int levelCurrent = levelPrev; char chNext = styler[startPos]; int stylePrev = 0; int styleNext = styler.StyleAt(startPos); for (Sci_PositionU i = startPos; i < lengthDoc; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); int style = styleNext; styleNext = styler.StyleAt(i + 1); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if ((stylePrev != SCE_CSOUND_OPCODE) && (style == SCE_CSOUND_OPCODE)) { char s[20]; unsigned int j = 0; while ((j < (sizeof(s) - 1)) && (iswordchar(styler[i + j]))) { s[j] = styler[i + j]; j++; } s[j] = '\0'; if (strcmp(s, "instr") == 0) levelCurrent++; if (strcmp(s, "endin") == 0) levelCurrent--; } if (atEOL) { int lev = levelPrev; if (visibleChars == 0) lev |= SC_FOLDLEVELWHITEFLAG; if ((levelCurrent > levelPrev) && (visibleChars > 0)) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelPrev = levelCurrent; visibleChars = 0; } if (!isspacechar(ch)) visibleChars++; stylePrev = style; } // Fill in the real level of the next line, keeping the current flags as they will be filled in later int flagsNext = styler.LevelAt(lineCurrent) & ~SC_FOLDLEVELNUMBERMASK; styler.SetLevel(lineCurrent, levelPrev | flagsNext); } static const char * const csoundWordListDesc[] = { "Opcodes", "Header Statements", "User keywords", 0 }; LexerModule lmCsound(SCLEX_CSOUND, ColouriseCsoundDoc, "csound", FoldCsoundInstruments, csoundWordListDesc); lexilla/lexers/LexMagik.cxx0000664000175000017500000003256014647367374014734 0ustar neilneil// Scintilla source code edit control /** * @file LexMagik.cxx * Lexer for GE(r) Smallworld(tm) MagikSF */ // Copyright 1998-2005 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; /** * Is it a core character (C isalpha(), exclamation and question mark) * * \param ch The character * \return True if ch is a character, False otherwise */ static inline bool IsAlphaCore(int ch) { return (isalpha(ch) || ch == '!' || ch == '?'); } /** * Is it a character (IsAlphaCore() and underscore) * * \param ch The character * \return True if ch is a character, False otherwise */ static inline bool IsAlpha(int ch) { return (IsAlphaCore(ch) || ch == '_'); } /** * Is it a symbolic character (IsAlpha() and colon) * * \param ch The character * \return True if ch is a character, False otherwise */ static inline bool IsAlphaSym(int ch) { return (IsAlpha(ch) || ch == ':'); } /** * Is it a numerical character (IsAlpha() and 0 - 9) * * \param ch The character * \return True if ch is a character, False otherwise */ static inline bool IsAlNum(int ch) { return ((ch >= '0' && ch <= '9') || IsAlpha(ch)); } /** * Is it a symbolic numerical character (IsAlNum() and colon) * * \param ch The character * \return True if ch is a character, False otherwise */ static inline bool IsAlNumSym(int ch) { return (IsAlNum(ch) || ch == ':'); } /** * The lexer function * * \param startPos Where to start scanning * \param length Where to scan to * \param initStyle The style at the initial point, not used in this folder * \param keywordlists The keywordslists, currently, number 5 is used * \param styler The styler */ static void ColouriseMagikDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { styler.StartAt(startPos); WordList &keywords = *keywordlists[0]; WordList &pragmatics = *keywordlists[1]; WordList &containers = *keywordlists[2]; WordList &flow = *keywordlists[3]; WordList &characters = *keywordlists[4]; StyleContext sc(startPos, length, initStyle, styler); for (; sc.More(); sc.Forward()) { repeat: if(sc.ch == '#') { if (sc.chNext == '#') sc.SetState(SCE_MAGIK_HYPER_COMMENT); else sc.SetState(SCE_MAGIK_COMMENT); for(; sc.More() && !(sc.atLineEnd); sc.Forward()); sc.SetState(SCE_MAGIK_DEFAULT); goto repeat; } if(sc.ch == '"') { sc.SetState(SCE_MAGIK_STRING); if(sc.More()) { sc.Forward(); for(; sc.More() && sc.ch != '"'; sc.Forward()); } sc.ForwardSetState(SCE_MAGIK_DEFAULT); goto repeat; } // The default state if(sc.state == SCE_MAGIK_DEFAULT) { // A certain keyword has been detected if (sc.ch == '_' && ( sc.currentPos == 0 || !IsAlNum(sc.chPrev))) { char keyword[50]; memset(keyword, '\0', 50); for( int scanPosition = 0; scanPosition < 50; scanPosition++) { char keywordChar = static_cast( tolower(styler.SafeGetCharAt( scanPosition + static_cast(sc.currentPos+1), ' '))); if(IsAlpha(keywordChar)) { keyword[scanPosition] = keywordChar; } else { break; } } // It is a pragma if(pragmatics.InList(keyword)) { sc.SetState(SCE_MAGIK_PRAGMA); } // it is a normal keyword like _local, _self, etc. else if(keywords.InList(keyword)) { sc.SetState(SCE_MAGIK_KEYWORD); } // It is a container keyword, such as _method, _proc, etc. else if(containers.InList(keyword)) { sc.SetState(SCE_MAGIK_CONTAINER); } // It is a flow keyword, such as _for, _if, _try, etc. else if(flow.InList(keyword)) { sc.SetState(SCE_MAGIK_FLOW); } // Interpret as unknown keyword else { sc.SetState(SCE_MAGIK_UNKNOWN_KEYWORD); } } // Symbolic expression else if(sc.ch == ':' && !IsAlNum(sc.chPrev)) { sc.SetState(SCE_MAGIK_SYMBOL); bool firstTrip = true; for(sc.Forward(); sc.More(); sc.Forward()) { if(firstTrip && IsAlphaSym(sc.ch)); else if(!firstTrip && IsAlNumSym(sc.ch)); else if(sc.ch == '|') { for(sc.Forward(); sc.More() && sc.ch != '|'; sc.Forward()); } else break; firstTrip = false; } sc.SetState(SCE_MAGIK_DEFAULT); goto repeat; } // Identifier (label) expression else if(sc.ch == '@') { sc.SetState(SCE_MAGIK_IDENTIFIER); bool firstTrip = true; for(sc.Forward(); sc.More(); sc.Forward()) { if(firstTrip && IsAlphaCore(sc.ch)) { firstTrip = false; } else if(!firstTrip && IsAlpha(sc.ch)); else break; } sc.SetState(SCE_MAGIK_DEFAULT); goto repeat; } // Start of a character else if(sc.ch == '%') { sc.SetState(SCE_MAGIK_CHARACTER); sc.Forward(); char keyword[50]; memset(keyword, '\0', 50); for( int scanPosition = 0; scanPosition < 50; scanPosition++) { char keywordChar = static_cast( tolower(styler.SafeGetCharAt( scanPosition + static_cast(sc.currentPos), ' '))); if(IsAlpha(keywordChar)) { keyword[scanPosition] = keywordChar; } else { break; } } if(characters.InList(keyword)) { sc.Forward(static_cast(strlen(keyword))); } else { sc.Forward(); } sc.SetState(SCE_MAGIK_DEFAULT); goto repeat; } // Operators else if( sc.ch == '>' || sc.ch == '<' || sc.ch == '.' || sc.ch == ',' || sc.ch == '+' || sc.ch == '-' || sc.ch == '/' || sc.ch == '*' || sc.ch == '~' || sc.ch == '$' || sc.ch == '=') { sc.SetState(SCE_MAGIK_OPERATOR); } // Braces else if(sc.ch == '(' || sc.ch == ')') { sc.SetState(SCE_MAGIK_BRACE_BLOCK); } // Brackets else if(sc.ch == '{' || sc.ch == '}') { sc.SetState(SCE_MAGIK_BRACKET_BLOCK); } // Square Brackets else if(sc.ch == '[' || sc.ch == ']') { sc.SetState(SCE_MAGIK_SQBRACKET_BLOCK); } } // It is an operator else if( sc.state == SCE_MAGIK_OPERATOR || sc.state == SCE_MAGIK_BRACE_BLOCK || sc.state == SCE_MAGIK_BRACKET_BLOCK || sc.state == SCE_MAGIK_SQBRACKET_BLOCK) { sc.SetState(SCE_MAGIK_DEFAULT); goto repeat; } // It is the pragma state else if(sc.state == SCE_MAGIK_PRAGMA) { if(!IsAlpha(sc.ch)) { sc.SetState(SCE_MAGIK_DEFAULT); goto repeat; } } // It is the keyword state else if( sc.state == SCE_MAGIK_KEYWORD || sc.state == SCE_MAGIK_CONTAINER || sc.state == SCE_MAGIK_FLOW || sc.state == SCE_MAGIK_UNKNOWN_KEYWORD) { if(!IsAlpha(sc.ch)) { sc.SetState(SCE_MAGIK_DEFAULT); goto repeat; } } } sc.Complete(); } /** * The word list description */ static const char * const magikWordListDesc[] = { "Accessors (local, global, self, super, thisthread)", "Pragmatic (pragma, private)", "Containers (method, block, proc)", "Flow (if, then, elif, else)", "Characters (space, tab, newline, return)", "Fold Containers (method, proc, block, if, loop)", 0}; /** * This function detects keywords which are able to have a body. Note that it * uses the Fold Containers word description, not the containers description. It * only works when the style at that particular position is set on Containers * or Flow (number 3 or 4). * * \param keywordslist The list of keywords that are scanned, they should only * contain the start keywords, not the end keywords * \param keyword The actual keyword * \return 1 if it is a folding start-keyword, -1 if it is a folding end-keyword * 0 otherwise */ static inline int IsFoldingContainer(WordList &keywordslist, char * keyword) { if( strlen(keyword) > 3 && keyword[0] == 'e' && keyword[1] == 'n' && keyword[2] == 'd') { if (keywordslist.InList(keyword + 3)) { return -1; } } else { if(keywordslist.InList(keyword)) { return 1; } } return 0; } /** * The folding function * * \param startPos Where to start scanning * \param length Where to scan to * \param keywordslists The keywordslists, currently, number 5 is used * \param styler The styler */ static void FoldMagikDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *keywordslists[], Accessor &styler) { bool compact = styler.GetPropertyInt("fold.compact") != 0; WordList &foldingElements = *keywordslists[5]; Sci_Position endPos = startPos + length; Sci_Position line = styler.GetLine(startPos); int level = styler.LevelAt(line) & SC_FOLDLEVELNUMBERMASK; int flags = styler.LevelAt(line) & ~SC_FOLDLEVELNUMBERMASK; for( Sci_Position currentPos = startPos; currentPos < endPos; currentPos++) { char currentState = styler.StyleAt(currentPos); char c = styler.SafeGetCharAt(currentPos, ' '); Sci_Position prevLine = styler.GetLine(currentPos - 1); line = styler.GetLine(currentPos); // Default situation if(prevLine < line) { styler.SetLevel(line, (level|flags) & ~SC_FOLDLEVELHEADERFLAG); flags = styler.LevelAt(line) & ~SC_FOLDLEVELNUMBERMASK; } if( ( currentState == SCE_MAGIK_CONTAINER || currentState == SCE_MAGIK_FLOW ) && c == '_') { char keyword[50]; memset(keyword, '\0', 50); for( int scanPosition = 0; scanPosition < 50; scanPosition++) { char keywordChar = static_cast( tolower(styler.SafeGetCharAt( scanPosition + currentPos + 1, ' '))); if(IsAlpha(keywordChar)) { keyword[scanPosition] = keywordChar; } else { break; } } if(IsFoldingContainer(foldingElements, keyword) > 0) { styler.SetLevel( line, styler.LevelAt(line) | SC_FOLDLEVELHEADERFLAG); level++; } else if(IsFoldingContainer(foldingElements, keyword) < 0) { styler.SetLevel(line, styler.LevelAt(line)); level--; } } if( compact && ( currentState == SCE_MAGIK_BRACE_BLOCK || currentState == SCE_MAGIK_BRACKET_BLOCK || currentState == SCE_MAGIK_SQBRACKET_BLOCK)) { if(c == '{' || c == '[' || c == '(') { styler.SetLevel( line, styler.LevelAt(line) | SC_FOLDLEVELHEADERFLAG); level++; } else if(c == '}' || c == ']' || c == ')') { styler.SetLevel(line, styler.LevelAt(line)); level--; } } } } /** * Injecting the module */ LexerModule lmMagikSF( SCLEX_MAGIK, ColouriseMagikDoc, "magiksf", FoldMagikDoc, magikWordListDesc); lexilla/lexers/LexNsis.cxx0000664000175000017500000004510614647367374014620 0ustar neilneil// Scintilla source code edit control /** @file LexNsis.cxx ** Lexer for NSIS **/ // Copyright 2003 - 2005 by Angelo Mandato // Last Updated: 03/13/2005 // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; /* // located in SciLexer.h #define SCLEX_NSIS 43 #define SCE_NSIS_DEFAULT 0 #define SCE_NSIS_COMMENT 1 #define SCE_NSIS_STRINGDQ 2 #define SCE_NSIS_STRINGLQ 3 #define SCE_NSIS_STRINGRQ 4 #define SCE_NSIS_FUNCTION 5 #define SCE_NSIS_VARIABLE 6 #define SCE_NSIS_LABEL 7 #define SCE_NSIS_USERDEFINED 8 #define SCE_NSIS_SECTIONDEF 9 #define SCE_NSIS_SUBSECTIONDEF 10 #define SCE_NSIS_IFDEFINEDEF 11 #define SCE_NSIS_MACRODEF 12 #define SCE_NSIS_STRINGVAR 13 #define SCE_NSIS_NUMBER 14 // ADDED for Scintilla v1.63 #define SCE_NSIS_SECTIONGROUP 15 #define SCE_NSIS_PAGEEX 16 #define SCE_NSIS_FUNCTIONDEF 17 #define SCE_NSIS_COMMENTBOX 18 */ static bool isNsisNumber(char ch) { return (ch >= '0' && ch <= '9'); } static bool isNsisChar(char ch) { return (ch == '.' ) || (ch == '_' ) || isNsisNumber(ch) || (ch >= 'A' && ch <= 'Z') || (ch >= 'a' && ch <= 'z'); } static bool isNsisLetter(char ch) { return (ch >= 'A' && ch <= 'Z') || (ch >= 'a' && ch <= 'z'); } static bool NsisNextLineHasElse(Sci_PositionU start, Sci_PositionU end, Accessor &styler) { Sci_Position nNextLine = -1; for( Sci_PositionU i = start; i < end; i++ ) { char cNext = styler.SafeGetCharAt( i ); if( cNext == '\n' ) { nNextLine = i+1; break; } } if( nNextLine == -1 ) // We never found the next line... return false; for( Sci_PositionU firstChar = nNextLine; firstChar < end; firstChar++ ) { char cNext = styler.SafeGetCharAt( firstChar ); if( cNext == ' ' ) continue; if( cNext == '\t' ) continue; if( cNext == '!' ) { if( styler.Match(firstChar, "!else") ) return true; } break; } return false; } static int NsisCmp( const char *s1, const char *s2, bool bIgnoreCase ) { if( bIgnoreCase ) return CompareCaseInsensitive( s1, s2); return strcmp( s1, s2 ); } static int calculateFoldNsis(Sci_PositionU start, Sci_PositionU end, int foldlevel, Accessor &styler, bool bElse, bool foldUtilityCmd ) { int style = styler.StyleAt(end); // If the word is too long, it is not what we are looking for if( end - start > 20 ) return foldlevel; if( foldUtilityCmd ) { // Check the style at this point, if it is not valid, then return zero if( style != SCE_NSIS_FUNCTIONDEF && style != SCE_NSIS_SECTIONDEF && style != SCE_NSIS_SUBSECTIONDEF && style != SCE_NSIS_IFDEFINEDEF && style != SCE_NSIS_MACRODEF && style != SCE_NSIS_SECTIONGROUP && style != SCE_NSIS_PAGEEX ) return foldlevel; } else { if( style != SCE_NSIS_FUNCTIONDEF && style != SCE_NSIS_SECTIONDEF && style != SCE_NSIS_SUBSECTIONDEF && style != SCE_NSIS_SECTIONGROUP && style != SCE_NSIS_PAGEEX ) return foldlevel; } int newFoldlevel = foldlevel; bool bIgnoreCase = false; // property nsis.ignorecase // Set to 1 to ignore case for NSIS. if( styler.GetPropertyInt("nsis.ignorecase") == 1 ) bIgnoreCase = true; char s[20]; // The key word we are looking for has atmost 13 characters s[0] = '\0'; for (Sci_PositionU i = 0; i < end - start + 1 && i < 19; i++) { s[i] = static_cast( styler[ start + i ] ); s[i + 1] = '\0'; } if( s[0] == '!' ) { if( NsisCmp(s, "!ifndef", bIgnoreCase) == 0 || NsisCmp(s, "!ifdef", bIgnoreCase ) == 0 || NsisCmp(s, "!ifmacrodef", bIgnoreCase ) == 0 || NsisCmp(s, "!ifmacrondef", bIgnoreCase ) == 0 || NsisCmp(s, "!if", bIgnoreCase ) == 0 || NsisCmp(s, "!macro", bIgnoreCase ) == 0 ) newFoldlevel++; else if( NsisCmp(s, "!endif", bIgnoreCase) == 0 || NsisCmp(s, "!macroend", bIgnoreCase ) == 0 ) newFoldlevel--; else if( bElse && NsisCmp(s, "!else", bIgnoreCase) == 0 ) newFoldlevel++; } else { if( NsisCmp(s, "Section", bIgnoreCase ) == 0 || NsisCmp(s, "SectionGroup", bIgnoreCase ) == 0 || NsisCmp(s, "Function", bIgnoreCase) == 0 || NsisCmp(s, "SubSection", bIgnoreCase ) == 0 || NsisCmp(s, "PageEx", bIgnoreCase ) == 0 ) newFoldlevel++; else if( NsisCmp(s, "SectionGroupEnd", bIgnoreCase ) == 0 || NsisCmp(s, "SubSectionEnd", bIgnoreCase ) == 0 || NsisCmp(s, "FunctionEnd", bIgnoreCase) == 0 || NsisCmp(s, "SectionEnd", bIgnoreCase ) == 0 || NsisCmp(s, "PageExEnd", bIgnoreCase ) == 0 ) newFoldlevel--; } return newFoldlevel; } static int classifyWordNsis(Sci_PositionU start, Sci_PositionU end, WordList *keywordLists[], Accessor &styler ) { bool bIgnoreCase = false; if( styler.GetPropertyInt("nsis.ignorecase") == 1 ) bIgnoreCase = true; bool bUserVars = false; // property nsis.uservars // Set to 1 to recognise user defined variables in NSIS. if( styler.GetPropertyInt("nsis.uservars") == 1 ) bUserVars = true; char s[100]; s[0] = '\0'; s[1] = '\0'; WordList &Functions = *keywordLists[0]; WordList &Variables = *keywordLists[1]; WordList &Lables = *keywordLists[2]; WordList &UserDefined = *keywordLists[3]; for (Sci_PositionU i = 0; i < end - start + 1 && i < 99; i++) { if( bIgnoreCase ) s[i] = static_cast( tolower(styler[ start + i ] ) ); else s[i] = static_cast( styler[ start + i ] ); s[i + 1] = '\0'; } // Check for special words... if( NsisCmp(s, "!macro", bIgnoreCase ) == 0 || NsisCmp(s, "!macroend", bIgnoreCase) == 0 ) // Covers !macro and !macroend return SCE_NSIS_MACRODEF; if( NsisCmp(s, "!ifdef", bIgnoreCase ) == 0 || NsisCmp(s, "!ifndef", bIgnoreCase) == 0 || NsisCmp(s, "!endif", bIgnoreCase) == 0 ) // Covers !ifdef, !ifndef and !endif return SCE_NSIS_IFDEFINEDEF; if( NsisCmp(s, "!if", bIgnoreCase ) == 0 || NsisCmp(s, "!else", bIgnoreCase ) == 0 ) // Covers !if and else return SCE_NSIS_IFDEFINEDEF; if (NsisCmp(s, "!ifmacrodef", bIgnoreCase ) == 0 || NsisCmp(s, "!ifmacrondef", bIgnoreCase ) == 0 ) // Covers !ifmacrodef and !ifnmacrodef return SCE_NSIS_IFDEFINEDEF; if( NsisCmp(s, "SectionGroup", bIgnoreCase) == 0 || NsisCmp(s, "SectionGroupEnd", bIgnoreCase) == 0 ) // Covers SectionGroup and SectionGroupEnd return SCE_NSIS_SECTIONGROUP; if( NsisCmp(s, "Section", bIgnoreCase ) == 0 || NsisCmp(s, "SectionEnd", bIgnoreCase) == 0 ) // Covers Section and SectionEnd return SCE_NSIS_SECTIONDEF; if( NsisCmp(s, "SubSection", bIgnoreCase) == 0 || NsisCmp(s, "SubSectionEnd", bIgnoreCase) == 0 ) // Covers SubSection and SubSectionEnd return SCE_NSIS_SUBSECTIONDEF; if( NsisCmp(s, "PageEx", bIgnoreCase) == 0 || NsisCmp(s, "PageExEnd", bIgnoreCase) == 0 ) // Covers PageEx and PageExEnd return SCE_NSIS_PAGEEX; if( NsisCmp(s, "Function", bIgnoreCase) == 0 || NsisCmp(s, "FunctionEnd", bIgnoreCase) == 0 ) // Covers Function and FunctionEnd return SCE_NSIS_FUNCTIONDEF; if ( Functions.InList(s) ) return SCE_NSIS_FUNCTION; if ( Variables.InList(s) ) return SCE_NSIS_VARIABLE; if ( Lables.InList(s) ) return SCE_NSIS_LABEL; if( UserDefined.InList(s) ) return SCE_NSIS_USERDEFINED; if( strlen(s) > 3 ) { if( s[1] == '{' && s[strlen(s)-1] == '}' ) return SCE_NSIS_VARIABLE; } // See if the variable is a user defined variable if( s[0] == '$' && bUserVars ) { bool bHasSimpleNsisChars = true; for (Sci_PositionU j = 1; j < end - start + 1 && j < 99; j++) { if( !isNsisChar( s[j] ) ) { bHasSimpleNsisChars = false; break; } } if( bHasSimpleNsisChars ) return SCE_NSIS_VARIABLE; } // To check for numbers if( isNsisNumber( s[0] ) ) { bool bHasSimpleNsisNumber = true; for (Sci_PositionU j = 1; j < end - start + 1 && j < 99; j++) { if( !isNsisNumber( s[j] ) ) { bHasSimpleNsisNumber = false; break; } } if( bHasSimpleNsisNumber ) return SCE_NSIS_NUMBER; } return SCE_NSIS_DEFAULT; } static void ColouriseNsisDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *keywordLists[], Accessor &styler) { int state = SCE_NSIS_DEFAULT; if( startPos > 0 ) state = styler.StyleAt(startPos-1); // Use the style from the previous line, usually default, but could be commentbox styler.StartAt( startPos ); styler.GetLine( startPos ); Sci_PositionU nLengthDoc = startPos + length; styler.StartSegment( startPos ); char cCurrChar; bool bVarInString = false; bool bClassicVarInString = false; Sci_PositionU i; for( i = startPos; i < nLengthDoc; i++ ) { cCurrChar = styler.SafeGetCharAt( i ); char cNextChar = styler.SafeGetCharAt(i+1); switch(state) { case SCE_NSIS_DEFAULT: if( cCurrChar == ';' || cCurrChar == '#' ) // we have a comment line { styler.ColourTo(i-1, state ); state = SCE_NSIS_COMMENT; break; } if( cCurrChar == '"' ) { styler.ColourTo(i-1, state ); state = SCE_NSIS_STRINGDQ; bVarInString = false; bClassicVarInString = false; break; } if( cCurrChar == '\'' ) { styler.ColourTo(i-1, state ); state = SCE_NSIS_STRINGRQ; bVarInString = false; bClassicVarInString = false; break; } if( cCurrChar == '`' ) { styler.ColourTo(i-1, state ); state = SCE_NSIS_STRINGLQ; bVarInString = false; bClassicVarInString = false; break; } // NSIS KeyWord,Function, Variable, UserDefined: if( cCurrChar == '$' || isNsisChar(cCurrChar) || cCurrChar == '!' ) { styler.ColourTo(i-1,state); state = SCE_NSIS_FUNCTION; // If it is a number, we must check and set style here first... if( isNsisNumber(cCurrChar) && (cNextChar == '\t' || cNextChar == ' ' || cNextChar == '\r' || cNextChar == '\n' ) ) styler.ColourTo( i, SCE_NSIS_NUMBER); break; } if( cCurrChar == '/' && cNextChar == '*' ) { styler.ColourTo(i-1,state); state = SCE_NSIS_COMMENTBOX; break; } break; case SCE_NSIS_COMMENT: if( cNextChar == '\n' || cNextChar == '\r' ) { // Special case: if( cCurrChar == '\\' ) { styler.ColourTo(i-2,state); styler.ColourTo(i,SCE_NSIS_DEFAULT); } else { styler.ColourTo(i,state); state = SCE_NSIS_DEFAULT; } } break; case SCE_NSIS_STRINGDQ: case SCE_NSIS_STRINGLQ: case SCE_NSIS_STRINGRQ: if( styler.SafeGetCharAt(i-1) == '\\' && styler.SafeGetCharAt(i-2) == '$' ) break; // Ignore the next character, even if it is a quote of some sort if( cCurrChar == '"' && state == SCE_NSIS_STRINGDQ ) { styler.ColourTo(i,state); state = SCE_NSIS_DEFAULT; break; } if( cCurrChar == '`' && state == SCE_NSIS_STRINGLQ ) { styler.ColourTo(i,state); state = SCE_NSIS_DEFAULT; break; } if( cCurrChar == '\'' && state == SCE_NSIS_STRINGRQ ) { styler.ColourTo(i,state); state = SCE_NSIS_DEFAULT; break; } if( cNextChar == '\r' || cNextChar == '\n' ) { Sci_Position nCurLine = styler.GetLine(i+1); Sci_Position nBack = i; // We need to check if the previous line has a \ in it... bool bNextLine = false; while( nBack > 0 ) { if( styler.GetLine(nBack) != nCurLine ) break; char cTemp = styler.SafeGetCharAt(nBack, 'a'); // Letter 'a' is safe here if( cTemp == '\\' ) { bNextLine = true; break; } if( cTemp != '\r' && cTemp != '\n' && cTemp != '\t' && cTemp != ' ' ) break; nBack--; } if( bNextLine ) { styler.ColourTo(i+1,state); } if( bNextLine == false ) { styler.ColourTo(i,state); state = SCE_NSIS_DEFAULT; } } break; case SCE_NSIS_FUNCTION: // NSIS KeyWord: if( cCurrChar == '$' ) state = SCE_NSIS_DEFAULT; else if( cCurrChar == '\\' && (cNextChar == 'n' || cNextChar == 'r' || cNextChar == 't' ) ) state = SCE_NSIS_DEFAULT; else if( (isNsisChar(cCurrChar) && !isNsisChar( cNextChar) && cNextChar != '}') || cCurrChar == '}' ) { state = classifyWordNsis( styler.GetStartSegment(), i, keywordLists, styler ); styler.ColourTo( i, state); state = SCE_NSIS_DEFAULT; } else if( !isNsisChar( cCurrChar ) && cCurrChar != '{' && cCurrChar != '}' ) { if( classifyWordNsis( styler.GetStartSegment(), i-1, keywordLists, styler) == SCE_NSIS_NUMBER ) styler.ColourTo( i-1, SCE_NSIS_NUMBER ); state = SCE_NSIS_DEFAULT; if( cCurrChar == '"' ) { state = SCE_NSIS_STRINGDQ; bVarInString = false; bClassicVarInString = false; } else if( cCurrChar == '`' ) { state = SCE_NSIS_STRINGLQ; bVarInString = false; bClassicVarInString = false; } else if( cCurrChar == '\'' ) { state = SCE_NSIS_STRINGRQ; bVarInString = false; bClassicVarInString = false; } else if( cCurrChar == '#' || cCurrChar == ';' ) { state = SCE_NSIS_COMMENT; } } break; case SCE_NSIS_COMMENTBOX: if( styler.SafeGetCharAt(i-1) == '*' && cCurrChar == '/' ) { styler.ColourTo(i,state); state = SCE_NSIS_DEFAULT; } break; } if( state == SCE_NSIS_COMMENT || state == SCE_NSIS_COMMENTBOX ) { styler.ColourTo(i,state); } else if( state == SCE_NSIS_STRINGDQ || state == SCE_NSIS_STRINGLQ || state == SCE_NSIS_STRINGRQ ) { bool bIngoreNextDollarSign = false; bool bUserVars = false; if( styler.GetPropertyInt("nsis.uservars") == 1 ) bUserVars = true; if( bVarInString && cCurrChar == '$' ) { bVarInString = false; bIngoreNextDollarSign = true; } else if( bVarInString && cCurrChar == '\\' && (cNextChar == 'n' || cNextChar == 'r' || cNextChar == 't' || cNextChar == '"' || cNextChar == '`' || cNextChar == '\'' ) ) { styler.ColourTo( i+1, SCE_NSIS_STRINGVAR); bVarInString = false; bIngoreNextDollarSign = false; } // Covers "$INSTDIR and user vars like $MYVAR" else if( bVarInString && !isNsisChar(cNextChar) ) { int nWordState = classifyWordNsis( styler.GetStartSegment(), i, keywordLists, styler); if( nWordState == SCE_NSIS_VARIABLE ) styler.ColourTo( i, SCE_NSIS_STRINGVAR); else if( bUserVars ) styler.ColourTo( i, SCE_NSIS_STRINGVAR); bVarInString = false; } // Covers "${TEST}..." else if( bClassicVarInString && cNextChar == '}' ) { styler.ColourTo( i+1, SCE_NSIS_STRINGVAR); bClassicVarInString = false; } // Start of var in string if( !bIngoreNextDollarSign && cCurrChar == '$' && cNextChar == '{' ) { styler.ColourTo( i-1, state); bClassicVarInString = true; bVarInString = false; } else if( !bIngoreNextDollarSign && cCurrChar == '$' ) { styler.ColourTo( i-1, state); bVarInString = true; bClassicVarInString = false; } } } // Colourise remaining document styler.ColourTo(nLengthDoc-1,state); } static void FoldNsisDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { // No folding enabled, no reason to continue... if( styler.GetPropertyInt("fold") == 0 ) return; bool foldAtElse = styler.GetPropertyInt("fold.at.else", 0) == 1; bool foldUtilityCmd = styler.GetPropertyInt("nsis.foldutilcmd", 1) == 1; bool blockComment = false; Sci_Position lineCurrent = styler.GetLine(startPos); Sci_PositionU safeStartPos = styler.LineStart( lineCurrent ); bool bArg1 = true; Sci_Position nWordStart = -1; int levelCurrent = SC_FOLDLEVELBASE; if (lineCurrent > 0) levelCurrent = styler.LevelAt(lineCurrent-1) >> 16; int levelNext = levelCurrent; int style = styler.StyleAt(safeStartPos); if( style == SCE_NSIS_COMMENTBOX ) { if( styler.SafeGetCharAt(safeStartPos) == '/' && styler.SafeGetCharAt(safeStartPos+1) == '*' ) levelNext++; blockComment = true; } for (Sci_PositionU i = safeStartPos; i < startPos + length; i++) { char chCurr = styler.SafeGetCharAt(i); style = styler.StyleAt(i); if( blockComment && style != SCE_NSIS_COMMENTBOX ) { levelNext--; blockComment = false; } else if( !blockComment && style == SCE_NSIS_COMMENTBOX ) { levelNext++; blockComment = true; } if( bArg1 && !blockComment) { if( nWordStart == -1 && (isNsisLetter(chCurr) || chCurr == '!') ) { nWordStart = i; } else if( isNsisLetter(chCurr) == false && nWordStart > -1 ) { int newLevel = calculateFoldNsis( nWordStart, i-1, levelNext, styler, foldAtElse, foldUtilityCmd ); if( newLevel == levelNext ) { if( foldAtElse && foldUtilityCmd ) { if( NsisNextLineHasElse(i, startPos + length, styler) ) levelNext--; } } else levelNext = newLevel; bArg1 = false; } } if( chCurr == '\n' ) { if( bArg1 && foldAtElse && foldUtilityCmd && !blockComment ) { if( NsisNextLineHasElse(i, startPos + length, styler) ) levelNext--; } // If we are on a new line... int levelUse = levelCurrent; int lev = levelUse | levelNext << 16; if (levelUse < levelNext ) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) styler.SetLevel(lineCurrent, lev); lineCurrent++; levelCurrent = levelNext; bArg1 = true; // New line, lets look at first argument again nWordStart = -1; } } int levelUse = levelCurrent; int lev = levelUse | levelNext << 16; if (levelUse < levelNext) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) styler.SetLevel(lineCurrent, lev); } static const char * const nsisWordLists[] = { "Functions", "Variables", "Lables", "UserDefined", 0, }; LexerModule lmNsis(SCLEX_NSIS, ColouriseNsisDoc, "nsis", FoldNsisDoc, nsisWordLists); lexilla/lexers/LexInno.cxx0000664000175000017500000002533614647367374014612 0ustar neilneil// Scintilla source code edit control /** @file LexInno.cxx ** Lexer for Inno Setup scripts. **/ // Written by Friedrich Vedder , using code from LexOthers.cxx. // Modified by Michael Heath. // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static bool innoIsBlank(int ch) { return (ch == ' ') || (ch == '\t'); } static bool innoNextNotBlankIs(Sci_Position i, Accessor &styler, char needle) { char ch; while (i < styler.Length()) { ch = styler.SafeGetCharAt(i); if (ch == needle) return true; if (!innoIsBlank(ch)) return false; i++; } return false; } static void ColouriseInnoDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *keywordLists[], Accessor &styler) { int state = SCE_INNO_DEFAULT; char chPrev; char ch = 0; char chNext = styler[startPos]; Sci_Position lengthDoc = startPos + length; char *buffer = new char[length + 1]; Sci_Position bufferCount = 0; bool isBOL, isEOL, isWS, isBOLWS = 0; // Save line state later with bitState and bitand with bit... to get line state int bitState = 0; int const bitCode = 1, bitMessages = 2, bitCommentCurly = 4, bitCommentRound = 8; // Get keyword lists WordList §ionKeywords = *keywordLists[0]; WordList &standardKeywords = *keywordLists[1]; WordList ¶meterKeywords = *keywordLists[2]; WordList &preprocessorKeywords = *keywordLists[3]; WordList &pascalKeywords = *keywordLists[4]; WordList &userKeywords = *keywordLists[5]; // Get line state Sci_Position curLine = styler.GetLine(startPos); int curLineState = curLine > 0 ? styler.GetLineState(curLine - 1) : 0; bool isCode = (curLineState & bitCode); bool isMessages = (curLineState & bitMessages); bool isCommentCurly = (curLineState & bitCommentCurly); bool isCommentRound = (curLineState & bitCommentRound); bool isCommentSlash = false; // Continue Pascal multline comment state if (isCommentCurly || isCommentRound) state = SCE_INNO_COMMENT_PASCAL; // Go through all provided text segment // using the hand-written state machine shown below styler.StartAt(startPos); styler.StartSegment(startPos); for (Sci_Position i = startPos; i < lengthDoc; i++) { chPrev = ch; ch = chNext; chNext = styler.SafeGetCharAt(i + 1); if (styler.IsLeadByte(ch)) { chNext = styler.SafeGetCharAt(i + 2); i++; continue; } isBOL = (chPrev == 0) || (chPrev == '\n') || (chPrev == '\r' && ch != '\n'); isBOLWS = (isBOL) ? 1 : (isBOLWS && (chPrev == ' ' || chPrev == '\t')); isEOL = (ch == '\n' || ch == '\r'); isWS = (ch == ' ' || ch == '\t'); if ((ch == '\r' && chNext != '\n') || (ch == '\n')) { // Remember the line state for future incremental lexing curLine = styler.GetLine(i); bitState = 0; if (isCode) bitState |= bitCode; if (isMessages) bitState |= bitMessages; if (isCommentCurly) bitState |= bitCommentCurly; if (isCommentRound) bitState |= bitCommentRound; styler.SetLineState(curLine, bitState); } switch(state) { case SCE_INNO_DEFAULT: if (!isCode && ch == ';' && isBOLWS) { // Start of a comment state = SCE_INNO_COMMENT; styler.ColourTo(i, SCE_INNO_COMMENT); } else if (ch == '[' && isBOLWS) { // Start of a section name state = SCE_INNO_SECTION; bufferCount = 0; } else if (ch == '#' && isBOLWS) { // Start of a preprocessor directive state = SCE_INNO_PREPROC; } else if (!isCode && ch == '{' && chNext != '{' && chPrev != '{') { // Start of an inline expansion state = SCE_INNO_INLINE_EXPANSION; } else if (isCode && ch == '{') { // Start of a Pascal comment state = SCE_INNO_COMMENT_PASCAL; isCommentCurly = true; styler.ColourTo(i, SCE_INNO_COMMENT_PASCAL); } else if (isCode && (ch == '(' && chNext == '*')) { // Start of a Pascal comment state = SCE_INNO_COMMENT_PASCAL; isCommentRound = true; styler.ColourTo(i + 1, SCE_INNO_COMMENT_PASCAL); } else if (isCode && ch == '/' && chNext == '/') { // Start of C-style comment state = SCE_INNO_COMMENT_PASCAL; isCommentSlash = true; styler.ColourTo(i + 1, SCE_INNO_COMMENT_PASCAL); } else if (!isMessages && ch == '"') { // Start of a double-quote string state = SCE_INNO_STRING_DOUBLE; styler.ColourTo(i, SCE_INNO_STRING_DOUBLE); } else if (!isMessages && ch == '\'') { // Start of a single-quote string state = SCE_INNO_STRING_SINGLE; styler.ColourTo(i, SCE_INNO_STRING_SINGLE); } else if (!isMessages && IsASCII(ch) && (isalpha(ch) || (ch == '_'))) { // Start of an identifier state = SCE_INNO_IDENTIFIER; bufferCount = 0; buffer[bufferCount++] = static_cast(tolower(ch)); } else { // Style it the default style styler.ColourTo(i, SCE_INNO_DEFAULT); } break; case SCE_INNO_COMMENT: if (isEOL) { state = SCE_INNO_DEFAULT; styler.ColourTo(i - 1, SCE_INNO_COMMENT); styler.ColourTo(i, SCE_INNO_DEFAULT); } else { styler.ColourTo(i, SCE_INNO_COMMENT); } break; case SCE_INNO_IDENTIFIER: if (IsASCII(ch) && (isalnum(ch) || (ch == '_'))) { buffer[bufferCount++] = static_cast(tolower(ch)); } else { state = SCE_INNO_DEFAULT; buffer[bufferCount] = '\0'; // Check if the buffer contains a keyword if (!isCode && standardKeywords.InList(buffer) && innoNextNotBlankIs(i, styler, '=')) { styler.ColourTo(i - 1, SCE_INNO_KEYWORD); } else if (!isCode && parameterKeywords.InList(buffer) && innoNextNotBlankIs(i, styler, ':')) { styler.ColourTo(i - 1, SCE_INNO_PARAMETER); } else if (isCode && pascalKeywords.InList(buffer)) { styler.ColourTo(i - 1, SCE_INNO_KEYWORD_PASCAL); } else if (!isCode && userKeywords.InList(buffer)) { styler.ColourTo(i - 1, SCE_INNO_KEYWORD_USER); } else { styler.ColourTo(i - 1, SCE_INNO_DEFAULT); } // Push back the faulty character chNext = styler[i--]; ch = chPrev; } break; case SCE_INNO_SECTION: if (ch == ']') { state = SCE_INNO_DEFAULT; buffer[bufferCount] = '\0'; // Check if the buffer contains a section name if (sectionKeywords.InList(buffer)) { styler.ColourTo(i, SCE_INNO_SECTION); isCode = !CompareCaseInsensitive(buffer, "code"); isMessages = isCode ? false : ( !CompareCaseInsensitive(buffer, "custommessages") || !CompareCaseInsensitive(buffer, "messages")); } else { styler.ColourTo(i, SCE_INNO_DEFAULT); } } else if (IsASCII(ch) && (isalnum(ch) || (ch == '_'))) { buffer[bufferCount++] = static_cast(tolower(ch)); } else { state = SCE_INNO_DEFAULT; styler.ColourTo(i, SCE_INNO_DEFAULT); } break; case SCE_INNO_PREPROC: if (isWS || isEOL) { if (IsASCII(chPrev) && isalpha(chPrev)) { state = SCE_INNO_DEFAULT; buffer[bufferCount] = '\0'; // Check if the buffer contains a preprocessor directive if (preprocessorKeywords.InList(buffer)) { styler.ColourTo(i - 1, SCE_INNO_PREPROC); } else { styler.ColourTo(i - 1, SCE_INNO_DEFAULT); } // Push back the faulty character chNext = styler[i--]; ch = chPrev; } } else if (IsASCII(ch) && isalpha(ch)) { if (chPrev == '#' || chPrev == ' ' || chPrev == '\t') bufferCount = 0; buffer[bufferCount++] = static_cast(tolower(ch)); } break; case SCE_INNO_STRING_DOUBLE: if (ch == '"') { state = SCE_INNO_DEFAULT; styler.ColourTo(i, SCE_INNO_STRING_DOUBLE); } else if (isEOL) { state = SCE_INNO_DEFAULT; styler.ColourTo(i - 1, SCE_INNO_STRING_DOUBLE); styler.ColourTo(i, SCE_INNO_DEFAULT); } else { styler.ColourTo(i, SCE_INNO_STRING_DOUBLE); } break; case SCE_INNO_STRING_SINGLE: if (ch == '\'') { state = SCE_INNO_DEFAULT; styler.ColourTo(i, SCE_INNO_STRING_SINGLE); } else if (isEOL) { state = SCE_INNO_DEFAULT; styler.ColourTo(i - 1, SCE_INNO_STRING_SINGLE); styler.ColourTo(i, SCE_INNO_DEFAULT); } else { styler.ColourTo(i, SCE_INNO_STRING_SINGLE); } break; case SCE_INNO_INLINE_EXPANSION: if (ch == '}') { state = SCE_INNO_DEFAULT; styler.ColourTo(i, SCE_INNO_INLINE_EXPANSION); } else if (isEOL) { state = SCE_INNO_DEFAULT; styler.ColourTo(i, SCE_INNO_DEFAULT); } break; case SCE_INNO_COMMENT_PASCAL: if (isCommentSlash) { if (isEOL) { state = SCE_INNO_DEFAULT; isCommentSlash = false; styler.ColourTo(i - 1, SCE_INNO_COMMENT_PASCAL); styler.ColourTo(i, SCE_INNO_DEFAULT); } else { styler.ColourTo(i, SCE_INNO_COMMENT_PASCAL); } } else if (isCommentCurly) { if (ch == '}') { state = SCE_INNO_DEFAULT; isCommentCurly = false; } styler.ColourTo(i, SCE_INNO_COMMENT_PASCAL); } else if (isCommentRound) { if (ch == ')' && chPrev == '*') { state = SCE_INNO_DEFAULT; isCommentRound = false; } styler.ColourTo(i, SCE_INNO_COMMENT_PASCAL); } break; } } delete []buffer; } static const char * const innoWordListDesc[] = { "Sections", "Keywords", "Parameters", "Preprocessor directives", "Pascal keywords", "User defined keywords", 0 }; static void FoldInnoDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { Sci_PositionU endPos = startPos + length; char chNext = styler[startPos]; Sci_Position lineCurrent = styler.GetLine(startPos); bool sectionFlag = false; int levelPrev = lineCurrent > 0 ? styler.LevelAt(lineCurrent - 1) : SC_FOLDLEVELBASE; int level; for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler[i + 1]; bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); int style = styler.StyleAt(i); if (style == SCE_INNO_SECTION) sectionFlag = true; if (atEOL || i == endPos - 1) { if (sectionFlag) { level = SC_FOLDLEVELBASE | SC_FOLDLEVELHEADERFLAG; if (level == levelPrev) styler.SetLevel(lineCurrent - 1, levelPrev & ~SC_FOLDLEVELHEADERFLAG); } else { level = levelPrev & SC_FOLDLEVELNUMBERMASK; if (levelPrev & SC_FOLDLEVELHEADERFLAG) level++; } styler.SetLevel(lineCurrent, level); levelPrev = level; lineCurrent++; sectionFlag = false; } } } LexerModule lmInno(SCLEX_INNOSETUP, ColouriseInnoDoc, "inno", FoldInnoDoc, innoWordListDesc); lexilla/lexers/LexLisp.cxx0000664000175000017500000002022414647367374014605 0ustar neilneil// Scintilla source code edit control /** @file LexLisp.cxx ** Lexer for Lisp. ** Written by Alexey Yutkin. **/ // Copyright 1998-2001 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; #define SCE_LISP_CHARACTER 29 #define SCE_LISP_MACRO 30 #define SCE_LISP_MACRO_DISPATCH 31 static inline bool isLispoperator(char ch) { if (IsASCII(ch) && isalnum(ch)) return false; if (ch == '\'' || ch == '`' || ch == '(' || ch == ')' || ch == '[' || ch == ']' || ch == '{' || ch == '}') return true; return false; } static inline bool isLispwordstart(char ch) { return IsASCII(ch) && ch != ';' && !isspacechar(ch) && !isLispoperator(ch) && ch != '\n' && ch != '\r' && ch != '\"'; } static void classifyWordLisp(Sci_PositionU start, Sci_PositionU end, WordList &keywords, WordList &keywords_kw, Accessor &styler) { assert(end >= start); char s[100]; Sci_PositionU i; bool digit_flag = true; for (i = 0; (i < end - start + 1) && (i < 99); i++) { s[i] = styler[start + i]; s[i + 1] = '\0'; if (!isdigit(s[i]) && (s[i] != '.')) digit_flag = false; } char chAttr = SCE_LISP_IDENTIFIER; if(digit_flag) chAttr = SCE_LISP_NUMBER; else { if (keywords.InList(s)) { chAttr = SCE_LISP_KEYWORD; } else if (keywords_kw.InList(s)) { chAttr = SCE_LISP_KEYWORD_KW; } else if ((s[0] == '*' && s[i-1] == '*') || (s[0] == '+' && s[i-1] == '+')) { chAttr = SCE_LISP_SPECIAL; } } styler.ColourTo(end, chAttr); return; } static void ColouriseLispDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { WordList &keywords = *keywordlists[0]; WordList &keywords_kw = *keywordlists[1]; styler.StartAt(startPos); int state = initStyle, radix = -1; char chNext = styler[startPos]; Sci_PositionU lengthDoc = startPos + length; styler.StartSegment(startPos); for (Sci_PositionU i = startPos; i < lengthDoc; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (styler.IsLeadByte(ch)) { chNext = styler.SafeGetCharAt(i + 2); i += 1; continue; } if (state == SCE_LISP_DEFAULT) { if (ch == '#') { styler.ColourTo(i - 1, state); radix = -1; state = SCE_LISP_MACRO_DISPATCH; } else if (ch == ':' && isLispwordstart(chNext)) { styler.ColourTo(i - 1, state); state = SCE_LISP_SYMBOL; } else if (isLispwordstart(ch)) { styler.ColourTo(i - 1, state); state = SCE_LISP_IDENTIFIER; } else if (ch == ';') { styler.ColourTo(i - 1, state); state = SCE_LISP_COMMENT; } else if (isLispoperator(ch) || ch=='\'') { styler.ColourTo(i - 1, state); styler.ColourTo(i, SCE_LISP_OPERATOR); if (ch=='\'' && isLispwordstart(chNext)) { state = SCE_LISP_SYMBOL; } } else if (ch == '\"') { styler.ColourTo(i - 1, state); state = SCE_LISP_STRING; } } else if (state == SCE_LISP_IDENTIFIER || state == SCE_LISP_SYMBOL) { if (!isLispwordstart(ch)) { if (state == SCE_LISP_IDENTIFIER) { classifyWordLisp(styler.GetStartSegment(), i - 1, keywords, keywords_kw, styler); } else { styler.ColourTo(i - 1, state); } state = SCE_LISP_DEFAULT; } /*else*/ if (isLispoperator(ch) || ch=='\'') { styler.ColourTo(i - 1, state); styler.ColourTo(i, SCE_LISP_OPERATOR); if (ch=='\'' && isLispwordstart(chNext)) { state = SCE_LISP_SYMBOL; } } } else if (state == SCE_LISP_MACRO_DISPATCH) { if (!(IsASCII(ch) && isdigit(ch))) { if (ch != 'r' && ch != 'R' && (i - styler.GetStartSegment()) > 1) { state = SCE_LISP_DEFAULT; } else { switch (ch) { case '|': state = SCE_LISP_MULTI_COMMENT; break; case 'o': case 'O': radix = 8; state = SCE_LISP_MACRO; break; case 'x': case 'X': radix = 16; state = SCE_LISP_MACRO; break; case 'b': case 'B': radix = 2; state = SCE_LISP_MACRO; break; case '\\': state = SCE_LISP_CHARACTER; break; case ':': case '-': case '+': state = SCE_LISP_MACRO; break; case '\'': if (isLispwordstart(chNext)) { state = SCE_LISP_SPECIAL; } else { styler.ColourTo(i - 1, SCE_LISP_DEFAULT); styler.ColourTo(i, SCE_LISP_OPERATOR); state = SCE_LISP_DEFAULT; } break; default: if (isLispoperator(ch)) { styler.ColourTo(i - 1, SCE_LISP_DEFAULT); styler.ColourTo(i, SCE_LISP_OPERATOR); } state = SCE_LISP_DEFAULT; break; } } } } else if (state == SCE_LISP_MACRO) { if (isLispwordstart(ch) && (radix == -1 || IsADigit(ch, radix))) { state = SCE_LISP_SPECIAL; } else { state = SCE_LISP_DEFAULT; } } else if (state == SCE_LISP_CHARACTER) { if (isLispoperator(ch)) { styler.ColourTo(i, SCE_LISP_SPECIAL); state = SCE_LISP_DEFAULT; } else if (isLispwordstart(ch)) { styler.ColourTo(i, SCE_LISP_SPECIAL); state = SCE_LISP_SPECIAL; } else { state = SCE_LISP_DEFAULT; } } else if (state == SCE_LISP_SPECIAL) { if (!isLispwordstart(ch) || (radix != -1 && !IsADigit(ch, radix))) { styler.ColourTo(i - 1, state); state = SCE_LISP_DEFAULT; } if (isLispoperator(ch) || ch=='\'') { styler.ColourTo(i - 1, state); styler.ColourTo(i, SCE_LISP_OPERATOR); if (ch=='\'' && isLispwordstart(chNext)) { state = SCE_LISP_SYMBOL; } } } else { if (state == SCE_LISP_COMMENT) { if (atEOL) { styler.ColourTo(i - 1, state); state = SCE_LISP_DEFAULT; } } else if (state == SCE_LISP_MULTI_COMMENT) { if (ch == '|' && chNext == '#') { i++; chNext = styler.SafeGetCharAt(i + 1); styler.ColourTo(i, state); state = SCE_LISP_DEFAULT; } } else if (state == SCE_LISP_STRING) { if (ch == '\\') { if (chNext == '\"' || chNext == '\'' || chNext == '\\') { i++; chNext = styler.SafeGetCharAt(i + 1); } } else if (ch == '\"') { styler.ColourTo(i, state); state = SCE_LISP_DEFAULT; } } } } styler.ColourTo(lengthDoc - 1, state); } static void FoldLispDoc(Sci_PositionU startPos, Sci_Position length, int /* initStyle */, WordList *[], Accessor &styler) { Sci_PositionU lengthDoc = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelPrev = styler.LevelAt(lineCurrent) & SC_FOLDLEVELNUMBERMASK; int levelCurrent = levelPrev; char chNext = styler[startPos]; int styleNext = styler.StyleAt(startPos); for (Sci_PositionU i = startPos; i < lengthDoc; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); int style = styleNext; styleNext = styler.StyleAt(i + 1); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); if (style == SCE_LISP_OPERATOR) { if (ch == '(' || ch == '[' || ch == '{') { levelCurrent++; } else if (ch == ')' || ch == ']' || ch == '}') { levelCurrent--; } } if (atEOL) { int lev = levelPrev; if (visibleChars == 0) lev |= SC_FOLDLEVELWHITEFLAG; if ((levelCurrent > levelPrev) && (visibleChars > 0)) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelPrev = levelCurrent; visibleChars = 0; } if (!isspacechar(ch)) visibleChars++; } // Fill in the real level of the next line, keeping the current flags as they will be filled in later int flagsNext = styler.LevelAt(lineCurrent) & ~SC_FOLDLEVELNUMBERMASK; styler.SetLevel(lineCurrent, levelPrev | flagsNext); } static const char * const lispWordListDesc[] = { "Functions and special operators", "Keywords", 0 }; LexerModule lmLISP(SCLEX_LISP, ColouriseLispDoc, "lisp", FoldLispDoc, lispWordListDesc); lexilla/lexers/LexMMIXAL.cxx0000664000175000017500000001236514647367374014674 0ustar neilneil// Scintilla source code edit control // Encoding: UTF-8 /** @file LexMMIXAL.cxx ** Lexer for MMIX Assembler Language. ** Written by Christoph Hösler ** For information about MMIX visit http://www-cs-faculty.stanford.edu/~knuth/mmix.html **/ // Copyright 1998-2003 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static inline bool IsAWordChar(const int ch) { return (ch < 0x80) && (isalnum(ch) || ch == ':' || ch == '_'); } static inline bool isMMIXALOperator(char ch) { if (IsASCII(ch) && isalnum(ch)) return false; if (ch == '+' || ch == '-' || ch == '|' || ch == '^' || ch == '*' || ch == '/' || ch == '%' || ch == '<' || ch == '>' || ch == '&' || ch == '~' || ch == '$' || ch == ',' || ch == '(' || ch == ')' || ch == '[' || ch == ']') return true; return false; } static void ColouriseMMIXALDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { WordList &opcodes = *keywordlists[0]; WordList &special_register = *keywordlists[1]; WordList &predef_symbols = *keywordlists[2]; StyleContext sc(startPos, length, initStyle, styler); for (; sc.More(); sc.Forward()) { // No EOL continuation if (sc.atLineStart) { if (sc.ch == '@' && sc.chNext == 'i') { sc.SetState(SCE_MMIXAL_INCLUDE); } else { sc.SetState(SCE_MMIXAL_LEADWS); } } // Check if first non whitespace character in line is alphanumeric if (sc.state == SCE_MMIXAL_LEADWS && !isspace(sc.ch)) { // LEADWS if(!IsAWordChar(sc.ch)) { sc.SetState(SCE_MMIXAL_COMMENT); } else { if(sc.atLineStart) { sc.SetState(SCE_MMIXAL_LABEL); } else { sc.SetState(SCE_MMIXAL_OPCODE_PRE); } } } // Determine if the current state should terminate. if (sc.state == SCE_MMIXAL_OPERATOR) { // OPERATOR sc.SetState(SCE_MMIXAL_OPERANDS); } else if (sc.state == SCE_MMIXAL_NUMBER) { // NUMBER if (!isdigit(sc.ch)) { if (IsAWordChar(sc.ch)) { sc.ChangeState(SCE_MMIXAL_REF); sc.SetState(SCE_MMIXAL_REF); } else { sc.SetState(SCE_MMIXAL_OPERANDS); } } } else if (sc.state == SCE_MMIXAL_LABEL) { // LABEL if (!IsAWordChar(sc.ch) ) { sc.SetState(SCE_MMIXAL_OPCODE_PRE); } } else if (sc.state == SCE_MMIXAL_REF) { // REF if (!IsAWordChar(sc.ch) ) { char s0[100]; sc.GetCurrent(s0, sizeof(s0)); const char *s = s0; if (*s == ':') { // ignore base prefix for match ++s; } if (special_register.InList(s)) { sc.ChangeState(SCE_MMIXAL_REGISTER); } else if (predef_symbols.InList(s)) { sc.ChangeState(SCE_MMIXAL_SYMBOL); } sc.SetState(SCE_MMIXAL_OPERANDS); } } else if (sc.state == SCE_MMIXAL_OPCODE_PRE) { // OPCODE_PRE if (!isspace(sc.ch)) { sc.SetState(SCE_MMIXAL_OPCODE); } } else if (sc.state == SCE_MMIXAL_OPCODE) { // OPCODE if (!IsAWordChar(sc.ch) ) { char s[100]; sc.GetCurrent(s, sizeof(s)); if (opcodes.InList(s)) { sc.ChangeState(SCE_MMIXAL_OPCODE_VALID); } else { sc.ChangeState(SCE_MMIXAL_OPCODE_UNKNOWN); } sc.SetState(SCE_MMIXAL_OPCODE_POST); } } else if (sc.state == SCE_MMIXAL_STRING) { // STRING if (sc.ch == '\"') { sc.ForwardSetState(SCE_MMIXAL_OPERANDS); } else if (sc.atLineEnd) { sc.ForwardSetState(SCE_MMIXAL_OPERANDS); } } else if (sc.state == SCE_MMIXAL_CHAR) { // CHAR if (sc.ch == '\'') { sc.ForwardSetState(SCE_MMIXAL_OPERANDS); } else if (sc.atLineEnd) { sc.ForwardSetState(SCE_MMIXAL_OPERANDS); } } else if (sc.state == SCE_MMIXAL_REGISTER) { // REGISTER if (!isdigit(sc.ch)) { sc.SetState(SCE_MMIXAL_OPERANDS); } } else if (sc.state == SCE_MMIXAL_HEX) { // HEX if (!isxdigit(sc.ch)) { sc.SetState(SCE_MMIXAL_OPERANDS); } } // Determine if a new state should be entered. if (sc.state == SCE_MMIXAL_OPCODE_POST || // OPCODE_POST sc.state == SCE_MMIXAL_OPERANDS) { // OPERANDS if (sc.state == SCE_MMIXAL_OPERANDS && isspace(sc.ch)) { sc.SetState(SCE_MMIXAL_COMMENT); } else if (isdigit(sc.ch)) { sc.SetState(SCE_MMIXAL_NUMBER); } else if (IsAWordChar(sc.ch) || sc.Match('@')) { sc.SetState(SCE_MMIXAL_REF); } else if (sc.Match('\"')) { sc.SetState(SCE_MMIXAL_STRING); } else if (sc.Match('\'')) { sc.SetState(SCE_MMIXAL_CHAR); } else if (sc.Match('$')) { sc.SetState(SCE_MMIXAL_REGISTER); } else if (sc.Match('#')) { sc.SetState(SCE_MMIXAL_HEX); } else if (isMMIXALOperator(static_cast(sc.ch))) { sc.SetState(SCE_MMIXAL_OPERATOR); } } } sc.Complete(); } static const char * const MMIXALWordListDesc[] = { "Operation Codes", "Special Register", "Predefined Symbols", 0 }; LexerModule lmMMIXAL(SCLEX_MMIXAL, ColouriseMMIXALDoc, "mmixal", 0, MMIXALWordListDesc); lexilla/lexers/LexYAML.cxx0000664000175000017500000003122014647367374014436 0ustar neilneil// Scintilla source code edit control /** @file LexYAML.cxx ** Lexer for YAML. **/ // Copyright 2003- by Sean O'Dell // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; namespace { const char * const yamlWordListDesc[] = { "Keywords", nullptr }; inline bool AtEOL(Accessor &styler, Sci_PositionU i) { return (styler[i] == '\n') || ((styler[i] == '\r') && (styler.SafeGetCharAt(i + 1) != '\n')); } /** * Check for space, tab, line feed, or carriage return. * See YAML 1.2 spec sections 5.4. Line Break Characters and 5.5. White Space Characters. */ constexpr bool IsWhiteSpaceOrEOL(char ch) noexcept { return ch == ' ' || ch == '\t' || ch == '\n' || ch == '\r'; } unsigned int SpaceCount(char* lineBuffer) noexcept { if (lineBuffer == nullptr) return 0; char* headBuffer = lineBuffer; while (*headBuffer == ' ') headBuffer++; return static_cast(headBuffer - lineBuffer); } bool KeywordAtChar(const char* lineBuffer, char* startComment, const WordList &keywords) noexcept { if (lineBuffer == nullptr || startComment <= lineBuffer) return false; char* endValue = startComment - 1; while (endValue >= lineBuffer && *endValue == ' ') endValue--; Sci_PositionU len = static_cast(endValue - lineBuffer) + 1; char s[100]; if (len > (sizeof(s) / sizeof(s[0]) - 1)) return false; strncpy(s, lineBuffer, len); s[len] = '\0'; return (keywords.InList(s)); } #define YAML_STATE_BITSIZE 16 #define YAML_STATE_MASK (0xFFFF0000) #define YAML_STATE_DOCUMENT (1 << YAML_STATE_BITSIZE) #define YAML_STATE_VALUE (2 << YAML_STATE_BITSIZE) #define YAML_STATE_COMMENT (3 << YAML_STATE_BITSIZE) #define YAML_STATE_TEXT_PARENT (4 << YAML_STATE_BITSIZE) #define YAML_STATE_TEXT (5 << YAML_STATE_BITSIZE) void ColouriseYAMLLine( char *lineBuffer, Sci_PositionU currentLine, Sci_PositionU lengthLine, Sci_PositionU startLine, Sci_PositionU endPos, const WordList &keywords, Accessor &styler) { Sci_PositionU i = 0; bool bInQuotes = false; const unsigned int indentAmount = SpaceCount(lineBuffer); if (currentLine > 0) { const int parentLineState = styler.GetLineState(currentLine - 1); if ((parentLineState&YAML_STATE_MASK) == YAML_STATE_TEXT || (parentLineState&YAML_STATE_MASK) == YAML_STATE_TEXT_PARENT) { const unsigned int parentIndentAmount = parentLineState&(~YAML_STATE_MASK); if (indentAmount > parentIndentAmount) { styler.SetLineState(currentLine, YAML_STATE_TEXT | parentIndentAmount); styler.ColourTo(endPos, SCE_YAML_TEXT); return; } } } styler.SetLineState(currentLine, 0); if (strncmp(lineBuffer, "---", 3) == 0 || strncmp(lineBuffer, "...", 3) == 0) { // Document marker styler.SetLineState(currentLine, YAML_STATE_DOCUMENT); styler.ColourTo(endPos, SCE_YAML_DOCUMENT); return; } // Skip initial spaces while ((i < lengthLine) && lineBuffer[i] == ' ') { // YAML always uses space, never TABS or anything else i++; } if (lineBuffer[i] == '\t') { // if we skipped all spaces, and we are NOT inside a text block, this is wrong styler.ColourTo(endPos, SCE_YAML_ERROR); return; } if (lineBuffer[i] == '#') { // Comment styler.SetLineState(currentLine, YAML_STATE_COMMENT); styler.ColourTo(endPos, SCE_YAML_COMMENT); return; } while (i < lengthLine) { if (lineBuffer[i] == '\'' || lineBuffer[i] == '\"') { bInQuotes = !bInQuotes; } else if (lineBuffer[i] == '#' && isspacechar(lineBuffer[i - 1]) && !bInQuotes) { styler.ColourTo(startLine + i - 1, SCE_YAML_DEFAULT); styler.ColourTo(endPos, SCE_YAML_COMMENT); return; } else if (lineBuffer[i] == ':' && !bInQuotes && (IsWhiteSpaceOrEOL(lineBuffer[i + 1]) || i == lengthLine - 1)) { styler.ColourTo(startLine + i - 1, SCE_YAML_IDENTIFIER); styler.ColourTo(startLine + i, SCE_YAML_OPERATOR); // Non-folding scalar i++; while ((i < lengthLine) && isspacechar(lineBuffer[i])) i++; Sci_PositionU endValue = lengthLine - 1; while ((endValue >= i) && isspacechar(lineBuffer[endValue])) endValue--; lineBuffer[endValue + 1] = '\0'; if (lineBuffer[i] == '|' || lineBuffer[i] == '>') { i++; if (lineBuffer[i] == '+' || lineBuffer[i] == '-') i++; while ((i < lengthLine) && isspacechar(lineBuffer[i])) i++; if (lineBuffer[i] == '\0') { styler.SetLineState(currentLine, YAML_STATE_TEXT_PARENT | indentAmount); styler.ColourTo(endPos, SCE_YAML_DEFAULT); return; } else if (lineBuffer[i] == '#') { styler.SetLineState(currentLine, YAML_STATE_TEXT_PARENT | indentAmount); styler.ColourTo(startLine + i - 1, SCE_YAML_DEFAULT); styler.ColourTo(endPos, SCE_YAML_COMMENT); return; } else { styler.ColourTo(endPos, SCE_YAML_ERROR); return; } } else if (lineBuffer[i] == '#') { styler.ColourTo(startLine + i - 1, SCE_YAML_DEFAULT); styler.ColourTo(endPos, SCE_YAML_COMMENT); return; } Sci_PositionU startComment = i; bInQuotes = false; while (startComment < lengthLine) { // Comment must be space padded if (lineBuffer[startComment] == '\'' || lineBuffer[startComment] == '\"') bInQuotes = !bInQuotes; if (lineBuffer[startComment] == '#' && isspacechar(lineBuffer[startComment - 1]) && !bInQuotes) break; startComment++; } styler.SetLineState(currentLine, YAML_STATE_VALUE); if (lineBuffer[i] == '&' || lineBuffer[i] == '*') { styler.ColourTo(startLine + startComment - 1, SCE_YAML_REFERENCE); if (startComment < lengthLine) styler.ColourTo(endPos, SCE_YAML_COMMENT); return; } if (KeywordAtChar(&lineBuffer[i], &lineBuffer[startComment], keywords)) { // Convertible value (true/false, etc.) styler.ColourTo(startLine + startComment - 1, SCE_YAML_KEYWORD); if (startComment < lengthLine) styler.ColourTo(endPos, SCE_YAML_COMMENT); return; } const Sci_PositionU i2 = i; while ((i < startComment) && lineBuffer[i]) { if (!(IsASCII(lineBuffer[i]) && isdigit(lineBuffer[i])) && lineBuffer[i] != '-' && lineBuffer[i] != '.' && lineBuffer[i] != ',' && lineBuffer[i] != ' ') { styler.ColourTo(startLine + startComment - 1, SCE_YAML_DEFAULT); if (startComment < lengthLine) styler.ColourTo(endPos, SCE_YAML_COMMENT); return; } i++; } if (i > i2) { styler.ColourTo(startLine + startComment - 1, SCE_YAML_NUMBER); if (startComment < lengthLine) styler.ColourTo(endPos, SCE_YAML_COMMENT); return; } break; // shouldn't get here, but just in case, the rest of the line is coloured the default } i++; } styler.ColourTo(endPos, SCE_YAML_DEFAULT); } void ColouriseYAMLDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *keywordLists[], Accessor &styler) { std::string lineBuffer; styler.StartAt(startPos); styler.StartSegment(startPos); Sci_PositionU startLine = startPos; const Sci_PositionU endPos = startPos + length; const Sci_PositionU maxPos = styler.Length(); Sci_PositionU lineCurrent = styler.GetLine(startPos); for (Sci_PositionU i = startPos; i < maxPos && i < endPos; i++) { lineBuffer.push_back(styler[i]); if (AtEOL(styler, i)) { // End of line (or of line buffer) met, colourise it ColouriseYAMLLine(lineBuffer.data(), lineCurrent, lineBuffer.length(), startLine, i, *keywordLists[0], styler); lineBuffer.clear(); startLine = i + 1; lineCurrent++; } } if (!lineBuffer.empty()) { // Last line does not have ending characters ColouriseYAMLLine(lineBuffer.data(), lineCurrent, lineBuffer.length(), startLine, startPos + length - 1, *keywordLists[0], styler); } } bool IsCommentLine(Sci_Position line, Accessor &styler) { const Sci_Position pos = styler.LineStart(line); if (styler[pos] == '#') return true; return false; } void FoldYAMLDoc(Sci_PositionU startPos, Sci_Position length, int /*initStyle - unused*/, WordList *[], Accessor &styler) { const Sci_Position maxPos = startPos + length; const Sci_Position maxLines = styler.GetLine(maxPos - 1); // Requested last line const Sci_Position docLines = styler.GetLine(styler.Length() - 1); // Available last line // property fold.comment.yaml // Set to 1 to allow folding of comment blocks in YAML. const bool foldComment = styler.GetPropertyInt("fold.comment.yaml") != 0; // Backtrack to previous non-blank line so we can determine indent level // for any white space lines // and so we can fix any preceding fold level (which is why we go back // at least one line in all cases) int spaceFlags = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int indentCurrent = styler.IndentAmount(lineCurrent, &spaceFlags, nullptr); while (lineCurrent > 0) { lineCurrent--; indentCurrent = styler.IndentAmount(lineCurrent, &spaceFlags, nullptr); if (!(indentCurrent & SC_FOLDLEVELWHITEFLAG) && (!IsCommentLine(lineCurrent, styler))) break; } int indentCurrentLevel = indentCurrent & SC_FOLDLEVELNUMBERMASK; // Set up initial loop state int prevComment = 0; if (lineCurrent >= 1) prevComment = foldComment && IsCommentLine(lineCurrent - 1, styler); // Process all characters to end of requested range // or comment that hangs over the end of the range. Cap processing in all cases // to end of document (in case of unclosed comment at end). while ((lineCurrent <= docLines) && ((lineCurrent <= maxLines) || prevComment)) { // Gather info int lev = indentCurrent; Sci_Position lineNext = lineCurrent + 1; int indentNext = indentCurrent; if (lineNext <= docLines) { // Information about next line is only available if not at end of document indentNext = styler.IndentAmount(lineNext, &spaceFlags, nullptr); } const int comment = foldComment && IsCommentLine(lineCurrent, styler); const int comment_start = (comment && !prevComment && (lineNext <= docLines) && IsCommentLine(lineNext, styler) && (lev > SC_FOLDLEVELBASE)); const int comment_continue = (comment && prevComment); if (!comment) indentCurrentLevel = indentCurrent & SC_FOLDLEVELNUMBERMASK; if (indentNext & SC_FOLDLEVELWHITEFLAG) indentNext = SC_FOLDLEVELWHITEFLAG | indentCurrentLevel; if (comment_start) { // Place fold point at start of a block of comments lev |= SC_FOLDLEVELHEADERFLAG; } else if (comment_continue) { // Add level to rest of lines in the block lev = lev + 1; } // Skip past any blank lines for next indent level info; we skip also // comments (all comments, not just those starting in column 0) // which effectively folds them into surrounding code rather // than screwing up folding. while ((lineNext < docLines) && ((indentNext & SC_FOLDLEVELWHITEFLAG) || (lineNext <= docLines && IsCommentLine(lineNext, styler)))) { lineNext++; indentNext = styler.IndentAmount(lineNext, &spaceFlags, nullptr); } const int levelAfterComments = indentNext & SC_FOLDLEVELNUMBERMASK; const int levelBeforeComments = Maximum(indentCurrentLevel,levelAfterComments); // Now set all the indent levels on the lines we skipped // Do this from end to start. Once we encounter one line // which is indented more than the line after the end of // the comment-block, use the level of the block before Sci_Position skipLine = lineNext; int skipLevel = levelAfterComments; while (--skipLine > lineCurrent) { const int skipLineIndent = styler.IndentAmount(skipLine, &spaceFlags, nullptr); if ((skipLineIndent & SC_FOLDLEVELNUMBERMASK) > levelAfterComments) skipLevel = levelBeforeComments; const int whiteFlag = skipLineIndent & SC_FOLDLEVELWHITEFLAG; styler.SetLevel(skipLine, skipLevel | whiteFlag); } // Set fold header on non-comment line if (!comment && !(indentCurrent & SC_FOLDLEVELWHITEFLAG) ) { if ((indentCurrent & SC_FOLDLEVELNUMBERMASK) < (indentNext & SC_FOLDLEVELNUMBERMASK)) lev |= SC_FOLDLEVELHEADERFLAG; } // Keep track of block comment state of previous line prevComment = comment_start || comment_continue; // Set fold level for this line and move to next line styler.SetLevel(lineCurrent, lev); indentCurrent = indentNext; lineCurrent = lineNext; } // NOTE: Cannot set level of last line here because indentCurrent doesn't have // header flag set; the loop above is crafted to take care of this case! //styler.SetLevel(lineCurrent, indentCurrent); } } LexerModule lmYAML(SCLEX_YAML, ColouriseYAMLDoc, "yaml", FoldYAMLDoc, yamlWordListDesc); lexilla/lexers/LexPowerPro.cxx0000664000175000017500000004777314647367374015475 0ustar neilneil// Scintilla source code edit control // @file LexPowerPro.cxx // PowerPro utility, written by Bruce Switzer, is available from http://powerpro.webeddie.com // PowerPro lexer is written by Christopher Bean (cbean@cb-software.net) // // Lexer code heavily borrowed from: // LexAU3.cxx by Jos van der Zande // LexCPP.cxx by Neil Hodgson // LexVB.cxx by Neil Hodgson // // Changes: // 2008-10-25 - Initial release // 2008-10-26 - Changed how is hilighted in 'function ' so that // local isFunction = "" and local functions = "" don't get falsely highlighted // 2008-12-14 - Added bounds checking for szFirstWord and szDo // - Replaced SetOfCharacters with CharacterSet // - Made sure that CharacterSet::Contains is passed only positive values // - Made sure that the return value of Accessor::SafeGetCharAt is positive before // passing to functions that require positive values like isspacechar() // - Removed unused visibleChars processing from ColourisePowerProDoc() // - Fixed bug with folding logic where line continuations didn't end where // they were supposed to // - Moved all helper functions to the top of the file // 2010-06-03 - Added onlySpaces variable to allow the @function and ;comment styles to be indented // - Modified HasFunction function to be a bit more robust // - Renamed HasFunction function to IsFunction // - Cleanup // Copyright 1998-2005 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static inline bool IsStreamCommentStyle(int style) { return style == SCE_POWERPRO_COMMENTBLOCK; } static inline bool IsLineEndChar(unsigned char ch) { return ch == 0x0a //LF || ch == 0x0c //FF || ch == 0x0d; //CR } static bool IsContinuationLine(Sci_PositionU szLine, Accessor &styler) { Sci_Position startPos = styler.LineStart(szLine); Sci_Position endPos = styler.LineStart(szLine + 1) - 2; while (startPos < endPos) { char stylech = styler.StyleAt(startPos); if (!(stylech == SCE_POWERPRO_COMMENTBLOCK)) { char ch = styler.SafeGetCharAt(endPos); char chPrev = styler.SafeGetCharAt(endPos - 1); char chPrevPrev = styler.SafeGetCharAt(endPos - 2); if (ch > 0 && chPrev > 0 && chPrevPrev > 0 && !isspacechar(ch) && !isspacechar(chPrev) && !isspacechar(chPrevPrev) ) return (chPrevPrev == ';' && chPrev == ';' && ch == '+'); } endPos--; // skip to next char } return false; } // Routine to find first none space on the current line and return its Style // needed for comment lines not starting on pos 1 static int GetStyleFirstWord(Sci_Position szLine, Accessor &styler) { Sci_Position startPos = styler.LineStart(szLine); Sci_Position endPos = styler.LineStart(szLine + 1) - 1; char ch = styler.SafeGetCharAt(startPos); while (ch > 0 && isspacechar(ch) && startPos < endPos) { startPos++; // skip to next char ch = styler.SafeGetCharAt(startPos); } return styler.StyleAt(startPos); } //returns true if there is a function to highlight //used to highlight in 'function ' //note: // sample line (without quotes): "\tfunction asdf() // currentPos will be the position of 'a' static bool IsFunction(Accessor &styler, Sci_PositionU currentPos) { const char function[10] = "function "; //10 includes \0 unsigned int numberOfCharacters = sizeof(function) - 1; Sci_PositionU position = currentPos - numberOfCharacters; //compare each character with the letters in the function array //return false if ALL don't match for (Sci_PositionU i = 0; i < numberOfCharacters; i++) { char c = styler.SafeGetCharAt(position++); if (c != function[i]) return false; } //make sure that there are only spaces (or tabs) between the beginning //of the line and the function declaration position = currentPos - numberOfCharacters - 1; //-1 to move to char before 'function' for (Sci_PositionU j = 0; j < 16; j++) { //check up to 16 preceeding characters char c = styler.SafeGetCharAt(position--, '\0'); //if can't read char, return NUL (past beginning of document) if (c <= 0) //reached beginning of document return true; if (c > 0 && IsLineEndChar(c)) return true; else if (c > 0 && !IsASpaceOrTab(c)) return false; } //fall-through return false; } static void ColourisePowerProDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler, bool caseSensitive) { WordList &keywords = *keywordlists[0]; WordList &keywords2 = *keywordlists[1]; WordList &keywords3 = *keywordlists[2]; WordList &keywords4 = *keywordlists[3]; //define the character sets CharacterSet setWordStart(CharacterSet::setAlpha, "_@", 0x80, true); CharacterSet setWord(CharacterSet::setAlphaNum, "._", 0x80, true); StyleContext sc(startPos, length, initStyle, styler); char s_save[100]; //for last line highlighting //are there only spaces between the first letter of the line and the beginning of the line bool onlySpaces = true; for (; sc.More(); sc.Forward()) { // save the total current word for eof processing char s[100]; sc.GetCurrentLowered(s, sizeof(s)); if ((sc.ch > 0) && setWord.Contains(sc.ch)) { strcpy(s_save,s); int tp = static_cast(strlen(s_save)); if (tp < 99) { s_save[tp] = static_cast(tolower(sc.ch)); s_save[tp+1] = '\0'; } } if (sc.atLineStart) { if (sc.state == SCE_POWERPRO_DOUBLEQUOTEDSTRING) { // Prevent SCE_POWERPRO_STRINGEOL from leaking back to previous line which // ends with a line continuation by locking in the state upto this position. sc.SetState(SCE_POWERPRO_DOUBLEQUOTEDSTRING); } } // Determine if the current state should terminate. switch (sc.state) { case SCE_POWERPRO_OPERATOR: sc.SetState(SCE_POWERPRO_DEFAULT); break; case SCE_POWERPRO_NUMBER: if (!IsADigit(sc.ch)) sc.SetState(SCE_POWERPRO_DEFAULT); break; case SCE_POWERPRO_IDENTIFIER: //if ((sc.ch > 0) && !setWord.Contains(sc.ch) || (sc.ch == '.')) { // use this line if don't want to match keywords with . in them. ie: win.debug will match both win and debug so win debug will also be colorized if ((sc.ch > 0) && !setWord.Contains(sc.ch)){ // || (sc.ch == '.')) { // use this line if you want to match keywords with a . ie: win.debug will only match win.debug neither win nor debug will be colorized separately char s[1000]; if (caseSensitive) { sc.GetCurrent(s, sizeof(s)); } else { sc.GetCurrentLowered(s, sizeof(s)); } if (keywords.InList(s)) { sc.ChangeState(SCE_POWERPRO_WORD); } else if (keywords2.InList(s)) { sc.ChangeState(SCE_POWERPRO_WORD2); } else if (keywords3.InList(s)) { sc.ChangeState(SCE_POWERPRO_WORD3); } else if (keywords4.InList(s)) { sc.ChangeState(SCE_POWERPRO_WORD4); } sc.SetState(SCE_POWERPRO_DEFAULT); } break; case SCE_POWERPRO_LINECONTINUE: if (sc.atLineStart) { sc.SetState(SCE_POWERPRO_DEFAULT); } else if (sc.Match('/', '*') || sc.Match('/', '/')) { sc.SetState(SCE_POWERPRO_DEFAULT); } break; case SCE_POWERPRO_COMMENTBLOCK: if (sc.Match('*', '/')) { sc.Forward(); sc.ForwardSetState(SCE_POWERPRO_DEFAULT); } break; case SCE_POWERPRO_COMMENTLINE: if (sc.atLineStart) { sc.SetState(SCE_POWERPRO_DEFAULT); } break; case SCE_POWERPRO_DOUBLEQUOTEDSTRING: if (sc.atLineEnd) { sc.ChangeState(SCE_POWERPRO_STRINGEOL); } else if (sc.ch == '\\') { if (sc.chNext == '\"' || sc.chNext == '\'' || sc.chNext == '\\') { sc.Forward(); } } else if (sc.ch == '\"') { sc.ForwardSetState(SCE_POWERPRO_DEFAULT); } break; case SCE_POWERPRO_SINGLEQUOTEDSTRING: if (sc.atLineEnd) { sc.ChangeState(SCE_POWERPRO_STRINGEOL); } else if (sc.ch == '\\') { if (sc.chNext == '\"' || sc.chNext == '\'' || sc.chNext == '\\') { sc.Forward(); } } else if (sc.ch == '\'') { sc.ForwardSetState(SCE_POWERPRO_DEFAULT); } break; case SCE_POWERPRO_STRINGEOL: if (sc.atLineStart) { sc.SetState(SCE_POWERPRO_DEFAULT); } break; case SCE_POWERPRO_VERBATIM: if (sc.ch == '\"') { if (sc.chNext == '\"') { sc.Forward(); } else { sc.ForwardSetState(SCE_POWERPRO_DEFAULT); } } break; case SCE_POWERPRO_ALTQUOTE: if (sc.ch == '#') { if (sc.chNext == '#') { sc.Forward(); } else { sc.ForwardSetState(SCE_POWERPRO_DEFAULT); } } break; case SCE_POWERPRO_FUNCTION: if (isspacechar(sc.ch) || sc.ch == '(') { sc.SetState(SCE_POWERPRO_DEFAULT); } break; } // Determine if a new state should be entered. if (sc.state == SCE_POWERPRO_DEFAULT) { if (sc.Match('?', '\"')) { sc.SetState(SCE_POWERPRO_VERBATIM); sc.Forward(); } else if (IsADigit(sc.ch) || (sc.ch == '.' && IsADigit(sc.chNext))) { sc.SetState(SCE_POWERPRO_NUMBER); }else if (sc.Match('?','#')) { if (sc.ch == '?' && sc.chNext == '#') { sc.SetState(SCE_POWERPRO_ALTQUOTE); sc.Forward(); } } else if (IsFunction(styler, sc.currentPos)) { //highlight in 'function ' sc.SetState(SCE_POWERPRO_FUNCTION); } else if (onlySpaces && sc.ch == '@') { //alternate function definition [label] sc.SetState(SCE_POWERPRO_FUNCTION); } else if ((sc.ch > 0) && (setWordStart.Contains(sc.ch) || (sc.ch == '?'))) { sc.SetState(SCE_POWERPRO_IDENTIFIER); } else if (sc.Match(";;+")) { sc.SetState(SCE_POWERPRO_LINECONTINUE); } else if (sc.Match('/', '*')) { sc.SetState(SCE_POWERPRO_COMMENTBLOCK); sc.Forward(); // Eat the * so it isn't used for the end of the comment } else if (sc.Match('/', '/')) { sc.SetState(SCE_POWERPRO_COMMENTLINE); } else if (onlySpaces && sc.ch == ';') { //legacy comment that can only have blank space in front of it sc.SetState(SCE_POWERPRO_COMMENTLINE); } else if (sc.Match(";;")) { sc.SetState(SCE_POWERPRO_COMMENTLINE); } else if (sc.ch == '\"') { sc.SetState(SCE_POWERPRO_DOUBLEQUOTEDSTRING); } else if (sc.ch == '\'') { sc.SetState(SCE_POWERPRO_SINGLEQUOTEDSTRING); } else if (isoperator(static_cast(sc.ch))) { sc.SetState(SCE_POWERPRO_OPERATOR); } } //maintain a record of whether or not all the preceding characters on //a line are space characters if (onlySpaces && !IsASpaceOrTab(sc.ch)) onlySpaces = false; //reset when starting a new line if (sc.atLineEnd) onlySpaces = true; } //************************************* // Colourize the last word correctly //************************************* if (sc.state == SCE_POWERPRO_IDENTIFIER) { if (keywords.InList(s_save)) { sc.ChangeState(SCE_POWERPRO_WORD); sc.SetState(SCE_POWERPRO_DEFAULT); } else if (keywords2.InList(s_save)) { sc.ChangeState(SCE_POWERPRO_WORD2); sc.SetState(SCE_POWERPRO_DEFAULT); } else if (keywords3.InList(s_save)) { sc.ChangeState(SCE_POWERPRO_WORD3); sc.SetState(SCE_POWERPRO_DEFAULT); } else if (keywords4.InList(s_save)) { sc.ChangeState(SCE_POWERPRO_WORD4); sc.SetState(SCE_POWERPRO_DEFAULT); } else { sc.SetState(SCE_POWERPRO_DEFAULT); } } sc.Complete(); } static void FoldPowerProDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { //define the character sets CharacterSet setWordStart(CharacterSet::setAlpha, "_@", 0x80, true); CharacterSet setWord(CharacterSet::setAlphaNum, "._", 0x80, true); //used to tell if we're recursively folding the whole document, or just a small piece (ie: if statement or 1 function) bool isFoldingAll = true; Sci_Position endPos = startPos + length; Sci_Position lastLine = styler.GetLine(styler.Length()); //used to help fold the last line correctly // get settings from the config files for folding comments and preprocessor lines bool foldComment = styler.GetPropertyInt("fold.comment") != 0; bool foldInComment = styler.GetPropertyInt("fold.comment") == 2; bool foldCompact = true; // Backtrack to previous line in case need to fix its fold status Sci_Position lineCurrent = styler.GetLine(startPos); if (startPos > 0) { isFoldingAll = false; if (lineCurrent > 0) { lineCurrent--; startPos = styler.LineStart(lineCurrent); } } // vars for style of previous/current/next lines int style = GetStyleFirstWord(lineCurrent,styler); int stylePrev = 0; // find the first previous line without continuation character at the end while ((lineCurrent > 0 && IsContinuationLine(lineCurrent, styler)) || (lineCurrent > 1 && IsContinuationLine(lineCurrent - 1, styler))) { lineCurrent--; startPos = styler.LineStart(lineCurrent); } if (lineCurrent > 0) { stylePrev = GetStyleFirstWord(lineCurrent-1,styler); } // vars for getting first word to check for keywords bool isFirstWordStarted = false; bool isFirstWordEnded = false; const unsigned int FIRST_WORD_MAX_LEN = 10; char szFirstWord[FIRST_WORD_MAX_LEN] = ""; unsigned int firstWordLen = 0; char szDo[3]=""; int szDolen = 0; bool isDoLastWord = false; // var for indentlevel int levelCurrent = SC_FOLDLEVELBASE; if (lineCurrent > 0) levelCurrent = styler.LevelAt(lineCurrent-1) >> 16; int levelNext = levelCurrent; int visibleChars = 0; int functionCount = 0; char chNext = styler.SafeGetCharAt(startPos); char chPrev = '\0'; char chPrevPrev = '\0'; char chPrevPrevPrev = '\0'; for (Sci_Position i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); if ((ch > 0) && setWord.Contains(ch)) visibleChars++; // get the syle for the current character neede to check in comment int stylech = styler.StyleAt(i); // start the capture of the first word if (!isFirstWordStarted && (ch > 0)) { if (setWord.Contains(ch) || setWordStart.Contains(ch) || ch == ';' || ch == '/') { isFirstWordStarted = true; if (firstWordLen < FIRST_WORD_MAX_LEN - 1) { szFirstWord[firstWordLen++] = static_cast(tolower(ch)); szFirstWord[firstWordLen] = '\0'; } } } // continue capture of the first word on the line else if (isFirstWordStarted && !isFirstWordEnded && (ch > 0)) { if (!setWord.Contains(ch)) { isFirstWordEnded = true; } else if (firstWordLen < (FIRST_WORD_MAX_LEN - 1)) { szFirstWord[firstWordLen++] = static_cast(tolower(ch)); szFirstWord[firstWordLen] = '\0'; } } if (stylech != SCE_POWERPRO_COMMENTLINE) { //reset isDoLastWord if we find a character(ignoring spaces) after 'do' if (isDoLastWord && (ch > 0) && setWord.Contains(ch)) isDoLastWord = false; // --find out if the word "do" is the last on a "if" line-- // collect each letter and put it into a buffer 2 chars long // if we end up with "do" in the buffer when we reach the end of // the line, "do" was the last word on the line if ((ch > 0) && isFirstWordEnded && strcmp(szFirstWord, "if") == 0) { if (szDolen == 2) { szDo[0] = szDo[1]; szDo[1] = static_cast(tolower(ch)); szDo[2] = '\0'; if (strcmp(szDo, "do") == 0) isDoLastWord = true; } else if (szDolen < 2) { szDo[szDolen++] = static_cast(tolower(ch)); szDo[szDolen] = '\0'; } } } // End of Line found so process the information if ((ch == '\r' && chNext != '\n') // \r\n || ch == '\n' // \n || i == endPos) { // end of selection // ************************** // Folding logic for Keywords // ************************** // if a keyword is found on the current line and the line doesn't end with ;;+ (continuation) // and we are not inside a commentblock. if (firstWordLen > 0 && chPrev != '+' && chPrevPrev != ';' && chPrevPrevPrev !=';' && (!IsStreamCommentStyle(style) || foldInComment) ) { // only fold "if" last keyword is "then" (else its a one line if) if (strcmp(szFirstWord, "if") == 0 && isDoLastWord) levelNext++; // create new fold for these words if (strcmp(szFirstWord, "for") == 0) levelNext++; //handle folding for functions/labels //Note: Functions and labels don't have an explicit end like [end function] // 1. functions/labels end at the start of another function // 2. functions/labels end at the end of the file if ((strcmp(szFirstWord, "function") == 0) || (firstWordLen > 0 && szFirstWord[0] == '@')) { if (isFoldingAll) { //if we're folding the whole document (recursivly by lua script) if (functionCount > 0) { levelCurrent--; } else { levelNext++; } functionCount++; } else { //if just folding a small piece (by clicking on the minus sign next to the word) levelCurrent--; } } // end the fold for these words before the current line if (strcmp(szFirstWord, "endif") == 0 || strcmp(szFirstWord, "endfor") == 0) { levelNext--; levelCurrent--; } // end the fold for these words before the current line and Start new fold if (strcmp(szFirstWord, "else") == 0 || strcmp(szFirstWord, "elseif") == 0 ) levelCurrent--; } // Preprocessor and Comment folding int styleNext = GetStyleFirstWord(lineCurrent + 1,styler); // ********************************* // Folding logic for Comment blocks // ********************************* if (foldComment && IsStreamCommentStyle(style)) { // Start of a comment block if (stylePrev != style && IsStreamCommentStyle(styleNext) && styleNext == style) { levelNext++; } // fold till the last line for normal comment lines else if (IsStreamCommentStyle(stylePrev) && styleNext != SCE_POWERPRO_COMMENTLINE && stylePrev == SCE_POWERPRO_COMMENTLINE && style == SCE_POWERPRO_COMMENTLINE) { levelNext--; } // fold till the one but last line for Blockcomment lines else if (IsStreamCommentStyle(stylePrev) && styleNext != SCE_POWERPRO_COMMENTBLOCK && style == SCE_POWERPRO_COMMENTBLOCK) { levelNext--; levelCurrent--; } } int levelUse = levelCurrent; int lev = levelUse | levelNext << 16; if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if (levelUse < levelNext) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) styler.SetLevel(lineCurrent, lev); // reset values for the next line lineCurrent++; stylePrev = style; style = styleNext; levelCurrent = levelNext; visibleChars = 0; // if the last characters are ;;+ then don't reset since the line continues on the next line. if (chPrev != '+' && chPrevPrev != ';' && chPrevPrevPrev != ';') { firstWordLen = 0; szDolen = 0; isFirstWordStarted = false; isFirstWordEnded = false; isDoLastWord = false; //blank out first word for (unsigned int i = 0; i < FIRST_WORD_MAX_LEN; i++) szFirstWord[i] = '\0'; } } // save the last processed characters if ((ch > 0) && !isspacechar(ch)) { chPrevPrevPrev = chPrevPrev; chPrevPrev = chPrev; chPrev = ch; } } //close folds on the last line - without this a 'phantom' //fold can appear when an open fold is on the last line //this can occur because functions and labels don't have an explicit end if (lineCurrent >= lastLine) { int lev = 0; lev |= SC_FOLDLEVELWHITEFLAG; styler.SetLevel(lineCurrent, lev); } } static const char * const powerProWordLists[] = { "Keyword list 1", "Keyword list 2", "Keyword list 3", "Keyword list 4", 0, }; static void ColourisePowerProDocWrapper(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { ColourisePowerProDoc(startPos, length, initStyle, keywordlists, styler, false); } LexerModule lmPowerPro(SCLEX_POWERPRO, ColourisePowerProDocWrapper, "powerpro", FoldPowerProDoc, powerProWordLists); lexilla/lexers/LexCPP.cxx0000664000175000017500000017163714647367374014337 0ustar neilneil// Scintilla source code edit control /** @file LexCPP.cxx ** Lexer for C++, C, Java, and JavaScript. ** Further folding features and configuration properties added by "Udo Lechner" **/ // Copyright 1998-2005 by Neil Hodgson // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "StringCopy.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" #include "OptionSet.h" #include "SparseState.h" #include "SubStyles.h" using namespace Scintilla; using namespace Lexilla; namespace { // Use an unnamed namespace to protect the functions and classes from name conflicts constexpr bool IsSpaceEquiv(int state) noexcept { return (state <= SCE_C_COMMENTDOC) || // including SCE_C_DEFAULT, SCE_C_COMMENT, SCE_C_COMMENTLINE (state == SCE_C_COMMENTLINEDOC) || (state == SCE_C_COMMENTDOCKEYWORD) || (state == SCE_C_COMMENTDOCKEYWORDERROR); } // Preconditions: sc.currentPos points to a character after '+' or '-'. // The test for pos reaching 0 should be redundant, // and is in only for safety measures. // Limitation: this code will give the incorrect answer for code like // a = b+++/ptn/... // Putting a space between the '++' post-inc operator and the '+' binary op // fixes this, and is highly recommended for readability anyway. bool FollowsPostfixOperator(const StyleContext &sc, LexAccessor &styler) { Sci_Position pos = sc.currentPos; while (--pos > 0) { const char ch = styler[pos]; if (ch == '+' || ch == '-') { return styler[pos - 1] == ch; } } return false; } bool followsReturnKeyword(const StyleContext &sc, LexAccessor &styler) { // Don't look at styles, so no need to flush. Sci_Position pos = sc.currentPos; const Sci_Position currentLine = styler.GetLine(pos); const Sci_Position lineStartPos = styler.LineStart(currentLine); while (--pos > lineStartPos) { const char ch = styler.SafeGetCharAt(pos); if (ch != ' ' && ch != '\t') { break; } } const char *retBack = "nruter"; const char *s = retBack; while (*s && pos >= lineStartPos && styler.SafeGetCharAt(pos) == *s) { s++; pos--; } return !*s; } constexpr bool IsOperatorOrSpace(int ch) noexcept { return isoperator(ch) || IsASpace(ch); } bool OnlySpaceOrTab(std::string_view s) noexcept { for (const char ch : s) { if (!IsASpaceOrTab(ch)) return false; } return true; } using Tokens = std::vector; Tokens StringSplit(const std::string &text, int separator) { Tokens vs(text.empty() ? 0 : 1); for (const char ch : text) { if (ch == separator) { vs.emplace_back(); } else { vs.back() += ch; } } return vs; } struct BracketPair { Tokens::iterator itBracket; Tokens::iterator itEndBracket; }; BracketPair FindBracketPair(Tokens &tokens) { const Tokens::iterator itBracket = std::find(tokens.begin(), tokens.end(), "("); if (itBracket != tokens.end()) { size_t nest = 0; for (Tokens::iterator itTok = itBracket; itTok != tokens.end(); ++itTok) { if (*itTok == "(") { nest++; } else if (*itTok == ")") { nest--; if (nest == 0) { return { itBracket, itTok }; } } } } return { tokens.end(), tokens.end() }; } void highlightTaskMarker(StyleContext &sc, LexAccessor &styler, int activity, const WordList &markerList, bool caseSensitive) { if (IsOperatorOrSpace(sc.chPrev) && !IsOperatorOrSpace(sc.ch) && markerList.Length()) { std::string marker; for (Sci_PositionU currPos = sc.currentPos; true; currPos++) { const char ch = styler.SafeGetCharAt(currPos); if (IsOperatorOrSpace(ch)) { break; } if (caseSensitive) marker.push_back(ch); else marker.push_back(MakeLowerCase(ch)); } if (markerList.InList(marker)) { sc.SetState(SCE_C_TASKMARKER|activity); } } } const CharacterSet setHexDigits(CharacterSet::setDigits, "ABCDEFabcdef"); const CharacterSet setOctDigits("01234567"); const CharacterSet setNoneNumeric; class EscapeSequence { const CharacterSet *escapeSetValid = nullptr; int digitsLeft = 0; public: int outerState = SCE_C_DEFAULT; EscapeSequence() = default; void resetEscapeState(int state, int nextChar) noexcept { digitsLeft = 0; outerState = state; escapeSetValid = &setNoneNumeric; if (nextChar == 'U') { digitsLeft = 9; escapeSetValid = &setHexDigits; } else if (nextChar == 'u') { digitsLeft = 5; escapeSetValid = &setHexDigits; } else if (nextChar == 'x') { digitsLeft = 5; escapeSetValid = &setHexDigits; } else if (setOctDigits.Contains(nextChar)) { digitsLeft = 3; escapeSetValid = &setOctDigits; } } [[nodiscard]] bool atEscapeEnd(int currChar) const noexcept { return (digitsLeft <= 0) || !escapeSetValid->Contains(currChar); } void consumeDigit() noexcept { digitsLeft--; } }; std::string GetRestOfLine(LexAccessor &styler, Sci_Position start, bool allowSpace) { std::string restOfLine; Sci_Position line = styler.GetLine(start); Sci_Position pos = start; Sci_Position endLine = styler.LineEnd(line); char ch = styler.SafeGetCharAt(start, '\n'); while (pos < endLine) { if (ch == '\\' && ((pos + 1) == endLine)) { // Continuation line line++; pos = styler.LineStart(line); endLine = styler.LineEnd(line); ch = styler.SafeGetCharAt(pos, '\n'); } else { const char chNext = styler.SafeGetCharAt(pos + 1, '\n'); if (ch == '/' && (chNext == '/' || chNext == '*')) break; if (allowSpace || (ch != ' ')) { restOfLine += ch; } pos++; ch = chNext; } } return restOfLine; } constexpr bool IsStreamCommentStyle(int style) noexcept { return style == SCE_C_COMMENT || style == SCE_C_COMMENTDOC || style == SCE_C_COMMENTDOCKEYWORD || style == SCE_C_COMMENTDOCKEYWORDERROR; } struct PPDefinition { Sci_Position line; std::string key; std::string value; bool isUndef; std::string arguments; PPDefinition(Sci_Position line_, std::string_view key_, std::string_view value_, bool isUndef_, std::string_view arguments_) : line(line_), key(key_), value(value_), isUndef(isUndef_), arguments(arguments_) { } }; constexpr int inactiveFlag = 0x40; class LinePPState { // Track the state of preprocessor conditionals to allow showing active and inactive // code in different styles. // Only works up to 31 levels of conditional nesting. // state is a bit mask with 1 bit per level // bit is 1 for level if section inactive, so any bits set = inactive style int state = 0; // ifTaken is a bit mask with 1 bit per level // bit is 1 for level if some branch at this level has been taken int ifTaken = 0; // level is the nesting level of #if constructs int level = -1; static const int maximumNestingLevel = 31; [[nodiscard]] int maskLevel() const noexcept { if (level >= 0) { return 1 << level; } return 1; } public: LinePPState() noexcept = default; [[nodiscard]] bool ValidLevel() const noexcept { return level >= 0 && level < maximumNestingLevel; } [[nodiscard]] bool IsActive() const noexcept { return state == 0; } [[nodiscard]] bool IsInactive() const noexcept { return state != 0; } [[nodiscard]] int ActiveState() const noexcept { return state ? inactiveFlag : 0; } [[nodiscard]] bool CurrentIfTaken() const noexcept { return (ifTaken & maskLevel()) != 0; } void StartSection(bool on) noexcept { level++; if (ValidLevel()) { if (on) { state &= ~maskLevel(); ifTaken |= maskLevel(); } else { state |= maskLevel(); ifTaken &= ~maskLevel(); } } } void EndSection() noexcept { if (ValidLevel()) { state &= ~maskLevel(); ifTaken &= ~maskLevel(); } level--; } void InvertCurrentLevel() noexcept { if (ValidLevel()) { state ^= maskLevel(); ifTaken |= maskLevel(); } } }; // Hold the preprocessor state for each line seen. // Currently one entry per line but could become sparse with just one entry per preprocessor line. class PPStates { std::vector vlls; public: [[nodiscard]] LinePPState ForLine(Sci_Position line) const noexcept { if ((line > 0) && (vlls.size() > static_cast(line))) { return vlls[line]; } return {}; } void Add(Sci_Position line, LinePPState lls) { vlls.resize(line+1); vlls[line] = lls; } }; enum class BackQuotedString : int { None, RawString, TemplateLiteral, }; // string interpolating state struct InterpolatingState { int state; int braceCount; }; struct Definition { std::string_view name; std::string_view value; std::string_view arguments; }; constexpr std::string_view TrimSpaceTab(std::string_view sv) noexcept { while (!sv.empty() && IsASpaceOrTab(sv.front())) { sv.remove_prefix(1); } return sv; } // Parse a macro definition, either from a #define line in a file or from keywords. // Either an object macro or a function macro () . // VALUE is optional and is treated as "1" if missing. // #define ALLOW_PRINT // #define VERSION 37 // #define VER(a,b) a*10+b // Whitespace separates macro and value in files but keywords use '=' separator. // 'endName' contains a set of characters that terminate the name of the macro. constexpr Definition ParseDefine(std::string_view definition, std::string_view endName) { Definition ret; definition = TrimSpaceTab(definition); const size_t afterName = definition.find_first_of(endName); if (afterName != std::string_view::npos) { ret.name = definition.substr(0, afterName); if (definition.at(afterName) == '(') { // Macro definition.remove_prefix(afterName+1); const size_t closeBracket = definition.find(')'); if (closeBracket != std::string_view::npos) { ret.arguments = definition.substr(0, closeBracket); definition.remove_prefix(closeBracket+1); if (!definition.empty() && (endName.find(definition.front()) != std::string_view::npos)) { definition.remove_prefix(1); } ret.value = definition; } // else malformed as requires closing bracket } else { ret.value = definition.substr(afterName+1); } } else { ret.name = definition; ret.value = "1"; } return ret; } // An individual named option for use in an OptionSet // Options used for LexerCPP struct OptionsCPP { bool stylingWithinPreprocessor = false; bool identifiersAllowDollars = true; bool trackPreprocessor = true; bool updatePreprocessor = true; bool verbatimStringsAllowEscapes = false; bool triplequotedStrings = false; bool hashquotedStrings = false; BackQuotedString backQuotedStrings = BackQuotedString::None; bool escapeSequence = false; bool fold = false; bool foldSyntaxBased = true; bool foldComment = false; bool foldCommentMultiline = true; bool foldCommentExplicit = true; std::string foldExplicitStart; std::string foldExplicitEnd; bool foldExplicitAnywhere = false; bool foldPreprocessor = false; bool foldPreprocessorAtElse = false; bool foldCompact = false; bool foldAtElse = false; }; const char *const cppWordLists[] = { "Primary keywords and identifiers", "Secondary keywords and identifiers", "Documentation comment keywords", "Global classes and typedefs", "Preprocessor definitions", "Task marker and error marker keywords", nullptr, }; struct OptionSetCPP : public OptionSet { OptionSetCPP() { DefineProperty("styling.within.preprocessor", &OptionsCPP::stylingWithinPreprocessor, "For C++ code, determines whether all preprocessor code is styled in the " "preprocessor style (0, the default) or only from the initial # to the end " "of the command word(1)."); DefineProperty("lexer.cpp.allow.dollars", &OptionsCPP::identifiersAllowDollars, "Set to 0 to disallow the '$' character in identifiers with the cpp lexer."); DefineProperty("lexer.cpp.track.preprocessor", &OptionsCPP::trackPreprocessor, "Set to 1 to interpret #if/#else/#endif to grey out code that is not active."); DefineProperty("lexer.cpp.update.preprocessor", &OptionsCPP::updatePreprocessor, "Set to 1 to update preprocessor definitions when #define found."); DefineProperty("lexer.cpp.verbatim.strings.allow.escapes", &OptionsCPP::verbatimStringsAllowEscapes, "Set to 1 to allow verbatim strings to contain escape sequences."); DefineProperty("lexer.cpp.triplequoted.strings", &OptionsCPP::triplequotedStrings, "Set to 1 to enable highlighting of triple-quoted strings."); DefineProperty("lexer.cpp.hashquoted.strings", &OptionsCPP::hashquotedStrings, "Set to 1 to enable highlighting of hash-quoted strings."); DefineProperty("lexer.cpp.backquoted.strings", &OptionsCPP::backQuotedStrings, "Set how to highlighting back-quoted strings. " "0 (the default) no highlighting. " "1 highlighted as Go raw string. " "2 highlighted as JavaScript template literal."); DefineProperty("lexer.cpp.escape.sequence", &OptionsCPP::escapeSequence, "Set to 1 to enable highlighting of escape sequences in strings"); DefineProperty("fold", &OptionsCPP::fold); DefineProperty("fold.cpp.syntax.based", &OptionsCPP::foldSyntaxBased, "Set this property to 0 to disable syntax based folding."); DefineProperty("fold.comment", &OptionsCPP::foldComment, "This option enables folding multi-line comments and explicit fold points when using the C++ lexer. " "Explicit fold points allows adding extra folding by placing a //{ comment at the start and a //} " "at the end of a section that should fold."); DefineProperty("fold.cpp.comment.multiline", &OptionsCPP::foldCommentMultiline, "Set this property to 0 to disable folding multi-line comments when fold.comment=1."); DefineProperty("fold.cpp.comment.explicit", &OptionsCPP::foldCommentExplicit, "Set this property to 0 to disable folding explicit fold points when fold.comment=1."); DefineProperty("fold.cpp.explicit.start", &OptionsCPP::foldExplicitStart, "The string to use for explicit fold start points, replacing the standard //{."); DefineProperty("fold.cpp.explicit.end", &OptionsCPP::foldExplicitEnd, "The string to use for explicit fold end points, replacing the standard //}."); DefineProperty("fold.cpp.explicit.anywhere", &OptionsCPP::foldExplicitAnywhere, "Set this property to 1 to enable explicit fold points anywhere, not just in line comments."); DefineProperty("fold.cpp.preprocessor.at.else", &OptionsCPP::foldPreprocessorAtElse, "This option enables folding on a preprocessor #else or #endif line of an #if statement."); DefineProperty("fold.preprocessor", &OptionsCPP::foldPreprocessor, "This option enables folding preprocessor directives when using the C++ lexer. " "Includes C#'s explicit #region and #endregion folding directives."); DefineProperty("fold.compact", &OptionsCPP::foldCompact); DefineProperty("fold.at.else", &OptionsCPP::foldAtElse, "This option enables C++ folding on a \"} else {\" line of an if statement."); DefineWordListSets(cppWordLists); } }; const char styleSubable[] = {SCE_C_IDENTIFIER, SCE_C_COMMENTDOCKEYWORD, 0}; LexicalClass lexicalClasses[] = { // Lexer Cpp SCLEX_CPP SCE_C_: 0, "SCE_C_DEFAULT", "default", "White space", 1, "SCE_C_COMMENT", "comment", "Comment: /* */.", 2, "SCE_C_COMMENTLINE", "comment line", "Line Comment: //.", 3, "SCE_C_COMMENTDOC", "comment documentation", "Doc comment: block comments beginning with /** or /*!", 4, "SCE_C_NUMBER", "literal numeric", "Number", 5, "SCE_C_WORD", "keyword", "Keyword", 6, "SCE_C_STRING", "literal string", "Double quoted string", 7, "SCE_C_CHARACTER", "literal string character", "Single quoted string", 8, "SCE_C_UUID", "literal uuid", "UUIDs (only in IDL)", 9, "SCE_C_PREPROCESSOR", "preprocessor", "Preprocessor", 10, "SCE_C_OPERATOR", "operator", "Operators", 11, "SCE_C_IDENTIFIER", "identifier", "Identifiers", 12, "SCE_C_STRINGEOL", "error literal string", "End of line where string is not closed", 13, "SCE_C_VERBATIM", "literal string multiline raw", "Verbatim strings for C#", 14, "SCE_C_REGEX", "literal regex", "Regular expressions for JavaScript", 15, "SCE_C_COMMENTLINEDOC", "comment documentation line", "Doc Comment Line: line comments beginning with /// or //!.", 16, "SCE_C_WORD2", "identifier", "Keywords2", 17, "SCE_C_COMMENTDOCKEYWORD", "comment documentation keyword", "Comment keyword", 18, "SCE_C_COMMENTDOCKEYWORDERROR", "error comment documentation keyword", "Comment keyword error", 19, "SCE_C_GLOBALCLASS", "identifier", "Global class", 20, "SCE_C_STRINGRAW", "literal string multiline raw", "Raw strings for C++0x", 21, "SCE_C_TRIPLEVERBATIM", "literal string multiline raw", "Triple-quoted strings for Vala", 22, "SCE_C_HASHQUOTEDSTRING", "literal string", "Hash-quoted strings for Pike", 23, "SCE_C_PREPROCESSORCOMMENT", "comment preprocessor", "Preprocessor stream comment", 24, "SCE_C_PREPROCESSORCOMMENTDOC", "comment preprocessor documentation", "Preprocessor stream doc comment", 25, "SCE_C_USERLITERAL", "literal", "User defined literals", 26, "SCE_C_TASKMARKER", "comment taskmarker", "Task Marker", 27, "SCE_C_ESCAPESEQUENCE", "literal string escapesequence", "Escape sequence", }; const int sizeLexicalClasses = static_cast(std::size(lexicalClasses)); } class LexerCPP : public ILexer5 { bool caseSensitive; CharacterSet setWord; CharacterSet setNegationOp; CharacterSet setAddOp; CharacterSet setMultOp; CharacterSet setRelOp; CharacterSet setLogicalOp; CharacterSet setWordStart; PPStates vlls; std::vector ppDefineHistory; std::map> interpolatingAtEol; WordList keywords; WordList keywords2; WordList keywords3; WordList keywords4; WordList ppDefinitions; WordList markerList; struct SymbolValue { std::string value; std::string arguments; SymbolValue() noexcept = default; SymbolValue(std::string_view value_, std::string_view arguments_) : value(value_), arguments(arguments_) { } SymbolValue &operator = (const std::string &value_) { value = value_; arguments.clear(); return *this; } [[nodiscard]] bool IsMacro() const noexcept { return !arguments.empty(); } }; using SymbolTable = std::map; SymbolTable preprocessorDefinitionsStart; OptionsCPP options; OptionSetCPP osCPP; EscapeSequence escapeSeq; SparseState rawStringTerminators; enum { ssIdentifier, ssDocKeyword }; SubStyles subStyles{ styleSubable, SubStylesFirst, SubStylesAvailable, inactiveFlag }; std::string returnBuffer; public: explicit LexerCPP(bool caseSensitive_) : caseSensitive(caseSensitive_), setWord(CharacterSet::setAlphaNum, "._", true), setNegationOp("!"), setAddOp("+-"), setMultOp("*/%"), setRelOp("=!<>"), setLogicalOp("|&") { } // Deleted so LexerCPP objects can not be copied. LexerCPP(const LexerCPP &) = delete; LexerCPP(LexerCPP &&) = delete; void operator=(const LexerCPP &) = delete; void operator=(LexerCPP &&) = delete; virtual ~LexerCPP() = default; void SCI_METHOD Release() noexcept override { delete this; } int SCI_METHOD Version() const noexcept override { return lvRelease5; } const char *SCI_METHOD PropertyNames() override { return osCPP.PropertyNames(); } int SCI_METHOD PropertyType(const char *name) override { return osCPP.PropertyType(name); } const char *SCI_METHOD DescribeProperty(const char *name) override { return osCPP.DescribeProperty(name); } Sci_Position SCI_METHOD PropertySet(const char *key, const char *val) override; const char *SCI_METHOD DescribeWordListSets() override { return osCPP.DescribeWordListSets(); } Sci_Position SCI_METHOD WordListSet(int n, const char *wl) override; void SCI_METHOD Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void SCI_METHOD Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void *SCI_METHOD PrivateCall(int, void *) noexcept override { return nullptr; } int SCI_METHOD LineEndTypesSupported() noexcept override { return SC_LINE_END_TYPE_UNICODE; } int SCI_METHOD AllocateSubStyles(int styleBase, int numberStyles) override { return subStyles.Allocate(styleBase, numberStyles); } int SCI_METHOD SubStylesStart(int styleBase) override { return subStyles.Start(styleBase); } int SCI_METHOD SubStylesLength(int styleBase) override { return subStyles.Length(styleBase); } int SCI_METHOD StyleFromSubStyle(int subStyle) override { const int styleBase = subStyles.BaseStyle(MaskActive(subStyle)); const int inactive = subStyle & inactiveFlag; return styleBase | inactive; } int SCI_METHOD PrimaryStyleFromStyle(int style) noexcept override { return MaskActive(style); } void SCI_METHOD FreeSubStyles() override { subStyles.Free(); } void SCI_METHOD SetIdentifiers(int style, const char *identifiers) override { subStyles.SetIdentifiers(style, identifiers); } int SCI_METHOD DistanceToSecondaryStyles() noexcept override { return inactiveFlag; } const char *SCI_METHOD GetSubStyleBases() noexcept override { return styleSubable; } int SCI_METHOD NamedStyles() override { return std::max(subStyles.LastAllocated() + 1, sizeLexicalClasses) + inactiveFlag; } const char *SCI_METHOD NameOfStyle(int style) override { if (style >= NamedStyles()) return ""; if (style < sizeLexicalClasses) return lexicalClasses[style].name; // TODO: inactive and substyles return ""; } const char *SCI_METHOD TagsOfStyle(int style) override { if (style >= NamedStyles()) return "Excess"; returnBuffer.clear(); const int firstSubStyle = subStyles.FirstAllocated(); if (firstSubStyle >= 0) { const int lastSubStyle = subStyles.LastAllocated(); if (((style >= firstSubStyle) && (style <= (lastSubStyle))) || ((style >= firstSubStyle + inactiveFlag) && (style <= (lastSubStyle + inactiveFlag)))) { int styleActive = style; if (style > lastSubStyle) { returnBuffer = "inactive "; styleActive -= inactiveFlag; } const int styleMain = StyleFromSubStyle(styleActive); returnBuffer += lexicalClasses[styleMain].tags; return returnBuffer.c_str(); } } if (style < sizeLexicalClasses) return lexicalClasses[style].tags; if (style >= inactiveFlag) { returnBuffer = "inactive "; const int styleActive = style - inactiveFlag; if (styleActive < sizeLexicalClasses) returnBuffer += lexicalClasses[styleActive].tags; else returnBuffer.clear(); return returnBuffer.c_str(); } return ""; } const char *SCI_METHOD DescriptionOfStyle(int style) override { if (style >= NamedStyles()) return ""; if (style < sizeLexicalClasses) return lexicalClasses[style].description; // TODO: inactive and substyles return ""; } // ILexer5 methods const char *SCI_METHOD GetName() override { return caseSensitive ? "cpp" : "cppnocase"; } int SCI_METHOD GetIdentifier() override { return caseSensitive ? SCLEX_CPP : SCLEX_CPPNOCASE; } const char *SCI_METHOD PropertyGet(const char *key) override; static ILexer5 *LexerFactoryCPP() { return new LexerCPP(true); } static ILexer5 *LexerFactoryCPPInsensitive() { return new LexerCPP(false); } constexpr static int MaskActive(int style) noexcept { return style & ~inactiveFlag; } void EvaluateTokens(Tokens &tokens, const SymbolTable &preprocessorDefinitions); [[nodiscard]] Tokens Tokenize(const std::string &expr) const; bool EvaluateExpression(const std::string &expr, const SymbolTable &preprocessorDefinitions); }; Sci_Position SCI_METHOD LexerCPP::PropertySet(const char *key, const char *val) { if (osCPP.PropertySet(&options, key, val)) { if (strcmp(key, "lexer.cpp.allow.dollars") == 0) { setWord = CharacterSet(CharacterSet::setAlphaNum, "._", true); if (options.identifiersAllowDollars) { setWord.Add('$'); } } return 0; } return -1; } const char *SCI_METHOD LexerCPP::PropertyGet(const char *key) { return osCPP.PropertyGet(key); } Sci_Position SCI_METHOD LexerCPP::WordListSet(int n, const char *wl) { WordList *wordListN = nullptr; switch (n) { case 0: wordListN = &keywords; break; case 1: wordListN = &keywords2; break; case 2: wordListN = &keywords3; break; case 3: wordListN = &keywords4; break; case 4: wordListN = &ppDefinitions; break; case 5: wordListN = &markerList; break; default: break; } Sci_Position firstModification = -1; if (wordListN) { if (wordListN->Set(wl)) { firstModification = 0; if (n == 4) { // Rebuild preprocessorDefinitions preprocessorDefinitionsStart.clear(); for (int nDefinition = 0; nDefinition < ppDefinitions.Length(); nDefinition++) { const Definition def = ParseDefine(ppDefinitions.WordAt(nDefinition), "(="); preprocessorDefinitionsStart[std::string(def.name)] = SymbolValue(def.value, def.arguments); } } } } return firstModification; } void SCI_METHOD LexerCPP::Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { LexAccessor styler(pAccess); const StyleContext::Transform transform = caseSensitive ? StyleContext::Transform::none : StyleContext::Transform::lower; const CharacterSet setOKBeforeRE("([{=,:;!%^&*|?~+-> "); const CharacterSet setCouldBePostOp("+-"); const CharacterSet setDoxygen(CharacterSet::setAlpha, "$@\\&<>#{}[]"); setWordStart = CharacterSet(CharacterSet::setAlpha, "_", true); const CharacterSet setInvalidRawFirst(" )\\\t\v\f\n"); if (options.identifiersAllowDollars) { setWordStart.Add('$'); } int chPrevNonWhite = ' '; int visibleChars = 0; bool lastWordWasUUID = false; int styleBeforeDCKeyword = SCE_C_DEFAULT; int styleBeforeTaskMarker = SCE_C_DEFAULT; bool continuationLine = false; bool isIncludePreprocessor = false; bool isStringInPreprocessor = false; bool inRERange = false; bool seenDocKeyBrace = false; std::vector interpolatingStack; Sci_Position lineCurrent = styler.GetLine(startPos); if (options.backQuotedStrings == BackQuotedString::TemplateLiteral) { // code copied from LexPython auto it = interpolatingAtEol.find(lineCurrent - 1); if (it != interpolatingAtEol.end()) { interpolatingStack = it->second; } it = interpolatingAtEol.lower_bound(lineCurrent); if (it != interpolatingAtEol.end()) { interpolatingAtEol.erase(it, interpolatingAtEol.end()); } } if ((MaskActive(initStyle) == SCE_C_PREPROCESSOR) || (MaskActive(initStyle) == SCE_C_COMMENTLINE) || (MaskActive(initStyle) == SCE_C_COMMENTLINEDOC)) { // Set continuationLine if last character of previous line is '\' if (lineCurrent > 0) { const Sci_Position endLinePrevious = styler.LineEnd(lineCurrent - 1); if (endLinePrevious > 0) { continuationLine = styler.SafeGetCharAt(endLinePrevious-1) == '\\'; } } } // look back to set chPrevNonWhite properly for better regex colouring if (startPos > 0) { Sci_Position back = startPos; while (--back && IsSpaceEquiv(MaskActive(styler.StyleAt(back)))) ; if (MaskActive(styler.StyleAt(back)) == SCE_C_OPERATOR) { chPrevNonWhite = styler.SafeGetCharAt(back); } } StyleContext sc(startPos, length, initStyle, styler); LinePPState preproc = vlls.ForLine(lineCurrent); bool definitionsChanged = false; // Truncate ppDefineHistory before current line if (!options.updatePreprocessor) ppDefineHistory.clear(); const std::vector::iterator itInvalid = std::find_if( ppDefineHistory.begin(), ppDefineHistory.end(), [lineCurrent](const PPDefinition &p) noexcept { return p.line >= lineCurrent; }); if (itInvalid != ppDefineHistory.end()) { ppDefineHistory.erase(itInvalid, ppDefineHistory.end()); definitionsChanged = true; } SymbolTable preprocessorDefinitions = preprocessorDefinitionsStart; for (const PPDefinition &ppDef : ppDefineHistory) { if (ppDef.isUndef) preprocessorDefinitions.erase(ppDef.key); else preprocessorDefinitions[ppDef.key] = SymbolValue(ppDef.value, ppDef.arguments); } std::string rawStringTerminator = rawStringTerminators.ValueAt(lineCurrent-1); SparseState rawSTNew(lineCurrent); std::string currentText; int activitySet = preproc.ActiveState(); const WordClassifier &classifierIdentifiers = subStyles.Classifier(SCE_C_IDENTIFIER); const WordClassifier &classifierDocKeyWords = subStyles.Classifier(SCE_C_COMMENTDOCKEYWORD); Sci_PositionU lineEndNext = styler.LineEnd(lineCurrent); if (sc.currentPos == 0 && sc.Match('#', '!')) { // Shell Shebang at beginning of file sc.SetState(SCE_C_COMMENTLINE); sc.Forward(); } for (; sc.More();) { if (sc.atLineStart) { // Using MaskActive() is not needed in the following statement. // Inside inactive preprocessor declaration, state will be reset anyway at the end of this block. if ((sc.state == SCE_C_STRING) || (sc.state == SCE_C_CHARACTER)) { // Prevent SCE_C_STRINGEOL from leaking back to previous line which // ends with a line continuation by locking in the state up to this position. sc.SetState(sc.state); } if ((MaskActive(sc.state) == SCE_C_PREPROCESSOR) && (!continuationLine)) { sc.SetState(SCE_C_DEFAULT|activitySet); } // Reset states to beginning of colourise so no surprises // if different sets of lines lexed. visibleChars = 0; lastWordWasUUID = false; isIncludePreprocessor = false; inRERange = false; if (preproc.IsInactive()) { activitySet = inactiveFlag; sc.SetState(sc.state | activitySet); } } if (sc.atLineEnd) { lineCurrent++; lineEndNext = styler.LineEnd(lineCurrent); vlls.Add(lineCurrent, preproc); if (!rawStringTerminator.empty()) { rawSTNew.Set(lineCurrent-1, rawStringTerminator); } if (!interpolatingStack.empty()) { interpolatingAtEol[sc.currentLine] = interpolatingStack; } } // Handle line continuation generically. if (sc.ch == '\\') { if ((sc.currentPos+1) >= lineEndNext) { lineCurrent++; lineEndNext = styler.LineEnd(lineCurrent); vlls.Add(lineCurrent, preproc); if (!rawStringTerminator.empty()) { rawSTNew.Set(lineCurrent-1, rawStringTerminator); } sc.Forward(); if (sc.ch == '\r' && sc.chNext == '\n') { // Even in UTF-8, \r and \n are separate sc.Forward(); } continuationLine = true; sc.Forward(); continue; } } const bool atLineEndBeforeSwitch = sc.atLineEnd; // Determine if the current state should terminate. switch (MaskActive(sc.state)) { case SCE_C_OPERATOR: sc.SetState(SCE_C_DEFAULT|activitySet); break; case SCE_C_NUMBER: // We accept almost anything because of hex. and number suffixes if (sc.ch == '_') { sc.ChangeState(SCE_C_USERLITERAL|activitySet); } else if (!(setWord.Contains(sc.ch) || (sc.ch == '\'') || (AnyOf(sc.chPrev, 'e', 'E', 'p', 'P') && AnyOf(sc.ch, '+', '-')))) { sc.SetState(SCE_C_DEFAULT|activitySet); } break; case SCE_C_USERLITERAL: if (!(setWord.Contains(sc.ch))) sc.SetState(SCE_C_DEFAULT|activitySet); break; case SCE_C_IDENTIFIER: if (sc.atLineStart || sc.atLineEnd || !setWord.Contains(sc.ch) || (sc.ch == '.')) { sc.GetCurrentString(currentText, transform); if (keywords.InList(currentText)) { lastWordWasUUID = currentText == "uuid"; sc.ChangeState(SCE_C_WORD|activitySet); } else if (keywords2.InList(currentText)) { sc.ChangeState(SCE_C_WORD2|activitySet); } else if (keywords4.InList(currentText)) { sc.ChangeState(SCE_C_GLOBALCLASS|activitySet); } else { const int subStyle = classifierIdentifiers.ValueFor(currentText); if (subStyle >= 0) { sc.ChangeState(subStyle|activitySet); } } const bool literalString = sc.ch == '\"'; if (literalString || sc.ch == '\'') { std::string_view s = currentText; size_t lenS = s.length(); const bool raw = literalString && sc.chPrev == 'R' && !setInvalidRawFirst.Contains(sc.chNext); if (raw) { s.remove_suffix(1); lenS--; } const bool valid = (lenS == 0) || ((lenS == 1) && ((s[0] == 'L') || (s[0] == 'u') || (s[0] == 'U'))) || ((lenS == 2) && literalString && (s[0] == 'u') && (s[1] == '8')); if (valid) { if (literalString) { if (raw) { // Set the style of the string prefix to SCE_C_STRINGRAW but then change to // SCE_C_DEFAULT as that allows the raw string start code to run. sc.ChangeState(SCE_C_STRINGRAW|activitySet); sc.SetState(SCE_C_DEFAULT|activitySet); } else { sc.ChangeState(SCE_C_STRING|activitySet); } } else { sc.ChangeState(SCE_C_CHARACTER|activitySet); } } else { sc.SetState(SCE_C_DEFAULT | activitySet); } } else { sc.SetState(SCE_C_DEFAULT|activitySet); } } break; case SCE_C_PREPROCESSOR: if (options.stylingWithinPreprocessor) { if (IsASpace(sc.ch) || (sc.ch == '(')) { sc.SetState(SCE_C_DEFAULT|activitySet); } } else if (isStringInPreprocessor && (sc.Match('>') || sc.Match('\"') || sc.atLineEnd)) { isStringInPreprocessor = false; } else if (!isStringInPreprocessor) { if ((isIncludePreprocessor && sc.Match('<')) || sc.Match('\"')) { isStringInPreprocessor = true; } else if (sc.Match('/', '*')) { if (sc.Match("/**") || sc.Match("/*!")) { sc.SetState(SCE_C_PREPROCESSORCOMMENTDOC|activitySet); } else { sc.SetState(SCE_C_PREPROCESSORCOMMENT|activitySet); } sc.Forward(); // Eat the * } else if (sc.Match('/', '/')) { sc.SetState(SCE_C_DEFAULT|activitySet); } } break; case SCE_C_PREPROCESSORCOMMENT: case SCE_C_PREPROCESSORCOMMENTDOC: if (sc.Match('*', '/')) { sc.Forward(); sc.ForwardSetState(SCE_C_PREPROCESSOR|activitySet); continue; // Without advancing in case of '\'. } break; case SCE_C_COMMENT: if (sc.Match('*', '/')) { sc.Forward(); sc.ForwardSetState(SCE_C_DEFAULT|activitySet); } else { styleBeforeTaskMarker = SCE_C_COMMENT; highlightTaskMarker(sc, styler, activitySet, markerList, caseSensitive); } break; case SCE_C_COMMENTDOC: if (sc.Match('*', '/')) { sc.Forward(); sc.ForwardSetState(SCE_C_DEFAULT|activitySet); } else if (sc.ch == '@' || sc.ch == '\\') { // JavaDoc and Doxygen support // Verify that we have the conditions to mark a comment-doc-keyword if ((IsASpace(sc.chPrev) || sc.chPrev == '*') && (!IsASpace(sc.chNext))) { styleBeforeDCKeyword = SCE_C_COMMENTDOC; sc.SetState(SCE_C_COMMENTDOCKEYWORD|activitySet); } } else if ((sc.ch == '<' && sc.chNext != '/') || (sc.ch == '/' && sc.chPrev == '<')) { // XML comment style styleBeforeDCKeyword = SCE_C_COMMENTDOC; sc.ForwardSetState(SCE_C_COMMENTDOCKEYWORD | activitySet); } break; case SCE_C_COMMENTLINE: if (sc.atLineStart && !continuationLine) { sc.SetState(SCE_C_DEFAULT|activitySet); } else { styleBeforeTaskMarker = SCE_C_COMMENTLINE; highlightTaskMarker(sc, styler, activitySet, markerList, caseSensitive); } break; case SCE_C_COMMENTLINEDOC: if (sc.atLineStart && !continuationLine) { sc.SetState(SCE_C_DEFAULT|activitySet); } else if (sc.ch == '@' || sc.ch == '\\') { // JavaDoc and Doxygen support // Verify that we have the conditions to mark a comment-doc-keyword if ((IsASpace(sc.chPrev) || sc.chPrev == '/' || sc.chPrev == '!') && (!IsASpace(sc.chNext))) { styleBeforeDCKeyword = SCE_C_COMMENTLINEDOC; sc.SetState(SCE_C_COMMENTDOCKEYWORD|activitySet); } } else if ((sc.ch == '<' && sc.chNext != '/') || (sc.ch == '/' && sc.chPrev == '<')) { // XML comment style styleBeforeDCKeyword = SCE_C_COMMENTLINEDOC; sc.ForwardSetState(SCE_C_COMMENTDOCKEYWORD | activitySet); } break; case SCE_C_COMMENTDOCKEYWORD: if ((styleBeforeDCKeyword == SCE_C_COMMENTDOC) && sc.Match('*', '/')) { sc.ChangeState(SCE_C_COMMENTDOCKEYWORDERROR); sc.Forward(); sc.ForwardSetState(SCE_C_DEFAULT|activitySet); seenDocKeyBrace = false; } else if (sc.ch == '[' || sc.ch == '{') { seenDocKeyBrace = true; } else if (!setDoxygen.Contains(sc.ch) && !(seenDocKeyBrace && AnyOf(sc.ch, ',', '.'))) { if (!(IsASpace(sc.ch) || (sc.ch == 0))) { sc.ChangeState(SCE_C_COMMENTDOCKEYWORDERROR|activitySet); } else { sc.GetCurrentString(currentText, transform); assert(!currentText.empty()); const std::string currentSuffix = currentText.substr(1); if (!keywords3.InList(currentSuffix) && !keywords3.InList(currentText)) { const int subStyleCDKW = classifierDocKeyWords.ValueFor(currentSuffix); if (subStyleCDKW >= 0) { sc.ChangeState(subStyleCDKW | activitySet); } else { sc.ChangeState(SCE_C_COMMENTDOCKEYWORDERROR | activitySet); } } } sc.SetState(styleBeforeDCKeyword|activitySet); seenDocKeyBrace = false; } else if (sc.ch == '>') { sc.GetCurrentString(currentText, transform); if (!keywords3.InList(currentText)) { const int subStyleCDKW = classifierDocKeyWords.ValueFor(currentText.substr(1)); if (subStyleCDKW >= 0) { sc.ChangeState(subStyleCDKW | activitySet); } else { sc.ChangeState(SCE_C_COMMENTDOCKEYWORDERROR | activitySet); } } sc.SetState(styleBeforeDCKeyword | activitySet); seenDocKeyBrace = false; } break; case SCE_C_STRING: if (sc.atLineEnd) { sc.ChangeState(SCE_C_STRINGEOL|activitySet); } else if (isIncludePreprocessor) { if (sc.ch == '>') { sc.ForwardSetState(SCE_C_DEFAULT|activitySet); isIncludePreprocessor = false; } } else if (sc.ch == '\\') { if (options.escapeSequence) { escapeSeq.resetEscapeState(sc.state, sc.chNext); sc.SetState(SCE_C_ESCAPESEQUENCE|activitySet); } sc.Forward(); // Skip all characters after the backslash } else if (sc.ch == '\"') { if (sc.chNext == '_') { sc.ChangeState(SCE_C_USERLITERAL|activitySet); } else { sc.ForwardSetState(SCE_C_DEFAULT|activitySet); } } break; case SCE_C_ESCAPESEQUENCE: escapeSeq.consumeDigit(); if (escapeSeq.atEscapeEnd(sc.ch)) { sc.SetState(escapeSeq.outerState); continue; } break; case SCE_C_HASHQUOTEDSTRING: if (sc.ch == '\\') { if (sc.chNext == '\"' || sc.chNext == '\'' || sc.chNext == '\\') { sc.Forward(); } } else if (sc.ch == '\"') { sc.ForwardSetState(SCE_C_DEFAULT|activitySet); } break; case SCE_C_STRINGRAW: if (sc.Match(rawStringTerminator.c_str())) { for (size_t termPos=rawStringTerminator.size(); termPos; termPos--) sc.Forward(); sc.SetState(SCE_C_DEFAULT|activitySet); if (interpolatingStack.empty()) { rawStringTerminator.clear(); } } else if (options.backQuotedStrings == BackQuotedString::TemplateLiteral) { if (sc.ch == '\\') { if (options.escapeSequence) { escapeSeq.resetEscapeState(sc.state, sc.chNext); sc.SetState(SCE_C_ESCAPESEQUENCE|activitySet); } sc.Forward(); // Skip all characters after the backslash } else if (sc.Match('$', '{')) { interpolatingStack.push_back({sc.state, 1}); sc.SetState(SCE_C_OPERATOR|activitySet); sc.Forward(); } } break; case SCE_C_CHARACTER: if (sc.atLineEnd) { sc.ChangeState(SCE_C_STRINGEOL|activitySet); } else if (sc.ch == '\\') { if (sc.chNext == '\"' || sc.chNext == '\'' || sc.chNext == '\\') { sc.Forward(); } } else if (sc.ch == '\'') { if (sc.chNext == '_') { sc.ChangeState(SCE_C_USERLITERAL|activitySet); } else { sc.ForwardSetState(SCE_C_DEFAULT|activitySet); } } break; case SCE_C_REGEX: if (sc.atLineStart) { sc.SetState(SCE_C_DEFAULT|activitySet); } else if (!inRERange && sc.ch == '/') { sc.Forward(); while (IsLowerCase(sc.ch)) sc.Forward(); // gobble regex flags sc.SetState(SCE_C_DEFAULT|activitySet); } else if (sc.ch == '\\' && ((sc.currentPos+1) < lineEndNext)) { // Gobble up the escaped character sc.Forward(); } else if (sc.ch == '[') { inRERange = true; } else if (sc.ch == ']') { inRERange = false; } break; case SCE_C_STRINGEOL: if (sc.atLineStart) { sc.SetState(SCE_C_DEFAULT|activitySet); } break; case SCE_C_VERBATIM: if (options.verbatimStringsAllowEscapes && (sc.ch == '\\')) { sc.Forward(); // Skip all characters after the backslash } else if (sc.ch == '\"') { if (sc.chNext == '\"') { sc.Forward(); } else { sc.ForwardSetState(SCE_C_DEFAULT|activitySet); } } break; case SCE_C_TRIPLEVERBATIM: if (sc.Match(R"(""")")) { while (sc.Match('"')) { sc.Forward(); } sc.SetState(SCE_C_DEFAULT|activitySet); } break; case SCE_C_UUID: if (sc.atLineEnd || sc.ch == ')') { sc.SetState(SCE_C_DEFAULT|activitySet); } break; case SCE_C_TASKMARKER: if (IsOperatorOrSpace(sc.ch)) { sc.SetState(styleBeforeTaskMarker|activitySet); styleBeforeTaskMarker = SCE_C_DEFAULT; } } if (sc.atLineEnd && !atLineEndBeforeSwitch) { // State exit processing consumed characters up to end of line. lineCurrent++; lineEndNext = styler.LineEnd(lineCurrent); vlls.Add(lineCurrent, preproc); } const bool atLineEndBeforeStateEntry = sc.atLineEnd; // Determine if a new state should be entered. if (MaskActive(sc.state) == SCE_C_DEFAULT) { if (sc.Match('@', '\"')) { sc.SetState(SCE_C_VERBATIM|activitySet); sc.Forward(); } else if (options.triplequotedStrings && sc.Match(R"(""")")) { sc.SetState(SCE_C_TRIPLEVERBATIM|activitySet); sc.Forward(2); } else if (options.hashquotedStrings && sc.Match('#', '\"')) { sc.SetState(SCE_C_HASHQUOTEDSTRING|activitySet); sc.Forward(); } else if ((options.backQuotedStrings != BackQuotedString::None) && sc.Match('`')) { sc.SetState(SCE_C_STRINGRAW|activitySet); rawStringTerminator = "`"; } else if (IsADigit(sc.ch) || (sc.ch == '.' && IsADigit(sc.chNext))) { if (lastWordWasUUID) { sc.SetState(SCE_C_UUID|activitySet); lastWordWasUUID = false; } else { sc.SetState(SCE_C_NUMBER|activitySet); } } else if (!sc.atLineEnd && (setWordStart.Contains(sc.ch) || (sc.ch == '@'))) { if (lastWordWasUUID) { sc.SetState(SCE_C_UUID|activitySet); lastWordWasUUID = false; } else { sc.SetState(SCE_C_IDENTIFIER|activitySet); } } else if (sc.Match('/', '*')) { if (sc.Match("/**") || sc.Match("/*!")) { // Support of Qt/Doxygen doc. style sc.SetState(SCE_C_COMMENTDOC|activitySet); } else { sc.SetState(SCE_C_COMMENT|activitySet); } sc.Forward(); // Eat the * so it isn't used for the end of the comment } else if (sc.Match('/', '/')) { if ((sc.Match("///") && !sc.Match("////")) || sc.Match("//!")) // Support of Qt/Doxygen doc. style sc.SetState(SCE_C_COMMENTLINEDOC|activitySet); else sc.SetState(SCE_C_COMMENTLINE|activitySet); } else if (sc.ch == '/' && (setOKBeforeRE.Contains(chPrevNonWhite) || followsReturnKeyword(sc, styler)) && (!setCouldBePostOp.Contains(chPrevNonWhite) || !FollowsPostfixOperator(sc, styler))) { sc.SetState(SCE_C_REGEX|activitySet); // JavaScript's RegEx inRERange = false; } else if (sc.ch == '\"') { if (sc.chPrev == 'R') { styler.Flush(); if (MaskActive(styler.StyleAt(sc.currentPos - 1)) == SCE_C_STRINGRAW) { sc.SetState(SCE_C_STRINGRAW|activitySet); rawStringTerminator = ")"; for (Sci_Position termPos = sc.currentPos + 1;; termPos++) { const char chTerminator = styler.SafeGetCharAt(termPos, '('); if (chTerminator == '(') break; rawStringTerminator += chTerminator; } rawStringTerminator += '\"'; } else { sc.SetState(SCE_C_STRING|activitySet); } } else { sc.SetState(SCE_C_STRING|activitySet); } isIncludePreprocessor = false; // ensure that '>' won't end the string } else if (isIncludePreprocessor && sc.ch == '<') { sc.SetState(SCE_C_STRING|activitySet); } else if (sc.ch == '\'') { sc.SetState(SCE_C_CHARACTER|activitySet); } else if (sc.ch == '#' && visibleChars == 0) { // Preprocessor commands are alone on their line sc.SetState(SCE_C_PREPROCESSOR|activitySet); // Skip whitespace between # and preprocessor word do { sc.Forward(); } while ((sc.ch == ' ' || sc.ch == '\t') && sc.More()); if (sc.Match("include")) { isIncludePreprocessor = true; } else { if (options.trackPreprocessor && IsAlphaNumeric(sc.ch)) { // If #if is nested too deeply (>31 levels) the active/inactive appearance // will stop reflecting the code. if (sc.Match("ifdef") || sc.Match("ifndef")) { const bool isIfDef = sc.Match("ifdef"); const int startRest = isIfDef ? 5 : 6; const std::string restOfLine = GetRestOfLine(styler, sc.currentPos + startRest + 1, false); const bool foundDef = preprocessorDefinitions.find(restOfLine) != preprocessorDefinitions.end(); preproc.StartSection(isIfDef == foundDef); } else if (sc.Match("if")) { const std::string restOfLine = GetRestOfLine(styler, sc.currentPos + 2, true); const bool ifGood = EvaluateExpression(restOfLine, preprocessorDefinitions); preproc.StartSection(ifGood); } else if (sc.Match("else")) { // #else is shown as active if either preceding or following section is active // as that means that it contributed to the result. if (preproc.ValidLevel()) { // If #else has no corresponding #if then take no action as invalid if (!preproc.CurrentIfTaken()) { // Inactive, may become active if parent scope active assert(sc.state == (SCE_C_PREPROCESSOR | inactiveFlag)); preproc.InvertCurrentLevel(); activitySet = preproc.ActiveState(); // If following is active then show "else" as active if (!activitySet) sc.ChangeState(SCE_C_PREPROCESSOR); } else if (preproc.IsActive()) { // Active -> inactive assert(sc.state == SCE_C_PREPROCESSOR); preproc.InvertCurrentLevel(); activitySet = preproc.ActiveState(); // Continue to show "else" as active as it ends active section. } } } else if (sc.Match("elif")) { // Ensure only one chosen out of #if .. #elif .. #elif .. #else .. #endif // #elif is shown as active if either preceding or following section is active // as that means that it contributed to the result. if (preproc.ValidLevel()) { if (!preproc.CurrentIfTaken()) { // Inactive, if expression true then may become active if parent scope active assert(sc.state == (SCE_C_PREPROCESSOR | inactiveFlag)); // Similar to #if const std::string restOfLine = GetRestOfLine(styler, sc.currentPos + 4, true); const bool ifGood = EvaluateExpression(restOfLine, preprocessorDefinitions); if (ifGood) { preproc.InvertCurrentLevel(); activitySet = preproc.ActiveState(); if (!activitySet) sc.ChangeState(SCE_C_PREPROCESSOR); } } else if (preproc.IsActive()) { // Active -> inactive assert(sc.state == SCE_C_PREPROCESSOR); preproc.InvertCurrentLevel(); activitySet = preproc.ActiveState(); // Continue to show "elif" as active as it ends active section. } } } else if (sc.Match("endif")) { preproc.EndSection(); activitySet = preproc.ActiveState(); sc.ChangeState(SCE_C_PREPROCESSOR|activitySet); } else if (sc.Match("define")) { if (options.updatePreprocessor && preproc.IsActive()) { const std::string restOfLine = GetRestOfLine(styler, sc.currentPos + 6, true); const Definition def = ParseDefine(restOfLine, "( \t"); preprocessorDefinitions[std::string(def.name)] = SymbolValue(def.value, def.arguments); ppDefineHistory.emplace_back(lineCurrent, def.name, def.value, false, def.arguments); definitionsChanged = true; } } else if (sc.Match("undef")) { if (options.updatePreprocessor && preproc.IsActive()) { const std::string restOfLine = GetRestOfLine(styler, sc.currentPos + 5, false); Tokens tokens = Tokenize(restOfLine); if (!tokens.empty()) { const std::string key = tokens[0]; preprocessorDefinitions.erase(key); ppDefineHistory.emplace_back(lineCurrent, key, "", true, ""); definitionsChanged = true; } } } } } } else if (isoperator(sc.ch)) { sc.SetState(SCE_C_OPERATOR|activitySet); if (!interpolatingStack.empty() && AnyOf(sc.ch, '{', '}')) { InterpolatingState ¤t = interpolatingStack.back(); if (sc.ch == '{') { current.braceCount += 1; } else { current.braceCount -= 1; if (current.braceCount == 0) { sc.ForwardSetState(current.state); interpolatingStack.pop_back(); continue; } } } } } if (sc.atLineEnd && !atLineEndBeforeStateEntry) { // State entry processing consumed characters up to end of line. lineCurrent++; lineEndNext = styler.LineEnd(lineCurrent); vlls.Add(lineCurrent, preproc); } if (!IsASpace(sc.ch) && !IsSpaceEquiv(MaskActive(sc.state))) { chPrevNonWhite = sc.ch; visibleChars++; } continuationLine = false; sc.Forward(); } const bool rawStringsChanged = rawStringTerminators.Merge(rawSTNew, lineCurrent); if (definitionsChanged || rawStringsChanged) styler.ChangeLexerState(startPos, startPos + length); sc.Complete(); } // Store both the current line's fold level and the next lines in the // level store to make it easy to pick up with each increment // and to make it possible to fiddle the current level for "} else {". void SCI_METHOD LexerCPP::Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { if (!options.fold) return; LexAccessor styler(pAccess); const Sci_PositionU endPos = startPos + length; int visibleChars = 0; bool inLineComment = false; Sci_Position lineCurrent = styler.GetLine(startPos); int levelCurrent = SC_FOLDLEVELBASE; if (lineCurrent > 0) levelCurrent = styler.LevelAt(lineCurrent-1) >> 16; Sci_PositionU lineStartNext = styler.LineStart(lineCurrent+1); int levelMinCurrent = levelCurrent; int levelNext = levelCurrent; char chNext = styler[startPos]; int styleNext = MaskActive(styler.StyleAt(startPos)); int style = MaskActive(initStyle); const bool userDefinedFoldMarkers = !options.foldExplicitStart.empty() && !options.foldExplicitEnd.empty(); for (Sci_PositionU i = startPos; i < endPos; i++) { const char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); const int stylePrev = style; style = styleNext; styleNext = MaskActive(styler.StyleAt(i + 1)); const bool atEOL = i == (lineStartNext-1); if ((style == SCE_C_COMMENTLINE) || (style == SCE_C_COMMENTLINEDOC)) inLineComment = true; if (options.foldComment && options.foldCommentMultiline && IsStreamCommentStyle(style) && !inLineComment) { if (!IsStreamCommentStyle(stylePrev)) { levelNext++; } else if (!IsStreamCommentStyle(styleNext) && !atEOL) { // Comments don't end at end of line and the next character may be unstyled. levelNext--; } } if (options.foldComment && options.foldCommentExplicit && ((style == SCE_C_COMMENTLINE) || options.foldExplicitAnywhere)) { if (userDefinedFoldMarkers) { if (styler.Match(i, options.foldExplicitStart.c_str())) { levelNext++; } else if (styler.Match(i, options.foldExplicitEnd.c_str())) { levelNext--; } } else { if ((ch == '/') && (chNext == '/')) { const char chNext2 = styler.SafeGetCharAt(i + 2); if (chNext2 == '{') { levelNext++; } else if (chNext2 == '}') { levelNext--; } } } } if (options.foldPreprocessor && (style == SCE_C_PREPROCESSOR)) { if (ch == '#') { Sci_PositionU j = i + 1; while ((j < endPos) && IsASpaceOrTab(styler.SafeGetCharAt(j))) { j++; } if (styler.Match(j, "region") || styler.Match(j, "if")) { levelNext++; } else if (styler.Match(j, "end")) { levelNext--; } if (options.foldPreprocessorAtElse && (styler.Match(j, "else") || styler.Match(j, "elif"))) { levelMinCurrent--; } } } if (options.foldSyntaxBased && (style == SCE_C_OPERATOR)) { if (ch == '{' || ch == '[' || ch == '(') { // Measure the minimum before a '{' to allow // folding on "} else {" if (options.foldAtElse && levelMinCurrent > levelNext) { levelMinCurrent = levelNext; } levelNext++; } else if (ch == '}' || ch == ']' || ch == ')') { levelNext--; } } if (!IsASpace(ch)) visibleChars++; if (atEOL || (i == endPos-1)) { int levelUse = levelCurrent; if ((options.foldSyntaxBased && options.foldAtElse) || (options.foldPreprocessor && options.foldPreprocessorAtElse) ) { levelUse = levelMinCurrent; } int lev = levelUse | levelNext << 16; if (visibleChars == 0 && options.foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if (levelUse < levelNext) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; lineStartNext = styler.LineStart(lineCurrent+1); levelCurrent = levelNext; levelMinCurrent = levelCurrent; if (atEOL && (i == static_cast(styler.Length()-1))) { // There is an empty line at end of file so give it same level and empty styler.SetLevel(lineCurrent, (levelCurrent | levelCurrent << 16) | SC_FOLDLEVELWHITEFLAG); } visibleChars = 0; inLineComment = false; } } } void LexerCPP::EvaluateTokens(Tokens &tokens, const SymbolTable &preprocessorDefinitions) { // Remove whitespace tokens tokens.erase(std::remove_if(tokens.begin(), tokens.end(), OnlySpaceOrTab), tokens.end()); // Evaluate defined statements to either 0 or 1 for (size_t i=0; (i+1)) const SymbolTable::const_iterator it = preprocessorDefinitions.find(tokens[i+2]); if (it != preprocessorDefinitions.end()) { val = "1"; } tokens.erase(tokens.begin() + i + 1, tokens.begin() + i + 4); } else { // Spurious '(' so erase as more likely to result in false tokens.erase(tokens.begin() + i + 1, tokens.begin() + i + 2); } } else { // defined const SymbolTable::const_iterator it = preprocessorDefinitions.find(tokens[i+1]); if (it != preprocessorDefinitions.end()) { val = "1"; } tokens.erase(tokens.begin() + i + 1, tokens.begin() + i + 2); } tokens[i] = val; } else { i++; } } // Evaluate identifiers constexpr size_t maxIterations = 100; size_t iterations = 0; // Limit number of iterations in case there is a recursive macro. for (size_t i = 0; (isecond.value); if (it->second.IsMacro()) { if ((i + 1 < tokens.size()) && (tokens.at(i + 1) == "(")) { // Create map of argument name to value const Tokens argumentNames = StringSplit(it->second.arguments, ','); std::map arguments; size_t arg = 0; size_t tok = i+2; while ((tok < tokens.size()) && (arg < argumentNames.size()) && (tokens.at(tok) != ")")) { if (tokens.at(tok) != ",") { arguments[argumentNames.at(arg)] = tokens.at(tok); arg++; } tok++; } // Remove invocation tokens.erase(tokens.begin() + i, tokens.begin() + tok + 1); // Substitute values into macro macroTokens.erase(std::remove_if(macroTokens.begin(), macroTokens.end(), OnlySpaceOrTab), macroTokens.end()); for (size_t iMacro = 0; iMacro < macroTokens.size();) { if (setWordStart.Contains(macroTokens[iMacro][0])) { const std::map::const_iterator itFind = arguments.find(macroTokens[iMacro]); if (itFind != arguments.end()) { // TODO: Possible that value will be expression so should insert tokenized form macroTokens[iMacro] = itFind->second; } } iMacro++; } // Insert results back into tokens tokens.insert(tokens.begin() + i, macroTokens.begin(), macroTokens.end()); } else { i++; } } else { // Remove invocation tokens.erase(tokens.begin() + i); // Insert results back into tokens tokens.insert(tokens.begin() + i, macroTokens.begin(), macroTokens.end()); } } else { // Identifier not found and value defaults to zero tokens[i] = "0"; } } else { i++; } } // Find bracketed subexpressions and recurse on them BracketPair bracketPair = FindBracketPair(tokens); while (bracketPair.itBracket != tokens.end()) { Tokens inBracket(bracketPair.itBracket + 1, bracketPair.itEndBracket); EvaluateTokens(inBracket, preprocessorDefinitions); // The insertion is done before the removal because there were failures with the opposite approach tokens.insert(bracketPair.itBracket, inBracket.begin(), inBracket.end()); // insert invalidated bracketPair. Use a new variable to avoid warning from Coverity. const BracketPair pairToErase = FindBracketPair(tokens); tokens.erase(pairToErase.itBracket, pairToErase.itEndBracket + 1); bracketPair = FindBracketPair(tokens); } // Evaluate logical negations for (size_t j=0; (j+1)") result = valA > valB; else if (tokens[k+1] == ">=") result = valA >= valB; else if (tokens[k+1] == "==") result = valA == valB; else if (tokens[k+1] == "!=") result = valA != valB; else if (tokens[k+1] == "||") result = valA || valB; else if (tokens[k+1] == "&&") result = valA && valB; const Tokens::iterator itInsert = tokens.erase(tokens.begin() + k, tokens.begin() + k + 3); tokens.insert(itInsert, std::to_string(result)); } else { k++; } } } } Tokens LexerCPP::Tokenize(const std::string &expr) const { // Break into tokens Tokens tokens; const char *cp = expr.c_str(); while (*cp) { std::string word; if (setWord.Contains(*cp)) { // Identifiers and numbers while (setWord.Contains(*cp)) { word += *cp; cp++; } } else if (IsASpaceOrTab(*cp)) { while (IsASpaceOrTab(*cp)) { word += *cp; cp++; } } else if (setRelOp.Contains(*cp)) { word += *cp; cp++; if (setRelOp.Contains(*cp)) { word += *cp; cp++; } } else if (setLogicalOp.Contains(*cp)) { word += *cp; cp++; if (setLogicalOp.Contains(*cp)) { word += *cp; cp++; } } else { // Should handle strings, characters, and comments here word += *cp; cp++; } tokens.push_back(word); } return tokens; } bool LexerCPP::EvaluateExpression(const std::string &expr, const SymbolTable &preprocessorDefinitions) { Tokens tokens = Tokenize(expr); EvaluateTokens(tokens, preprocessorDefinitions); // "0" or "" -> false else true const bool isFalse = tokens.empty() || ((tokens.size() == 1) && (tokens[0].empty() || tokens[0] == "0")); return !isFalse; } LexerModule lmCPP(SCLEX_CPP, LexerCPP::LexerFactoryCPP, "cpp", cppWordLists); LexerModule lmCPPNoCase(SCLEX_CPPNOCASE, LexerCPP::LexerFactoryCPPInsensitive, "cppnocase", cppWordLists); lexilla/lexers/LexMSSQL.cxx0000664000175000017500000002670714647367374014611 0ustar neilneil// Scintilla source code edit control /** @file LexMSSQL.cxx ** Lexer for MSSQL. **/ // By Filip Yaghob // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; #define KW_MSSQL_STATEMENTS 0 #define KW_MSSQL_DATA_TYPES 1 #define KW_MSSQL_SYSTEM_TABLES 2 #define KW_MSSQL_GLOBAL_VARIABLES 3 #define KW_MSSQL_FUNCTIONS 4 #define KW_MSSQL_STORED_PROCEDURES 5 #define KW_MSSQL_OPERATORS 6 static char classifyWordSQL(Sci_PositionU start, Sci_PositionU end, WordList *keywordlists[], Accessor &styler, unsigned int actualState, unsigned int prevState) { char s[256]; bool wordIsNumber = isdigit(styler[start]) || (styler[start] == '.'); WordList &kwStatements = *keywordlists[KW_MSSQL_STATEMENTS]; WordList &kwDataTypes = *keywordlists[KW_MSSQL_DATA_TYPES]; WordList &kwSystemTables = *keywordlists[KW_MSSQL_SYSTEM_TABLES]; WordList &kwGlobalVariables = *keywordlists[KW_MSSQL_GLOBAL_VARIABLES]; WordList &kwFunctions = *keywordlists[KW_MSSQL_FUNCTIONS]; WordList &kwStoredProcedures = *keywordlists[KW_MSSQL_STORED_PROCEDURES]; WordList &kwOperators = *keywordlists[KW_MSSQL_OPERATORS]; for (Sci_PositionU i = 0; i < end - start + 1 && i < 128; i++) { s[i] = static_cast(tolower(styler[start + i])); s[i + 1] = '\0'; } char chAttr = SCE_MSSQL_IDENTIFIER; if (actualState == SCE_MSSQL_GLOBAL_VARIABLE) { if (kwGlobalVariables.InList(&s[2])) chAttr = SCE_MSSQL_GLOBAL_VARIABLE; } else if (wordIsNumber) { chAttr = SCE_MSSQL_NUMBER; } else if (prevState == SCE_MSSQL_DEFAULT_PREF_DATATYPE) { // Look first in datatypes if (kwDataTypes.InList(s)) chAttr = SCE_MSSQL_DATATYPE; else if (kwOperators.InList(s)) chAttr = SCE_MSSQL_OPERATOR; else if (kwStatements.InList(s)) chAttr = SCE_MSSQL_STATEMENT; else if (kwSystemTables.InList(s)) chAttr = SCE_MSSQL_SYSTABLE; else if (kwFunctions.InList(s)) chAttr = SCE_MSSQL_FUNCTION; else if (kwStoredProcedures.InList(s)) chAttr = SCE_MSSQL_STORED_PROCEDURE; } else { if (kwOperators.InList(s)) chAttr = SCE_MSSQL_OPERATOR; else if (kwStatements.InList(s)) chAttr = SCE_MSSQL_STATEMENT; else if (kwSystemTables.InList(s)) chAttr = SCE_MSSQL_SYSTABLE; else if (kwFunctions.InList(s)) chAttr = SCE_MSSQL_FUNCTION; else if (kwStoredProcedures.InList(s)) chAttr = SCE_MSSQL_STORED_PROCEDURE; else if (kwDataTypes.InList(s)) chAttr = SCE_MSSQL_DATATYPE; } styler.ColourTo(end, chAttr); return chAttr; } static void ColouriseMSSQLDoc(Sci_PositionU startPos, Sci_Position length, int initStyle, WordList *keywordlists[], Accessor &styler) { styler.StartAt(startPos); bool fold = styler.GetPropertyInt("fold") != 0; Sci_Position lineCurrent = styler.GetLine(startPos); int spaceFlags = 0; int state = initStyle; int prevState = initStyle; char chPrev = ' '; char chNext = styler[startPos]; int nesting = 0; if (lineCurrent >= 1) { nesting = styler.GetLineState(lineCurrent - 1); } styler.StartSegment(startPos); Sci_PositionU lengthDoc = startPos + length; for (Sci_PositionU i = startPos; i < lengthDoc; i++) { const Sci_Position lineStartNext = styler.LineStart(lineCurrent + 1); const bool atEOL = (static_cast(i) == (lineStartNext - 1)); char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); if ((ch == '\r' && chNext != '\n') || (ch == '\n')) { int indentCurrent = styler.IndentAmount(lineCurrent, &spaceFlags); int lev = indentCurrent; if (!(indentCurrent & SC_FOLDLEVELWHITEFLAG)) { // Only non whitespace lines can be headers int indentNext = styler.IndentAmount(lineCurrent + 1, &spaceFlags); if (indentCurrent < (indentNext & ~SC_FOLDLEVELWHITEFLAG)) { lev |= SC_FOLDLEVELHEADERFLAG; } } if (fold) { styler.SetLevel(lineCurrent, lev); } } if (styler.IsLeadByte(ch)) { chNext = styler.SafeGetCharAt(i + 2); chPrev = ' '; i += 1; continue; } // When the last char isn't part of the state (have to deal with it too)... if ( (state == SCE_MSSQL_IDENTIFIER) || (state == SCE_MSSQL_STORED_PROCEDURE) || (state == SCE_MSSQL_DATATYPE) || //~ (state == SCE_MSSQL_COLUMN_NAME) || (state == SCE_MSSQL_FUNCTION) || //~ (state == SCE_MSSQL_GLOBAL_VARIABLE) || (state == SCE_MSSQL_VARIABLE)) { if (!iswordchar(ch)) { int stateTmp; if ((state == SCE_MSSQL_VARIABLE) || (state == SCE_MSSQL_COLUMN_NAME)) { styler.ColourTo(i - 1, state); stateTmp = state; } else stateTmp = classifyWordSQL(styler.GetStartSegment(), i - 1, keywordlists, styler, state, prevState); prevState = state; if (stateTmp == SCE_MSSQL_IDENTIFIER || stateTmp == SCE_MSSQL_VARIABLE) state = SCE_MSSQL_DEFAULT_PREF_DATATYPE; else state = SCE_MSSQL_DEFAULT; } } else if (state == SCE_MSSQL_LINE_COMMENT) { if (ch == '\r' || ch == '\n') { styler.ColourTo(i - 1, state); prevState = state; state = SCE_MSSQL_DEFAULT; } } else if (state == SCE_MSSQL_GLOBAL_VARIABLE) { if ((ch != '@') && !iswordchar(ch)) { classifyWordSQL(styler.GetStartSegment(), i - 1, keywordlists, styler, state, prevState); prevState = state; state = SCE_MSSQL_DEFAULT; } } // If is the default or one of the above succeeded if (state == SCE_MSSQL_DEFAULT || state == SCE_MSSQL_DEFAULT_PREF_DATATYPE) { if (iswordstart(ch)) { styler.ColourTo(i - 1, state); prevState = state; state = SCE_MSSQL_IDENTIFIER; } else if (ch == '/' && chNext == '*') { styler.ColourTo(i - 1, SCE_MSSQL_DEFAULT); prevState = state; state = SCE_MSSQL_COMMENT; } else if (ch == '-' && chNext == '-') { styler.ColourTo(i - 1, state); prevState = state; state = SCE_MSSQL_LINE_COMMENT; } else if (ch == '\'') { styler.ColourTo(i - 1, SCE_MSSQL_DEFAULT); prevState = state; state = SCE_MSSQL_STRING; } else if (ch == '"') { styler.ColourTo(i - 1, SCE_MSSQL_DEFAULT); prevState = state; state = SCE_MSSQL_COLUMN_NAME; } else if (ch == '[') { styler.ColourTo(i - 1, SCE_MSSQL_DEFAULT); prevState = state; state = SCE_MSSQL_COLUMN_NAME_2; } else if (isoperator(ch)) { styler.ColourTo(i - 1, state); styler.ColourTo(i, SCE_MSSQL_OPERATOR); //~ style = SCE_MSSQL_DEFAULT; prevState = state; state = SCE_MSSQL_DEFAULT; } else if (ch == '@') { styler.ColourTo(i - 1, SCE_MSSQL_DEFAULT); prevState = state; if (chNext == '@') { state = SCE_MSSQL_GLOBAL_VARIABLE; // i += 2; } else state = SCE_MSSQL_VARIABLE; } // When the last char is part of the state... } else if (state == SCE_MSSQL_COMMENT) { if (ch == '/' && chNext == '*') nesting++; else if (ch == '/' && chPrev == '*') { if (nesting > 0) nesting--; else if (((i > (styler.GetStartSegment() + 2)) || ((initStyle == SCE_MSSQL_COMMENT) && (styler.GetStartSegment() == startPos)))) { styler.ColourTo(i, state); //~ state = SCE_MSSQL_COMMENT; prevState = state; state = SCE_MSSQL_DEFAULT; } } } else if (state == SCE_MSSQL_STRING) { if (ch == '\'') { if ( chNext == '\'' ) { i++; ch = chNext; chNext = styler.SafeGetCharAt(i + 1); } else { styler.ColourTo(i, state); prevState = state; state = SCE_MSSQL_DEFAULT; //i++; } //ch = chNext; //chNext = styler.SafeGetCharAt(i + 1); } } else if (state == SCE_MSSQL_COLUMN_NAME) { if (ch == '"') { if (chNext == '"') { i++; ch = chNext; chNext = styler.SafeGetCharAt(i + 1); } else { styler.ColourTo(i, state); prevState = state; state = SCE_MSSQL_DEFAULT_PREF_DATATYPE; //i++; } } } else if (state == SCE_MSSQL_COLUMN_NAME_2) { if (ch == ']') { styler.ColourTo(i, state); prevState = state; state = SCE_MSSQL_DEFAULT_PREF_DATATYPE; //i++; } } if (atEOL) styler.SetLineState(lineCurrent++, (state == SCE_MSSQL_COMMENT) ? nesting : 0); chPrev = ch; } styler.ColourTo(lengthDoc - 1, state); } static void FoldMSSQLDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { bool foldComment = styler.GetPropertyInt("fold.comment") != 0; bool foldCompact = styler.GetPropertyInt("fold.compact", 1) != 0; Sci_PositionU endPos = startPos + length; int visibleChars = 0; Sci_Position lineCurrent = styler.GetLine(startPos); int levelPrev = styler.LevelAt(lineCurrent) & SC_FOLDLEVELNUMBERMASK; int levelCurrent = levelPrev; char chNext = styler[startPos]; bool inComment = (styler.StyleAt(startPos-1) == SCE_MSSQL_COMMENT); char s[10] = ""; for (Sci_PositionU i = startPos; i < endPos; i++) { char ch = chNext; chNext = styler.SafeGetCharAt(i + 1); int style = styler.StyleAt(i); bool atEOL = (ch == '\r' && chNext != '\n') || (ch == '\n'); // Comment folding if (foldComment) { if (!inComment && (style == SCE_MSSQL_COMMENT)) levelCurrent++; else if (inComment && (style != SCE_MSSQL_COMMENT)) levelCurrent--; inComment = (style == SCE_MSSQL_COMMENT); } if (style == SCE_MSSQL_STATEMENT) { // Folding between begin or case and end if (ch == 'b' || ch == 'B' || ch == 'c' || ch == 'C' || ch == 'e' || ch == 'E') { for (Sci_PositionU j = 0; j < 5; j++) { if (!iswordchar(styler[i + j])) { break; } s[j] = static_cast(tolower(styler[i + j])); s[j + 1] = '\0'; } if ((strcmp(s, "begin") == 0) || (strcmp(s, "case") == 0)) { levelCurrent++; } if (strcmp(s, "end") == 0) { levelCurrent--; } } } if (atEOL) { int lev = levelPrev; if (visibleChars == 0 && foldCompact) lev |= SC_FOLDLEVELWHITEFLAG; if ((levelCurrent > levelPrev) && (visibleChars > 0)) lev |= SC_FOLDLEVELHEADERFLAG; if (lev != styler.LevelAt(lineCurrent)) { styler.SetLevel(lineCurrent, lev); } lineCurrent++; levelPrev = levelCurrent; visibleChars = 0; } if (!isspacechar(ch)) visibleChars++; } // Fill in the real level of the next line, keeping the current flags as they will be filled in later int flagsNext = styler.LevelAt(lineCurrent) & ~SC_FOLDLEVELNUMBERMASK; styler.SetLevel(lineCurrent, levelPrev | flagsNext); } static const char * const sqlWordListDesc[] = { "Statements", "Data Types", "System tables", "Global variables", "Functions", "System Stored Procedures", "Operators", 0, }; LexerModule lmMSSQL(SCLEX_MSSQL, ColouriseMSSQLDoc, "mssql", FoldMSSQLDoc, sqlWordListDesc); lexilla/lexers/LexIndent.cxx0000664000175000017500000000475414647367374015131 0ustar neilneil// Scintilla source code edit control /** @file LexIndent.cxx ** Lexer for no language. Used for indentation-based folding of files. **/ // The License.txt file describes the conditions under which this software may be distributed. #include #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" using namespace Lexilla; static void ColouriseIndentDoc(Sci_PositionU startPos, Sci_Position length, int, WordList *[], Accessor &styler) { // Indent language means all style bytes are 0 so just mark the end - no need to fill in. if (length > 0) { styler.StartAt(startPos + length - 1); styler.StartSegment(startPos + length - 1); styler.ColourTo(startPos + length - 1, 0); } } static void FoldIndentDoc(Sci_PositionU startPos, Sci_Position length, int /* initStyle */, WordList *[], Accessor &styler) { int visibleCharsCurrent, visibleCharsNext; int levelCurrent, levelNext; Sci_PositionU i, lineEnd; Sci_PositionU lengthDoc = startPos + length; Sci_Position lineCurrent = styler.GetLine(startPos); i = styler.LineStart(lineCurrent ); lineEnd = styler.LineStart(lineCurrent+1)-1; if(lineEnd>=lengthDoc) lineEnd = lengthDoc-1; while(styler[lineEnd]=='\n' || styler[lineEnd]=='\r') lineEnd--; for(visibleCharsCurrent=0, levelCurrent=SC_FOLDLEVELBASE; !visibleCharsCurrent && i<=lineEnd; i++){ if(isspacechar(styler[i])) levelCurrent++; else visibleCharsCurrent=1; } for(; i=lengthDoc) lineEnd = lengthDoc-1; while(styler[lineEnd]=='\n' || styler[lineEnd]=='\r') lineEnd--; for(visibleCharsNext=0, levelNext=SC_FOLDLEVELBASE; !visibleCharsNext && i<=lineEnd; i++){ if(isspacechar(styler[i])) levelNext++; else visibleCharsNext=1; } int lev = levelCurrent; if(!visibleCharsCurrent) lev |= SC_FOLDLEVELWHITEFLAG; else if(levelNext > levelCurrent) lev |= SC_FOLDLEVELHEADERFLAG; styler.SetLevel(lineCurrent, lev); levelCurrent = levelNext; visibleCharsCurrent = visibleCharsNext; } } LexerModule lmIndent(SCLEX_INDENT, ColouriseIndentDoc, "indent", FoldIndentDoc); lexilla/lexers/LexLua.cxx0000664000175000017500000004723114647367374014426 0ustar neilneil// Scintilla source code edit control /** @file LexLua.cxx ** Lexer for Lua language. ** ** Written by Paul Winwood. ** Folder by Alexey Yutkin. ** Modified by Marcos E. Wurzius & Philippe Lhoste **/ #include #include #include #include #include #include #include #include "ILexer.h" #include "Scintilla.h" #include "SciLexer.h" #include "WordList.h" #include "LexAccessor.h" #include "Accessor.h" #include "StyleContext.h" #include "CharacterSet.h" #include "LexerModule.h" #include "OptionSet.h" #include "SubStyles.h" #include "DefaultLexer.h" using namespace Scintilla; using namespace Lexilla; namespace { // Test for [=[ ... ]=] delimiters, returns 0 if it's only a [ or ], // return 1 for [[ or ]], returns >=2 for [=[ or ]=] and so on. // The maximum number of '=' characters allowed is 254. int LongDelimCheck(StyleContext &sc) { constexpr int maximumEqualCharacters = 254; int sep = 1; while (sc.GetRelative(sep) == '=' && sep <= maximumEqualCharacters) sep++; if (sc.GetRelative(sep) == sc.ch) return sep; return 0; } const char *const luaWordListDesc[] = { "Keywords", "Basic functions", "String, (table) & math functions", "(coroutines), I/O & system facilities", "user1", "user2", "user3", "user4", nullptr }; const char styleSubable[] = { SCE_LUA_IDENTIFIER, 0 }; const LexicalClass lexicalClasses[] = { // Lexer Lua SCLEX_LUA SCE_LUA_: 0, "SCE_LUA_DEFAULT", "default", "White space: Visible only in View Whitespace mode (or if it has a back colour)", 1, "SCE_LUA_COMMENT", "comment", "Block comment (Lua 5.0)", 2, "SCE_LUA_COMMENTLINE", "comment line", "Line comment", 3, "SCE_LUA_COMMENTDOC", "comment documentation", "Doc comment", 4, "SCE_LUA_NUMBER", "literal numeric", "Number", 5, "SCE_LUA_WORD", "keyword", "Keyword", 6, "SCE_LUA_STRING", "literal string", "(Double quoted) String", 7, "SCE_LUA_CHARACTER", "literal string character", "Character (Single quoted string)", 8, "SCE_LUA_LITERALSTRING", "literal string", "Literal string", 9, "SCE_LUA_PREPROCESSOR", "preprocessor", "Preprocessor (obsolete in Lua 4.0 and up)", 10, "SCE_LUA_OPERATOR", "operator", "Operators", 11, "SCE_LUA_IDENTIFIER", "identifier", "Identifier (everything else...)", 12, "SCE_LUA_STRINGEOL", "error literal string", "End of line where string is not closed", 13, "SCE_LUA_WORD2", "identifier", "Other keywords", 14, "SCE_LUA_WORD3", "identifier", "Other keywords", 15, "SCE_LUA_WORD4", "identifier", "Other keywords", 16, "SCE_LUA_WORD5", "identifier", "Other keywords", 17, "SCE_LUA_WORD6", "identifier", "Other keywords", 18, "SCE_LUA_WORD7", "identifier", "Other keywords", 19, "SCE_LUA_WORD8", "identifier", "Other keywords", 20, "SCE_LUA_LABEL", "label", "Labels", }; // Options used for LexerLua struct OptionsLua { bool foldCompact = true; }; struct OptionSetLua : public OptionSet { OptionSetLua() { DefineProperty("fold.compact", &OptionsLua::foldCompact); DefineWordListSets(luaWordListDesc); } }; class LexerLua : public DefaultLexer { WordList keywords; WordList keywords2; WordList keywords3; WordList keywords4; WordList keywords5; WordList keywords6; WordList keywords7; WordList keywords8; OptionsLua options; OptionSetLua osLua; SubStyles subStyles{styleSubable}; public: explicit LexerLua() : DefaultLexer("lua", SCLEX_LUA, lexicalClasses, std::size(lexicalClasses)) { } LexerLua(const LexerLua &) = delete; LexerLua(LexerLua &&) = delete; LexerLua &operator=(const LexerLua &) = delete; LexerLua &operator=(LexerLua &&) = delete; ~LexerLua() override = default; void SCI_METHOD Release() noexcept override { delete this; } [[nodiscard]] int SCI_METHOD Version() const noexcept override { return lvRelease5; } const char *SCI_METHOD PropertyNames() noexcept override { return osLua.PropertyNames(); } int SCI_METHOD PropertyType(const char *name) override { return osLua.PropertyType(name); } const char *SCI_METHOD DescribeProperty(const char *name) override { return osLua.DescribeProperty(name); } Sci_Position SCI_METHOD PropertySet(const char *key, const char *val) override; const char *SCI_METHOD PropertyGet(const char *key) override { return osLua.PropertyGet(key); } const char *SCI_METHOD DescribeWordListSets() noexcept override { return osLua.DescribeWordListSets(); } Sci_Position SCI_METHOD WordListSet(int n, const char *wl) override; void SCI_METHOD Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; void SCI_METHOD Fold(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) override; int SCI_METHOD AllocateSubStyles(int styleBase, int numberStyles) override { return subStyles.Allocate(styleBase, numberStyles); } int SCI_METHOD SubStylesStart(int styleBase) override { return subStyles.Start(styleBase); } int SCI_METHOD SubStylesLength(int styleBase) override { return subStyles.Length(styleBase); } int SCI_METHOD StyleFromSubStyle(int subStyle) override { const int styleBase = subStyles.BaseStyle(subStyle); return styleBase; } int SCI_METHOD PrimaryStyleFromStyle(int style) override { return style; } void SCI_METHOD FreeSubStyles() override { subStyles.Free(); } void SCI_METHOD SetIdentifiers(int style, const char *identifiers) override { subStyles.SetIdentifiers(style, identifiers); } int SCI_METHOD DistanceToSecondaryStyles() override { return 0; } const char *SCI_METHOD GetSubStyleBases() override { return styleSubable; } static ILexer5 *LexerFactoryLua() { return new LexerLua(); } }; Sci_Position SCI_METHOD LexerLua::PropertySet(const char *key, const char *val) { if (osLua.PropertySet(&options, key, val)) { return 0; } return -1; } Sci_Position SCI_METHOD LexerLua::WordListSet(int n, const char *wl) { WordList *wordListN = nullptr; switch (n) { case 0: wordListN = &keywords; break; case 1: wordListN = &keywords2; break; case 2: wordListN = &keywords3; break; case 3: wordListN = &keywords4; break; case 4: wordListN = &keywords5; break; case 5: wordListN = &keywords6; break; case 6: wordListN = &keywords7; break; case 7: wordListN = &keywords8; break; default: break; } Sci_Position firstModification = -1; if (wordListN) { if (wordListN->Set(wl)) { firstModification = 0; } } return firstModification; } constexpr int maskSeparator = 0xFF; constexpr int maskStringWs = 0x100; constexpr int maskDocComment = 0x200; void LexerLua::Lex(Sci_PositionU startPos, Sci_Position length, int initStyle, IDocument *pAccess) { LexAccessor styler(pAccess); // Accepts accented characters const CharacterSet setWordStart(CharacterSet::setAlpha, "_", true); const CharacterSet setWord(CharacterSet::setAlphaNum, "_", true); // Not exactly following number definition (several dots are seen as OK, etc.) // but probably enough in most cases. [pP] is for hex floats. const CharacterSet setNumber(CharacterSet::setDigits, ".-+abcdefpABCDEFP"); const CharacterSet setExponent("eEpP"); const CharacterSet setLuaOperator("*/-+()={}~[];<>,.^%:#&|"); const CharacterSet setEscapeSkip("\"'\\"); const WordClassifier &classifierIdentifiers = subStyles.Classifier(SCE_LUA_IDENTIFIER); Sci_Position currentLine = styler.GetLine(startPos); // Initialize long string [[ ... ]] or block comment --[[ ... ]], // if we are inside such a string. Block comment was introduced in Lua 5.0, // blocks with separators [=[ ... ]=] in Lua 5.1. // Continuation of a string (\z whitespace escaping) is controlled by stringWs. int sepCount = 0; int stringWs = 0; int lastLineDocComment = 0; if ((currentLine > 0) && AnyOf(initStyle, SCE_LUA_DEFAULT, SCE_LUA_LITERALSTRING, SCE_LUA_COMMENT, SCE_LUA_COMMENTDOC, SCE_LUA_STRING, SCE_LUA_CHARACTER)) { const int lineState = styler.GetLineState(currentLine - 1); sepCount = lineState & maskSeparator; stringWs = lineState & maskStringWs; lastLineDocComment = lineState & maskDocComment; } // results of identifier/keyword matching Sci_Position idenPos = 0; Sci_Position idenStartCharWidth = 0; Sci_Position idenWordPos = 0; int idenStyle = SCE_LUA_IDENTIFIER; bool foundGoto = false; // Do not leak onto next line if (AnyOf(initStyle, SCE_LUA_STRINGEOL, SCE_LUA_COMMENTLINE, SCE_LUA_COMMENTDOC, SCE_LUA_PREPROCESSOR)) { initStyle = SCE_LUA_DEFAULT; } StyleContext sc(startPos, length, initStyle, styler); if (startPos == 0 && sc.ch == '#' && sc.chNext == '!') { // shbang line: "#!" is a comment only if located at the start of the script sc.SetState(SCE_LUA_COMMENTLINE); } for (; sc.More(); sc.Forward()) { if (sc.atLineEnd) { // Update the line state, so it can be seen by next line currentLine = styler.GetLine(sc.currentPos); switch (sc.state) { case SCE_LUA_DEFAULT: case SCE_LUA_LITERALSTRING: case SCE_LUA_COMMENT: case SCE_LUA_COMMENTDOC: case SCE_LUA_STRING: case SCE_LUA_CHARACTER: // Inside a literal string, block comment or string, we set the line state styler.SetLineState(currentLine, lastLineDocComment | stringWs | sepCount); break; default: // Reset the line state styler.SetLineState(currentLine, 0); break; } } if (sc.atLineStart && (sc.state == SCE_LUA_STRING)) { // Prevent SCE_LUA_STRINGEOL from leaking back to previous line sc.SetState(SCE_LUA_STRING); } // Handle string line continuation if ((sc.state == SCE_LUA_STRING || sc.state == SCE_LUA_CHARACTER) && sc.ch == '\\') { if (sc.chNext == '\n' || sc.chNext == '\r') { sc.Forward(); if (sc.ch == '\r' && sc.chNext == '\n') { sc.Forward(); } continue; } } // Determine if the current state should terminate. if (sc.state == SCE_LUA_OPERATOR) { if (sc.ch == ':' && sc.chPrev == ':') { // ::