0
I Use This!
Activity Not Available

Project Summary

Fast lexer for programming languges.Based on handle writen table automation.May be used for tokenize any text with byte and multibyte(constant size) coding.

Main optimization is tree of table automation with 256 entries.Each entry is code of current char in text.

Second optimization will be added in nearest future.It must decrease using of memory.Each byte separate to two parts in 4 bits.For each part create table with 16 entries.

////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////

Быстрый lexer для языков программирования таких как C/C++/C#/Java и т.п..Основан на написанном вручную табличном автомате.Может быть использован для токенизации текста в одно и многобайтовых(с постоянным размером) кодировках.

Главня оптимизация - дерево табличных автоматов с 256 входами.Каждый вход - код текущего символа в тексте.

Вторая оптимизация будет добавленна в ближайшем будующем.Она должна существенно снизить использование памяти и состоит в следующем.Не секрет) что байт состоит из восьми битов.Разделим определение символа на две части.Сначала распознаем верхние 4 бита.Для этого создадим таблицу из 16 входов.Потом нижние 4 бита.Соответственно создадим ещё одну такуюже таблицу.

Tags

c cpp fastlexer lexer

In a Nutshell, fastlexer...

 No code available to analyze

Open Hub computes statistics on FOSS projects by examining source code and commit history in source code management systems. This project has no code locations, and so Open Hub cannot perform this analysis

Is this project's source code hosted in a publicly available repository? Do you know the URL? If you do, click the button below and tell us so that Open Hub can generate statistics! It's fast and easy - try it and see!

Add a code location

GNU General Public License v3.0 or later
Permitted

Commercial Use

Modify

Distribute

Place Warranty

Use Patent Claims

Forbidden

Sub-License

Hold Liable

Required

Distribute Original

Disclose Source

Include Copyright

State Changes

Include License

Include Install Instructions

These details are provided for information only. No information here is legal advice and should not be used as such.

All Licenses

This Project has No vulnerabilities Reported Against it

Did You Know...

  • ...
    Black Duck offers a free trial so you can discover if there are open source vulnerabilities in your code
  • ...
    search using multiple tags to find exactly what you need
  • ...
    there are over 3,000 projects on the Open Hub with security vulnerabilities reported against them
  • ...
    check out hot projects on the Open Hub

 No code available to analyze

Open Hub computes statistics on FOSS projects by examining source code and commit history in source code management systems. This project has no code locations, and so Open Hub cannot perform this analysis

Is this project's source code hosted in a publicly available repository? Do you know the URL? If you do, click the button below and tell us so that Open Hub can generate statistics! It's fast and easy - try it and see!

Add a code location

Community Rating

Be the first to rate this project
Click to add your rating
   Spinner
Review this Project!
Sample ohloh analysis