48 Commits

Author SHA1 Message Date
Laurenz
7f8f225cb3 Split up parser into multiple files 🧱
Splits up into:
- escaping: resolving of escape sequences
- parser: the parsing code
- tests: all integrated parsing tests

Also moves Ident from the root syntax module into the tree module.
2020-09-03 19:16:19 +02:00
Laurenz
181f756a9e Format everything with rustfmt! 💚 2020-08-30 22:18:55 +02:00
Laurenz
30f16bbf64 Add Value type and replace dyn-nodes with call-exprs 🏗
- In addition to syntax trees there are now `Value`s, which syntax trees can be evaluated into (e.g. the tree is `5+5` and the value is `10`)
- Parsing is completely pure, function calls are not parsed into nodes, but into simple call expressions, which are resolved later
- Functions aren't dynamic nodes anymore, but simply functions which receive their arguments as a table and the layouting context
- Functions may return any `Value`
- Layouting is powered by functions which return the new `Commands` value, which informs the layouting engine what to do
- When a function returns a non-`Commands` value, the layouter simply dumps the value into the document in monospace
2020-08-16 22:39:21 +02:00
Laurenz
9f6137d8a8 Remove tuples and objects in favor of tables 🛢
This refactores the parser tests to make them more concise and flexible with regards to spans.
2020-08-16 14:38:30 +02:00
Laurenz
1a0608930c Rename Value trait into TryFromExpr ✒ 2020-08-15 11:44:18 +02:00
Laurenz
2467cd6272 Refactor function parsing ♻ 2020-08-04 13:48:07 +02:00
Laurenz
dbfb3d2ced Formatting, documentation and small improvements 🧽 2020-08-03 16:04:55 +02:00
Laurenz
5a8f2fb73d Replace body! macro with functions 🧰 2020-08-02 22:21:58 +02:00
Laurenz
266d457292 Refactor model into tree 🛒 2020-08-02 22:05:49 +02:00
Laurenz
533374db14 Refactor argument parsing 🔬 2020-08-02 16:31:34 +02:00
Laurenz
bbcdeb128c Move, rename and switch some things (boring) 🚚
- Problems -> Diagnostics
- Position -> Pos
- offset_spans -> Offset trait
- Size -> Length (and some more size types renamed)
- Paper into its own module
- scope::Parser -> parsing::CallParser
- Create `Decorations` alias
- Remove lots of double newlines
- Switch from f32 to f64
2020-07-29 18:09:51 +02:00
Laurenz
1658b00282 New syntax features 👔
- Forced line breaks with backslash followed by whitespace
- (Multline) raw text in backticks
- Set font class fallbacks with [font.family] (e.g. [font.family: monospace=("CMU Typewriter Text")])
- More sophisticated procedure to find end of function, which accounts for comments, strings, raw text and nested functions (this is a mix of a feature and a bug fix)
2020-02-13 21:58:49 +01:00
Laurenz
60099aed50 Parse tuples and objects 🍒
Generalizes the parsing of tuples, objects and function arguments into generic comma-separated collections.
2020-02-11 21:30:39 +01:00
Laurenz
4e8359385f Improve syntax testing framework ♻
... and finally expand a few escape sequences in strings.
2020-02-07 22:29:16 +01:00
Laurenz
02dc29d18a Highlight bold / italic / monospace 🎨 2020-02-06 11:15:48 +01:00
Laurenz
e63ce52ae0 Merge Parsed and Layouted types into Pass with Feedback 🌝🎢🌚 2020-02-04 19:22:23 +01:00
Laurenz
ec60795575 Port tests 🚁 2020-02-03 15:05:34 +01:00
Laurenz
3150fd5643 Better Debug/Display and Derives 🧽 2020-02-03 12:22:02 +01:00
Laurenz
40ea35cbe7 Upgrade to new toddle interface 🐳 2020-02-03 10:37:50 +01:00
Laurenz
20fb4e7c37 Document everything 📜 2020-01-26 15:51:13 +01:00
Laurenz
0a087cd28b Reorganize modules 🧱 2020-01-24 16:23:57 +01:00
Laurenz
03fddaf3ae Non-fatal argument parsing 🌋 2020-01-24 12:44:04 +01:00
Laurenz
78da2bdd5d Decoupled function parser 🔗 [WIP] 2020-01-21 17:09:31 +01:00
Laurenz
95e6b078fe Move to non-fatal errors 🪂 [WIP]
- Dynamic models instead of SyntaxTrees
- No more ParseResult/LayoutResult
- Errors and Decorations which are propagated to parent contexts
- Models are finally clonable
2020-01-19 21:53:24 +01:00
Laurenz
277f2d2176 ColorToken serialization + function fix 🚧 2020-01-18 15:58:36 +01:00
Laurenz
70878885f5 Do argument parsing ☑ 2020-01-16 23:00:39 +01:00
Laurenz
08b91a265f Powerful parser testing 🐱👤 2020-01-16 17:51:04 +01:00
Laurenz
15ad30555b Parser testing prototype 🥥 2020-01-14 20:17:50 +01:00
Laurenz
a8f711d49a Checkpoint 🏁 2020-01-13 11:26:42 +01:00
Laurenz
b1e956419d Re-engineer tokenization 🚿 2020-01-11 10:11:14 +01:00
Laurenz
5dbc7dc5aa Introduce color tokens 🎨 2020-01-09 18:44:29 +01:00
Laurenz
a93b1ab003 Formatting 🛀 2020-01-06 12:50:20 +01:00
Laurenz
bd384a2a63 Re-enable *, _ and `. 2020-01-05 11:18:13 +01:00
Laurenz
f3e461b27c Paper styles and scalable+default margins 📜 2019-12-15 15:09:09 +01:00
Laurenz
971ff3a2dc Implement expression kind for Spanned<T> 👩‍💻 2019-12-13 14:58:14 +01:00
Laurenz
ff107cf3e7 Tidying up 🧹 2019-12-12 22:19:38 +01:00
Laurenz
f5b104d0da Rename crate typst -> typstc 2019-12-05 20:29:55 +01:00
Laurenz
72a9631b03 Move arg parser into FuncArgs and create (incomplete) consistent map 🧭 2019-12-05 19:48:37 +01:00
Laurenz
f72b1505be Unify error types ♾ 2019-12-04 20:20:02 +01:00
Laurenz
9fb31defd0 Expand functionality of function! macro 🛰 2019-12-04 19:35:28 +01:00
Laurenz
b13ed627ff Better error reporting 🚨 2019-11-30 14:10:35 +01:00
Laurenz
1ece263579 Create easy-to-use argument parser 💎 2019-11-07 19:07:11 +01:00
Laurenz
271af7ed03 Parse keyword arguments 📋 2019-11-06 23:18:48 +01:00
Laurenz
110e4b9cb9 Spans for all parts of functions 2019-10-31 20:26:21 +01:00
Laurenz
65ec3764e5 Basic node spans 2019-10-30 22:52:25 +01:00
Laurenz
b5d8b8f4a5 Token spans 🔜🔙 2019-10-30 21:13:12 +01:00
Laurenz
ccc4639c7d Improve documentation comments 📜 2019-10-30 20:13:28 +01:00
Laurenz
b4be25e43b Prettify peeking and rearrange syntax/parsing modules 🧶 2019-10-24 19:10:03 +02:00