Regular Expressions With Go: Part 1

Overview

Regular expressions (AKA regex) are a formal language that defines a sequence of characters with some pattern. In the real world they can be used to solve a lot of problems with semi-structured text. You can extract the important bits and pieces from text with a lot of decorations or unrelated content. Go has a strong regex package in its standard library that lets you slice and dice text with regexes. 

In this two-part series, you'll learn what regular expressions are and how to use regular expressions effectively in Go to accomplish many common tasks. If you're not familiar with regular expressions at all, there are lots of great tutorials. Here is a good one.

Understanding Regular Expressions

Let's start with a quick example. You have some text, and you want to check if it contains an email address. An email address is specified rigorously in RFC 822. In short, it has a local part followed by an @ symbol followed by a domain. The mail address will be separated from the rest of the text by space. 

To figure out if it contains an email address, the following regex will do: ^\w+@\w+\.\w+$. Note that this regex is a little permissive and will allow some invalid email addresses through. But it's good enough to demonstrate the concept. Let's try it on a couple of potential email addresses before explaining how it works:

package main

import (
    "os"
    "regexp"
    "fmt"
)


func check(err error) {
    if err != nil {
        fmt.Println(err.Error())
        os.Exit(1)
    }
}

func main() {
    emails := []string{
        "brown@fox",
        "brown@fox.",
        "brown@fox.com",
        "br@own@fox.com",
    }

    pattern := `^\w+@\w+\.\w+$`
    for _, email := range emails {
        matched, err := regexp.Match(pattern, []byte(email))
        check(err)
        if matched {
            fmt.Printf("√ '%s' is a valid email\n", email)
        } else {
            fmt.Printf("X '%s' is not a valid email\n", email)
        }
    }
}

Output:

X 'brown@fox' is not a valid email
X 'brown@fox.' is not a valid email
√ 'brown@fox.com' is a valid email
X 'br@own@fox.com' is not a valid email

Our regular expression works on this little sample. The first two addresses were rejected because the domain didn't have a dot or didn't have any characters after the dot. The third email was formatted correctly. The last candidate had two @ symbols.

Let's break this regex down: ^\w+@\w+\.\w+$

Character/Symbol Meaning
^ Beginning of the target text
\w Any word characters [0-9A-Za-z_]
+ At least one of the previous characters
@ Literally the @ character 
\. The literal dot character. Must be escaped with \
$ End of target text

Altogether, this regex will match pieces of text that start with one or more word characters, followed by the "@" character, followed again by one or more word characters, followed by a dot and followed by yet again one or more word characters.  

Dealing With Special Characters

The following characters have special meanings in regular expressions: .+*?()|[]{}^$\. We have already saw many of them in the email example. If we want to match them literally, we need to escape them with a backslash. Let's introduce a little helper function called match() that will save us a lot of typing. It takes a pattern and some text, uses the regexp.Match() method to match the pattern to the text (after converting the text to a byte array), and prints the results:

func match(pattern string, text string) {
    matched, _ := regexp.Match(pattern, []byte(text))
        if matched {
                fmt.Println("√", pattern, ":", text)
        } else {
                fmt.Println("X", pattern, ":", text)
        }
}

Here's an example of matching a regular character like z vs. matching a special character like ?:

func main() {
    text := "Can I haz cheezburger?"
        pattern := "z"
        match(pattern, text)

        pattern = "\\?"
        match(pattern, text)

        pattern = `\?`
        match(pattern, text)
}

Output:

√ z : Can I haz cheezburger?
√ \? : Can I haz cheezburger?
√ \? : Can I haz cheezburger?

The regex pattern \? contains a backslash that must be escaped with another backslash when represented as a regular Go string. The reason is that backslash is also used to escape special characters in Go strings like newline (\n). If you want to match the backslash character itself, you'll need four slashes! 

The solution is to use Go raw strings with the backtick (`) instead of double quotes. Of course, if you want to match the newline character, you must go back to regular strings and deal with multiple backslash escapes.

Placeholders and Repetitions

In most cases, you don't try to literally match a sequence of specific characters like "abc", but a sequence of unknown length with maybe some known characters injected somewhere. Regexes support this use case with the dot  . special character that stands for any character whatsoever. The * special character repeats the previous character (or group) zero or more times. If you combine them, as in .*, then you match anything because it simply means zero or more characters. The + is very similar to *, but it matches one or more of the previous characters or groups. So .+ will match any non-empty text.

Using Boundaries

There are three types of boundaries: the start of the text denoted by ^, the end of the text denoted by $, and the word boundary denoted by \b. For example, consider this text from the classic movie The Princess Bride: "My name is Inigo Montoya. You killed my father. Prepare to die." If you match just "father" you get a match, but if you're looking for "father" at the end of the text, you need to add the $ character, and then there will be no match. On the other hand, matching "Hello" at the beginning works well.

func main() {
    text := "Hello, my name is Inigo Montoya, you killed my father, prepare to die."
        pattern := "father"
        match(pattern, text)

        pattern = "father$"
        match(pattern, text)

        pattern = "^Hello"
        match(pattern, text)
}

Output:

√ father  : Hello, my name is Inigo Montoya, 
            you killed my father, prepare to die.
X father$ : Hello, my name is Inigo Montoya, 
            you killed my father, prepare to die.
√ ^Hello :  Hello, my name is Inigo Montoya, 
            you killed my father, prepare to die.

Word boundaries look at each word. You can start and/or end a pattern with the \b. Note that punctuation marks like commas are considered a boundary and not part of the word. Here are a few examples:

func main() {
    text := `Hello, my name is Inigo Montoya, 
                 you killed my father, prepare to die.`
        pattern := `kill`
        match(pattern, text)

        pattern = `\bkill`
        match(pattern, text)

        pattern = `kill\b`
        match(pattern, text)

        pattern = `\bkill\b`
        match(pattern, text)

        pattern = `\bkilled\b`
        match(pattern, text)

        pattern = `\bMontoya,\b`
        match(pattern, text)
}

Output:

√ kill :         Hello, my name is Inigo Montoya, 
                 you killed my father, prepare to die.
√ \bkill :       Hello, my name is Inigo Montoya, 
                 you killed my father, prepare to die.
X kill\b :       Hello, my name is Inigo Montoya, 
                 you killed my father, prepare to die.
X \bkill\b :     Hello, my name is Inigo Montoya, 
                 you killed my father, prepare to die.
√ \bkilled\b :   Hello, my name is Inigo Montoya, 
                 you killed my father, prepare to die.
X \bMontoya,\b : Hello, my name is Inigo Montoya, 
                 you killed my father, prepare to die.

Using Classes

It's often useful to treat all groups of characters together like all digits, whitespace characters, or all alphanumeric characters. Golang supports the POSIX classes, which are:

Character Class Meaning
[:alnum:]
 alphanumeric (≡ [0-9A-Za-z])
[:alpha:]
 alphabetic (≡ [A-Za-z])
[:ascii:] 
 ASCII (≡ [\x00-\x7F])
[:blank:] 
 blank (≡ [\t ])
[:cntrl:]
 control (≡ [\x00-\x1F\x7F])
[:digit:]
 digits (≡ [0-9])
[:graph:]
 graphical (≡ [!-~] == [A-Za-z0-9!"#$%&'()*+,\-./:;<=>?@[\\\]^_`{|}~])
[:lower:] 
 lower case (≡ [a-z])
[:print:] 
 printable (≡ [ -~] == [ [:graph:]])
[:punct:]
 punctuation (≡ [!-/:-@[-`{-~])
[:space:]
 whitespace (≡ [\t\n\v\f\r ])
[:upper:]
 upper case (≡ [A-Z])
[:word:]
 word characters (≡ [0-9A-Za-z_])
[:xdigit:]
 hex digit (≡ [0-9A-Fa-f])

In the following example, I'll use the [:digit:] class to look for numbers in the text. Also, I show here how to search for an exact number of characters by adding the requested number in curly braces.

func main() {
    text := `The answer to life, universe and
             everything is 42 ."
        pattern := "[[:digit:]]{3}"
        match(pattern, text)

        pattern = "[[:digit:]]{2}"
        match(pattern, text)
}

Output:

X [[:digit:]]{3} : The answer to life, universe and 
                   everything is 42.
√ [[:digit:]]{2} : The answer to life, universe and
                   everything is 42.

You can define your own classes too by putting characters in square brackets. For example, if you want to check if some text is a valid DNA sequence that contains only the characters ACGT then use the ^[ACGT]*$ regex:

func main() {
    text := "AGGCGTTGGGAACGTT"
        pattern := "^[ACGT]*$"
        match(pattern, text)

        text = "Not exactly a DNA sequence"
        match(pattern, text)
}

Output:

√ ^[ACGT]*$ : AGGCGTTGGGAACGTT
X ^[ACGT]*$ : Not exactly a DNA sequence

Using Alternatives

In some cases, there are multiple viable alternatives. Matching HTTP URLs may be characterized by a protocol schema, which is either http:// or https://. The pipe character | lets you choose between alternatives. Here is a regex that will sort them out: (http)|(https)://\w+\.\w{2,}. It translates to a string that starts with http:// or https:// followed by at least one word character followed by a dot followed by at least two word characters.

func main() {
    pattern := `(http)|(https)://\w+\.\w{2,}`
        match(pattern, "http://tutsplus.com")
        match(pattern, "https://tutsplus.com")
        match(pattern, "htt://tutsplus.com")
}

Output:

√ (http)|(https)://\w+\.\w{2,} : http://tutsplus.com
√ (http)|(https)://\w+\.\w{2,} : https://tutsplus.com
X (http)|(https)://\w+\.\w{2,} : htt://tutsplus.com

Conclusion

In this part of the tutorial, we covered a lot of ground and learned a lot about regular expressions, with hands-on examples using the Golang regexp library. We focused on pure matching and how to express our intentions using regular expressions. 

In part two, we will focus on using regular expressions to work with text, including fuzzy finding, replacements, grouping, and dealing with new lines.



from Envato Tuts+ Tutorials

Comments

Post a Comment

Popular posts from this blog

How to Build Self-Confidence: 10+ Steps to Improve Your Self-Esteem

Image
Do you have friends who can walk up to someone at a party and they’d instantly hit it off? These are the people who often get free drinks, invites to cool events, and make new friends whenever they go out. You can gain confidence in yourself and improve different aspects of your life. (Image source:  Envato Elements ) Meanwhile, there are people who feel anxious in almost every social encounter. Their first day on a job, a big company meeting, and even a housewarming party all make them feel vulnerable and unsure of themselves. Questions like the following often spring to mind during these events:  “ What will I say? ”  “Who do I talk to?” “ What will I do if there’s an awkward silence? ”  While social awkwardness is common, it’s not a lifetime thing. You can learn how to build self-confidence that doesn’t feel forced or unnatural. You can still be yourself and have the self-confidence to try new things, meet new people, and all the benefits that come with a confident aura.
Read more

Best of 2020: Great Landing Pages for Design Inspiration (Showcase Examples)

Image
A great landing page design is crucial when it comes to announcing new products or services as well as the launch of your company. Great landing pages help visitors focus on a singular action. That makes them great for driving conversions and signups. Zimed is one of our best landing page design examples on Envato Elements. Nowadays, you don’t have to be a web design expert to create a landing page. There's no shortage of  quality landing page samples on various marketplaces so all you need to do is find the one you like, buy it, and set it up. That's why we've set up this landing page showcase. In today's post, we'll share our best landing page examples from Envato Elements and ThemeForest. Find Great Landing Page Design Examples on Envato Elements for 2020 Envato Elements is a great starting point when it comes to the best  landing page design . Envato Elements is a subscription-based marketplace with dozens of landing page templates. When you start bro
Read more

18+ Best Free PowerPoint Puzzle Pieces Templates (Infographic PPT Slides)

Image
Many people are visual learners. The population of visual learners is why it helps to use visual infographics to explain an idea in your PowerPoint presentation.  One of the best examples is using a PowerPoint puzzle pieces template.  Each piece of the puzzle can fit together into a singular idea. Templates like the premium  PANDAWA  template have all the PowerPoint puzzle pieces you need to explain a complex idea. Using a PowerPoint puzzle pieces will help you explain concepts more clearly. You can quickly and easily change professionally designed PowerPoint puzzles to fit your needs. This round-up will show you some of the best free PowerPoint puzzle templates. You'll also see top PowerPoint puzzle pieces templates from Envato Elements, and more puzzle pieces templates from GraphicRiver. Download the Best PowerPoint Puzzle Templates From Envato Elements Later in this tutorial, you'll see free template options. But for now, let's focus on the best of the best: pr
Read more