Developer Cheatsheet

Helpful information for developers on the Editor team.

Useful Commands

general

  • Testing CI/CD Jobs Locally: gitlab-runner exec shell job_name

gitlab-org/gitlab

  • gdk start ( gdk doctor
  • bin/rake frontend:fixtures
  • Running tests:
    • yarn karma
    • yarn jest
  • Debugging Capybara
    • CHROME_HEADLESS=0 bundle exec rspec spec/features/projects/tree/create_directory_spec.rb
  • Capybara Screenshots
    • screenshot_and_save_page
    • screenshot_and_open_image
  • live_debug
  • Static Analysis:
    • scripts/static-analysis (long)
    • yarn eslint (faster)
  • fdescribe and fit for focused karma specs

Running QA Specs

See https://gitlab.com/gitlab-org/gitlab/tree/master/qa#how-can-i-use-it for more details.

  • cd qa
  • bundle
  • brew cask <install|reinstall> chromedriver
  • bundle exec bin/qa Test::Instance::All http://0.0.0.0:3000 -- qa/specs/features/ee/browser_ui/1_manage/project/project_templates_spec.rb

To run the QA specs in RubyMine, use a custom rspec runner configuration (right click on the arrow next to the example in the gutter), and set the qa/bin/rubymine script as the custom RSpec runner script, and the working directory as qa.

See more detailed instructions for this process here: https://gitlab.com/gitlab-org/gitlab-development-kit/-/blob/main/doc/howto/end_to_end_test_configuration.md#starting-tests-using-the-rubymine-gutter

gitlab-com/www-gitlab-com

Tips and Tricks

GDK Tips

  • To access EE features, you need to make sure you have an EE license added in /admin/license

Running Web IDE Terminal in GDK

GDK Debugging

Log Debugging

  • If you want to print out a debugging message:
    • puts or p will ONLY show up in gdk tail rails
    • logger.info('...') will ONLY show up in tail -f log/development.log

RubyMine Debugging

MOVED: Ths section on debugging the GDK with the RubyMine debugger has been moved to https://handbook.gitlab.com/handbook/tools-and-tips/editors-and-ides/jetbrains-ides/individual-ides/rubymine/#debugging-rails-web

Git Tips

Rebasing

Interactive Rebasing

  • Use of interactive rebasing (git rebase -i master) and message cleanup via reword/fixup are worth learning more about if you are unfamiliar with them.
  • Interactive rebasing tip:
    • This process will let you separate “interactive rebasing” against the merge-base (the common ancestor of your branch HEAD and the upstream branch master) from the possibility of “conflict resolution” when rebasing against the latest upstream master.
    • First, do a git rebase -i $(git merge-base HEAD master). This lets you do your interactive rebase against the merge-base without any chance of having to deal with conflicts at the same time. Make sure that the merge-base commit is contained on your master branch (i.e. you didn’t just fetch and checkout the branch directly without updating master). You could just git fetch then rebase against origin/master, but this negates the benefit of using --force-with-lease.
    • Optionally git push --force-with-lease (Or just wait until after the next step to push if you don’t want to trigger an extra unnecessary build)
    • Then, do a git rebase master, to rebase against the latest master, and resolve any conflicts against your cleaned-up, interactively-rebased branch.
    • git push --force-with-lease (force-with-lease ensures nobody else has pushed to the branch since you last pulled)

Using the –onto option for rebasing stacked MRs

If you have multiple MRs which are “stacked” on each other, the --onto option is very useful and can help avoid unnecessary rebase conflicts.

Assume this situation:

  1. first MR and branch is based off of the master (main) branch, and has some commits.
  2. second MR and branch is based off of the first branch, and has some commits.
  3. first branch has been rebased off of master.
  4. This means that the first branch’s commit’s SHAs have changed, and thus the SHAs for those commits in the second branch are outdated.

This is where --onto comes in handy. If you simply tried to rebase second directly on to of first, you would get a lot of confusing rebase conflicts that didn’t make sense, because the “history” or state of the first branch has changed compared to what the second branch currently knows about.

But there’s a way to avoid these confusing and unnecessary conflicts: You take ONLY the commits that are part of the second branch, and rebase them ONTO the current state of the first branch, using the --onto option.

Here’s how:

  1. git checkout second
  2. git log second and copy the SHA of the commit that USED to be the latest commit on the first branch. For example, abcdef
    • NOTE: If you have ensured that there is only a single commit on the second branch (via regular interactive rebase and fixup as explained above), then you can also just use head^ instead of getting the specific SHA.
  3. Rebase “relative” to that commit, “onto” the first branch: git rebase abcdef --onto first, or if second only has one commit, use git rebase head^ --onto first
  4. Continue on with the rebase as normal. You may still get some legitimate conflicts you have to resolve if first has changed some of the same lines as second, but no confusing/unnecessary conflicts due to the second branch’s “outdated history” of first, because you’ve ignored it with --onto.

Git References

Interactive Git Learning Tools

Squashing down a branch which has had master merged into it

When a branch has followed a merge instead of a rebase workflow, it can get very confusing to know what is going on, and you want to just squash it down to a single commit. But, you can’t just do a regular interactive rebase relative to master if the branch has had master merged into it. Here’s what you have to do instead.

Note there may be more efficient ways of doing this, suggestions are welcome. Also note that sometimes this doesn’t work, you’ll end up with almost all the changes from the branch uncommitted after step 5 - not sure why :(

Assuming branch is named branch and upstream is named master:

  1. Do a log of all the commits on the branch: git log master..branch --oneline

  2. Find the last (latest) commit on the branch. It will be the top one, assume it is c60ed83.

  3. Find the commit on the branch which is IMMEDIATELY BEFORE the merge commit.

    1. You can run git log --graph --oneline --decorate on your branch to find the merge commit - the merge commit will likely have a commit message like “resoove merge conflicts”.

    2. Follow the “line” of your branch down and find the commit on your branch immediately before the merge commit.

    3. Here’s an example of what this would look like. In this example, c36ee33 is the merge commit, and b48156a is the commit immediately before it. In a real terminal, the lines will also be different colors, to make this easier to read.

      * c60ed83 (HEAD -> caw-investigate-rebase-conflicts, origin/caw-investigate-rebase-conflicts) chore: fix vue
      * a5269d6 chore: fix vue
      * b3941ad chore: fix previous commits
      *   c36ee33 chore: resolve conflicts
      |\
      | *   a13f09e (origin/llb/conditionally-load-legacy-web-ide-scripts) Merge branch 'removeRemoteFromExample' into 'main'
      | |\
      | | * a5144c2 chore: Remove "Remote Development" mode from the example app
      | |/
      | *   c33f00c Merge branch 'cwoolley-gitlab-main-patch-d6cd' into 'main'
      | |\
      | | * fcfb4a1 (origin/cwoolley-gitlab-main-patch-d6cd, cwoolley-gitlab-main-patch-d6cd) chore: Update file Default.md
      | * |   e97eeec Merge branch 'replaceLogger' into 'main'
      | |\ \
      | | * | 8d48c3e chore: Replace console.log reference with actual logger
      | * | |   60be327 Merge branch 'rename-group-ide-label' into 'main'
      | |\ \ \
      | | |_|/
      | |/| |
      | | * | 90ac565 chore: Rename group::ide to "group::remote development"
      | |/ /
      | * |   0b89422 (origin/365-make-vscode-loglevel-configurable-2, origin/365-make-vscode-loglevel-configurable) Merge branch 'dp-remove-remote-repository' into 'main'
      | |\ \
      | | |/
      | |/|
      | | * fc374f0 feat: Remove "Configure a Remote Connection" command
      | |/
      | *   522f9b9 Merge branch 'updateCommit' into 'main'
      | |\
      | | * 9a99045 feat: update copy for committing to new branch
      | * |   e6a542f Merge branch 'ealcantara/web-ide-development-process-issue-template' into 'main'
      | |\ \
      | | |/
      | |/|
      | | * a520ee4 (origin/ealcantara/web-ide-development-process-issue-template) chore: Web IDE development process issue template
      * | | b48156a chore: fix waitForReady
      * | | 3f4bae3 chore: ran prettier
      * | | bc990b1 chore: remove with erroneous configType
      * | | 75ad9f0 chore: fix errors
      ...
      ...
      
    4. Copy the SHA of that commit which is immediately before the merge commit. For this example, we’ll assume its b48156a

  4. Reset hard to the commit before your merge commit: git reset --hard b48156a

  5. merge --squash the last commit: git merge --squash c60ed83

  6. Now, if you run git log --graph --oneline --decorate again, you will see that the merge commit and all the commits after it have been replaced with a single normal, non-merge commit. Here’s an example of what the above log looks like after doing this:

    * b48156a (HEAD -> caw-investigate-rebase-conflicts) chore: fix waitForReady
    * 3f4bae3 chore: ran prettier
    * bc990b1 chore: remove with erroneous configType
    * 75ad9f0 chore: fix errors
    ...
    ...
    
  7. If there were other merge commits, get rid of them using the same steps.

  8. NOTE: In some cases, after the squash, there may be extra changes from the master commits that you don’t want. Get rid of them with:

    1. git restore --staged .
    2. git checkout .
    3. git clean -df

Now, you should be able to use rebase and rebase --interactive normally on your branch.

If you want to try this out yourself with the above example, you can check out this branch (just don’t push it back to the repo).

Working with Issues/MRs

New habits

Though the contributor and development docs are the single source of truth, there are some additional habits that may be worth developing when you’re new to the code contribution process.

Depending on your existing habits and git practices the habits below may help mitigate pain during code submissions.

  • Keep GDK up to date (update often, if not daily)
  • Keep your commit history clean
  • Keep merge requests small
    • Merge conflicts are inevitable, but focusing on making your MRs smaller will save you pain later
  • Keep localization files up to date

Dealing with Broken Master

Browser Testing

About testing:

Some frontendmasters workshops related to testing that I want to take after the web security workshop:

Jetbrains IDE Usage

MOVED: There is now a dedicated handbook section on JetBrains IDEs: https://handbook.gitlab.com/handbook/tools-and-tips/editors-and-ides/jetbrains-ides/

Last modified August 5, 2024: Update file developer-cheatsheet.md (c74771be)