[PR #5] [MERGED] Bump chardet from 3.0.4 to 4.0.0 #54

Closed
opened 2026-09-02 13:09:09 +02:00 by TheLovinator · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/TheLovinator1/discord-twitter-webhooks/pull/5
Author: @dependabot[bot]
Created: 2/26/2021
Status: Merged
Merged: 2/26/2021
Merged by: @TheLovinator1

Base: masterHead: dependabot/pip/chardet-4.0.0


📝 Commits (1)

  • 59a76fb Bump chardet from 3.0.4 to 4.0.0

📊 Changes

1 file changed (+1 additions, -1 deletions)

View changed files

📝 requirements.txt (+1 -1)

📄 Description

Bumps chardet from 3.0.4 to 4.0.0.

Release notes

Sourced from chardet's releases.

chardet 4.0.0

⚠️ This will be the last release of chardet to support Python 2.7. chardet 5.0 will only support 3.6+ ⚠️

Major Changes

This release is multiple years in the making, and provides some quality of life improvements to chardet. The primary user-facing changes are:

  1. Single-byte charset probers now use nested dictionaries under the hood, so they are usually a little faster than before. (See #121 for details)
  2. The CharsetGroupProber class now properly short-circuits when one of the probers in the group is considered a definite match. This lead to a substantial speedup.
  3. There is now a chardet.detect_all function that returns a list of possible encodings for the input with associated confidences.
  4. We have dropped support for Python 2.6, 3.4, and 3.5 as they are all past end-of-life.

The changes in this release have also laid the groundwork for retraining the models to make them more accurate, and to support some more encodings/languages (see #99 for progress). This is our main focus for chardet 5.0 (beyond dropping Python 2 support).

Benchmarks

Running on a MacBook Pro (15-inch, 2018) with 2.2GHz 6-core i7 processor and 32GB RAM

old version (chardet 3.0.4)

Benchmarking chardet 3.0.4 on CPython 3.7.5 (default, Sep  8 2020, 12:19:42)
[Clang 11.0.3 (clang-1103.0.32.62)]
--------------------------------------------------------------------------------
Calls per second for each encoding:
ascii: 25559.439366240098
big5: 7.187002209518091
cp932: 4.71090956645177
cp949: 2.937256786994428
euc-jp: 4.870580412090848
euc-kr: 6.6910755971933416
euc-tw: 87.71098043480079
gb2312: 6.614302607154443
ibm855: 27.595893549680685
ibm866: 29.93483661732791
iso-2022-jp: 3379.5052775763434
iso-2022-kr: 26181.67290886392
iso-8859-1: 120.63424740403983
iso-8859-5: 32.65106262196898
iso-8859-7: 62.480089080556084
koi8-r: 13.72481001727257
maccyrillic: 33.018537255804496
shift_jis: 4.996013583677438
tis-620: 14.323112928341818
utf-16: 166771.53081510935
utf-32: 198782.18009478672
utf-8: 13.966236809766901
utf-8-sig: 193732.28637413395
windows-1251: 23.038910006925768
</tr></table> 

... (truncated)

Commits
  • a808ed1 Merge pull request #140 from chardet/master
  • 53854fb Add language to detect_all output
  • 1e208b7 Properly set CharsetGroupProber.state to FOUND_IT (#203)
  • a9286f7 Try to switch from Travis to GitHub Actions (#204)
  • 1db0347 Handle weird logging edge case in universaldetector.py
  • 056a2a4 Remove shebang and executable bit from chardet/cli/chardetect.py (#171)
  • 55ef330 Update links (#152)
  • e4290b6 Remove unnecessary numeric placeholders from format strings (#176)
  • 6a59c4b Remove use of deprecated 'setup.py test' (#187)
  • 4650dbf Remove shebang from nonexecutable script (#192)
  • Additional commits viewable in compare view

Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot merge will merge this PR after your CI passes on it
  • @dependabot squash and merge will squash and merge this PR after your CI passes on it
  • @dependabot cancel merge will cancel a previously requested merge and block automerging
  • @dependabot reopen will reopen this PR if it is closed
  • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/TheLovinator1/discord-twitter-webhooks/pull/5 **Author:** [@dependabot[bot]](https://github.com/apps/dependabot) **Created:** 2/26/2021 **Status:** ✅ Merged **Merged:** 2/26/2021 **Merged by:** [@TheLovinator1](https://github.com/TheLovinator1) **Base:** `master` ← **Head:** `dependabot/pip/chardet-4.0.0` --- ### 📝 Commits (1) - [`59a76fb`](https://github.com/TheLovinator1/discord-twitter-webhooks/commit/59a76fbe9ac7a909e29d2128271e554b51beb263) Bump chardet from 3.0.4 to 4.0.0 ### 📊 Changes **1 file changed** (+1 additions, -1 deletions) <details> <summary>View changed files</summary> 📝 `requirements.txt` (+1 -1) </details> ### 📄 Description Bumps [chardet](https://github.com/chardet/chardet) from 3.0.4 to 4.0.0. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/chardet/chardet/releases">chardet's releases</a>.</em></p> <blockquote> <h2>chardet 4.0.0</h2> <p>⚠️ This will be the last release of chardet to support Python 2.7. chardet 5.0 will only support 3.6+ ⚠️</p> <h3>Major Changes</h3> <p>This release is multiple years in the making, and provides some quality of life improvements to chardet. The primary user-facing changes are:</p> <ol> <li>Single-byte charset probers now use nested dictionaries under the hood, so they are usually a little faster than before. (See <a href="https://github-redirect.dependabot.com/chardet/chardet/issues/121">#121</a> for details)</li> <li>The <code>CharsetGroupProber</code> class now properly short-circuits when one of the probers in the group is considered a definite match. This lead to a substantial speedup.</li> <li>There is now a <code>chardet.detect_all</code> function that returns a list of possible encodings for the input with associated confidences.</li> <li>We have dropped support for Python 2.6, 3.4, and 3.5 as they are all past end-of-life.</li> </ol> <p>The changes in this release have also laid the groundwork for retraining the models to make them more accurate, and to support some more encodings/languages (see <a href="https://github-redirect.dependabot.com/chardet/chardet/issues/99">#99</a> for progress). This is our main focus for chardet 5.0 (beyond dropping Python 2 support).</p> <h3>Benchmarks</h3> <p>Running on a MacBook Pro (15-inch, 2018) with 2.2GHz 6-core i7 processor and 32GB RAM</p> <h4>old version (chardet 3.0.4)</h4> <pre><code>Benchmarking chardet 3.0.4 on CPython 3.7.5 (default, Sep 8 2020, 12:19:42) [Clang 11.0.3 (clang-1103.0.32.62)] -------------------------------------------------------------------------------- Calls per second for each encoding: ascii: 25559.439366240098 big5: 7.187002209518091 cp932: 4.71090956645177 cp949: 2.937256786994428 euc-jp: 4.870580412090848 euc-kr: 6.6910755971933416 euc-tw: 87.71098043480079 gb2312: 6.614302607154443 ibm855: 27.595893549680685 ibm866: 29.93483661732791 iso-2022-jp: 3379.5052775763434 iso-2022-kr: 26181.67290886392 iso-8859-1: 120.63424740403983 iso-8859-5: 32.65106262196898 iso-8859-7: 62.480089080556084 koi8-r: 13.72481001727257 maccyrillic: 33.018537255804496 shift_jis: 4.996013583677438 tis-620: 14.323112928341818 utf-16: 166771.53081510935 utf-32: 198782.18009478672 utf-8: 13.966236809766901 utf-8-sig: 193732.28637413395 windows-1251: 23.038910006925768 &lt;/tr&gt;&lt;/table&gt; </code></pre> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/chardet/chardet/commit/a808ed1c945293c0edeeda3a360abfa2a0b25a20"><code>a808ed1</code></a> Merge pull request <a href="https://github-redirect.dependabot.com/chardet/chardet/issues/140">#140</a> from chardet/master</li> <li><a href="https://github.com/chardet/chardet/commit/53854fb04f4f1baa02ad9787ab0bc9abf5d78cd5"><code>53854fb</code></a> Add language to detect_all output</li> <li><a href="https://github.com/chardet/chardet/commit/1e208b743c3fed378eb3189d8080aba8ba77d730"><code>1e208b7</code></a> Properly set CharsetGroupProber.state to FOUND_IT (<a href="https://github-redirect.dependabot.com/chardet/chardet/issues/203">#203</a>)</li> <li><a href="https://github.com/chardet/chardet/commit/a9286f7b5d78fd1d9542cee5ece2da7989c0688f"><code>a9286f7</code></a> Try to switch from Travis to GitHub Actions (<a href="https://github-redirect.dependabot.com/chardet/chardet/issues/204">#204</a>)</li> <li><a href="https://github.com/chardet/chardet/commit/1db03470dd5b82fb305b5fd1bebfb46cd961551f"><code>1db0347</code></a> Handle weird logging edge case in universaldetector.py</li> <li><a href="https://github.com/chardet/chardet/commit/056a2a439e7dcaf6a845aa583f32687f6a420b41"><code>056a2a4</code></a> Remove shebang and executable bit from chardet/cli/chardetect.py (<a href="https://github-redirect.dependabot.com/chardet/chardet/issues/171">#171</a>)</li> <li><a href="https://github.com/chardet/chardet/commit/55ef330ee105778d89597d95a738cda1b82d9497"><code>55ef330</code></a> Update links (<a href="https://github-redirect.dependabot.com/chardet/chardet/issues/152">#152</a>)</li> <li><a href="https://github.com/chardet/chardet/commit/e4290b6517c2e02c334b57fd8ded51db02c8a298"><code>e4290b6</code></a> Remove unnecessary numeric placeholders from format strings (<a href="https://github-redirect.dependabot.com/chardet/chardet/issues/176">#176</a>)</li> <li><a href="https://github.com/chardet/chardet/commit/6a59c4b19226231fc310a3c11e0be939a04f9b3e"><code>6a59c4b</code></a> Remove use of deprecated 'setup.py test' (<a href="https://github-redirect.dependabot.com/chardet/chardet/issues/187">#187</a>)</li> <li><a href="https://github.com/chardet/chardet/commit/4650dbfedd02f8e474c2ca775b741d1b08e40a18"><code>4650dbf</code></a> Remove shebang from nonexecutable script (<a href="https://github-redirect.dependabot.com/chardet/chardet/issues/192">#192</a>)</li> <li>Additional commits viewable in <a href="https://github.com/chardet/chardet/compare/3.0.4...4.0.0">compare view</a></li> </ul> </details> <br /> [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=chardet&package-manager=pip&previous-version=3.0.4&new-version=4.0.0)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
TheLovinator 2026-09-02 13:09:09 +02:00
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
TheLovinator/discord-twitter-webhooks#54
No description provided.