https://github.com/google-research/bert/blob/master/multilingual.md#list-of-languages\n\n104 languages, 12-layer, 768-hidden, 12-heads, 110M parameters","text":"Base BERT model, smaller variant. The list of supported languages is available here: https://github.com/google-research/bert/blob/master/multilingual.md#list-of-languages\n\n104 languages, 12-layer, 768-hidden, 12-heads, 110M parameters"},"_id":"64ff5ee9ea5699b59a75a871"},{"author":"google-bert","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/5dd96eb166059660ed1ee413/TmmBAiyUIfm_mM3OtySkw.png","fullname":"BERT community","name":"google-bert","type":"org","isHf":false,"isMod":false,"isEnterprise":false,"followerCount":167},"downloads":1781085,"gated":false,"id":"google-bert/bert-base-chinese","inference":"cold","lastModified":"2024-02-19T11:03:31.000Z","likes":1006,"pipeline_tag":"fill-mask","private":false,"repoType":"model","isLikedByUser":false,"widgetOutputUrls":[],"type":"model","position":5,"note":{"html":"Base BERT model, smaller variant. Chinese Simplified and Traditional, \n\n12-layer, 768-hidden, 12-heads, 110M parameters","text":"Base BERT model, smaller variant. Chinese Simplified and Traditional, \n\n12-layer, 768-hidden, 12-heads, 110M parameters"},"_id":"64ff6000e3201fff883b4b18"},{"author":"google-bert","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/5dd96eb166059660ed1ee413/TmmBAiyUIfm_mM3OtySkw.png","fullname":"BERT community","name":"google-bert","type":"org","isHf":false,"isMod":false,"isEnterprise":false,"followerCount":167},"downloads":6288,"gated":false,"id":"google-bert/bert-large-cased-whole-word-masking","inference":"not-popular-enough","lastModified":"2024-04-10T09:56:46.000Z","likes":15,"pipeline_tag":"fill-mask","private":false,"repoType":"model","isLikedByUser":false,"widgetOutputUrls":[],"type":"model","position":7,"note":{"html":"Large BERT model, larger variant. Trained on the \"cased\" dataset, meaning that it wasn't lowercase and all accents were kept.\n\nWhole word masking indicates a different preprocessing where entire words are masked rather than subwords. The BERT team reports better metrics with the wwm models.\n\n24-layer, 1024-hidden, 16-heads, 340M parameters","text":"Large BERT model, larger variant. Trained on the \"cased\" dataset, meaning that it wasn't lowercase and all accents were kept.\n\nWhole word masking indicates a different preprocessing where entire words are masked rather than subwords. The BERT team reports better metrics with the wwm models.\n\n24-layer, 1024-hidden, 16-heads, 340M parameters"},"_id":"64ff633970b6b05c5ab14be1"},{"author":"google-bert","authorData":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/5dd96eb166059660ed1ee413/TmmBAiyUIfm_mM3OtySkw.png","fullname":"BERT community","name":"google-bert","type":"org","isHf":false,"isMod":false,"isEnterprise":false,"followerCount":167},"downloads":28615,"gated":false,"id":"google-bert/bert-large-uncased-whole-word-masking","inference":"not-popular-enough","lastModified":"2024-02-19T11:08:36.000Z","likes":19,"pipeline_tag":"fill-mask","private":false,"repoType":"model","isLikedByUser":false,"widgetOutputUrls":[],"type":"model","position":8,"note":{"html":" Large BERT model, larger variant. Trained on the \"uncased\" dataset, meaning that it was lowercase and all accents were removed.\n\nWhole word masking indicates a different preprocessing where entire words are masked rather than subwords. The BERT team reports better metrics with the wwm models.\n\n24-layer, 1024-hidden, 16-heads, 340M parameters","text":" Large BERT model, larger variant. Trained on the \"uncased\" dataset, meaning that it was lowercase and all accents were removed.\n\nWhole word masking indicates a different preprocessing where entire words are masked rather than subwords. The BERT team reports better metrics with the wwm models.\n\n24-layer, 1024-hidden, 16-heads, 340M parameters"},"_id":"64ff6349990aaba7bb1c0b2d"}],"position":13,"theme":"pink","private":false,"shareUrl":"https://huggingface.co/collections/google/bert-release-64ff5e7a4be99045d1896dbc","upvotes":23,"isUpvotedByUser":false},"collections":[{"title":"MetricX-23","slug":"google/metricx-23-65c3b185c80ac8c06644a262"},{"title":"MetricX-24","slug":"google/metricx-24-6745102e7baa7dd7ddf97e04"},{"title":"Health AI Developer Foundations (HAI-DEF)","slug":"google/health-ai-developer-foundations-hai-def-6744dc060bc19b6cf631bb0f"},{"title":"Gemma 2 Release","slug":"google/gemma-2-release-667d6600fd5220e7b967f315"},{"title":"PaliGemma Release","slug":"google/paligemma-release-6643a9ffbf57de2ae0448dda"},{"title":"PaliGemma FT Models","slug":"google/paligemma-ft-models-6643b03efb769dad650d2dda"},{"title":"CodeGemma Release","slug":"google/codegemma-release-66152ac7b683e2667abdee11"},{"title":"RecurrentGemma Release","slug":"google/recurrentgemma-release-66152cbdd2d6619cb1665b7a"},{"title":"Gemma release","slug":"google/gemma-release-65d5efbccdbb8c4202ec078b"},{"title":"Gemma 2 2B Release","slug":"google/gemma-2-2b-release-66a20f3796a2ff2a7c76f98f"},{"title":"ShieldGemma Release","slug":"google/shieldgemma-release-66a20efe3c10ef2bd5808c79"},{"title":"Gemma Scope Release","slug":"google/gemma-scope-release-66a4271f6f0b4d4a9d5e04e2"},{"title":"BERT release","slug":"google/bert-release-64ff5e7a4be99045d1896dbc"},{"title":"ALBERT release","slug":"google/albert-release-64ff65ba18830fabea2f2cec"},{"title":"ELECTRA release","slug":"google/electra-release-64ff6e8b18830fabea30a1ab"},{"title":"Flan-T5 release","slug":"google/flan-t5-release-65005c39e3201fff885e22fb"},{"title":"T5 release","slug":"google/t5-release-65005e7c520f8d7b4d037918"},{"title":"MT5 release","slug":"google/mt5-release-65005f1a520f8d7b4d039509"},{"title":"SEAHORSE release","slug":"google/seahorse-release-6543b0c06d87d83c6d24193b"},{"title":"Switch-Transformers release ","slug":"google/switch-transformers-release-6548c35c6507968374b56d1f"},{"title":"SigLIP","slug":"google/siglip-659d5e62f0ae1a57ae0e83ba"},{"title":"IndicGenBench","slug":"google/indicgenbench-663185166ea914038209b723"},{"title":"ImageInWords Release","slug":"google/imageinwords-release-6645be087eebfc1c76cebcf9"},{"title":"DataGemma Release","slug":"google/datagemma-release-66df7636084d2b150a4e6643"},{"title":"Gemma-APS Release","slug":"google/gemma-aps-release-66e1a42c7b9c3bd67a0ade88"},{"title":"TimesFM Release","slug":"google/timesfm-release-66e4be5fdb56e960c1e482a6"},{"title":"Gemma 2 JPN Release","slug":"google/gemma-2-jpn-release-66f5d3337fdf061dff76a4f1"}],"upvoters":[{"_id":"6032802e1f993496bc14d9e3","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6032802e1f993496bc14d9e3/w6hr-DEQot4VVkoyRIBiy.png","isPro":false,"fullname":"Omar Sanseviero","user":"osanseviero","type":"user"},{"_id":"62441d1d9fdefb55a0b7d12c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1648631057413-noauth.png","isPro":false,"fullname":"Younes Belkada","user":"ybelkada","type":"user"},{"_id":"6255c25a4ffc294ab02e161f","avatarUrl":"/avatars/53434a232333c84126353a3ca5c79174.svg","isPro":false,"fullname":"Czas09","user":"czas09","type":"user"},{"_id":"63107b18e87051f3e3e0f598","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/63107b18e87051f3e3e0f598/R9onir4Y0MZuq1jEWCZ2-.jpeg","isPro":false,"fullname":"Unchun Yang","user":"ucyang","type":"user"}]}">